nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-24 10:18:15 +00:00

250 lines
2.6 KiB
Text

ALittle Client
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Anarchy99
Apexoo
AwarioSmartBot
BBBike
BDCbot
BLEXBot
BackWeb
Badass
Barkrowler
Battleztar Bazinga
BetaBot
Bitacle
Black Hole
BlackWidow
Blow
BotALot
Brandprotect
Buck
CATExplorador
CCBot
Calculon
Cegbfeieh
CheTeam
CheeseBot
CherryPicker
Cloud mapping
Cocolyzebot
CopyRightCheck
CrunchBot
CyotekWebCopy
DBLBot
DSearch
Demon
Deusu
Devil
Digincore
Dirbuster
Disco
Discoverybot
Dispatch
DnyzBot
DomainCrawler
Dragonfly
Drip
ECCP/1.0
Ebingbong
Ecxi
Evil
Exabot
ExtLinksBot
ExtractorPro
EyeNetIE
FemtosearchBot
FlashGet
FrontPage
Fuzz
Fyrebot
G-i-g-a-b-o-t
GetRight
Getintent
Go!Zilla
Go-Ahead-Got-It
Grabber
GrapeFX
GridBot
HTMLparser
HTTP::Lite
Harvest
Humanlinks
IDBTE4M
Iblog
Id-search
Indy Library
Intelliseek
Internet Ninja
InternetSeer
JamesBOT
JennyBot
Jetty
Joomla
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LNSpiderguy
Lanshanbot
Leap
LeechGet
LexiBot
Libwhisker
LieBaoFast
Lightspeedsystems
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
MFC_Tear_Sample
MIDown tool
MJ12bot
Mag-Net
Magnet
MarkWatch
Mata Hari
MeanPath Bot
Metauri
Microsoft URL Control
Mister PiX
Msrabot
Musobot
Nameprotect
NearSite
Needle
Net Vampire
NetLyzer
NetSpider
NetZIP
Nettrack
Netvibes
Nikto
NimbleCrawler
Nuclei
Offline Explorer
Openfind
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Pandalytics
Panscient
Papa Foto
Pavuk
PeoplePal
Picscout
Pimonster
PleaseCrawl
ProPowerBot
Probethenet
Psbot
RankFlex
Rankivabot
RankurBot
Re-re
ReGet
RealDownload
RebelMouse
RedesScrapy
RepoMonkey
SalesIntelligent
SemrushBot
SeoSiteCheckup
SeobilityBot
Shodan
Site Sucker
SiteExplorer
SiteLockSpider
SiteSucker
SlySearch
Snapbot
Snoopy
Sosospider
Sottopop
SpaceBison
Sucker
SuperBot
SurveyBot
Suzuran
Swiftbot
T0PHackTeam
Teleport
TeleportPro
Telesoft
TheNomad
Toata
Tracemyfile
True_Robot
TurnitinBot
TwengaBot
Typhoeus
URLy.Warning
Upflow
VeriCiteCrawler
Virusdie
WISENutbot
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
WeSEE
Web Collage
Web Enhancer
Web Pix
WebBandit
WebFetch
WebFuck
WebReaper
WebStripper
WebZIP
Website Quester
WebsiteQuester
Whack
Whatweb
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wotbox
Wprecon
Xenu
Zauba
Zermelo
Zitebot
ZmEu
ZoominfoBot
ZumBot
arquivo-web-crawler
arquivo.pt
cah.io.community
clark-crawler
com.plumanalytics
crawl.sogou.com
demandbase-bot
eCatch
evc-batch
facebookscraper
instabid
isitwp.com
meanpathbot
mediawords
muhstik-scan
page scorer
plumanalytics
ripz
s1z.ru
scalaj-http
sexsearcher
sogouspider
sp_auditbot
sysscan
trendiction.de
voyagerx.com
webmeup-crawler
webpros.com
x09Mozilla
xpymep1.exe
zauba.io