nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-27 22:04:43 +00:00

100 lines
1.1 KiB
Text

AdsTxtCrawlerTP
BDFetch
BacklinksExtendedBot
Badass
Brandprotect
CheeseBot
CherryPicker
Collector
Copyscape
Crescent
Devil
Discoverybot
DittoSpyder
DomainAppender
Domains Project
Download Wonder
Ebingbong
Evil
Exabot
Ezooms
FHscan
Foobot
Freeuploader
FyberSpider
G-i-g-a-b-o-t
GetWeb
Gotit
HybridBot
InfoTekies
Joomla
Lanshanbot
LibWeb
LieBaoFast
Lightspeedsystems
LinkScan
Linkbot
LinkextractorPro
MSFrontPage
MicroMessenger
Mister PiX
NetZIP
Niki-bot
Nimbostratus
Ninja
OpenLinkProfiler
Openfind
Page Analyzer
Pavuk
Picscout
Pockey
Probethenet
RankActiveLinkBot
RankFlex
RankurBot
SEOkicks-Robot
SEOlyticsCrawler
ScanAlert
Scanbot
ScoutJet
SearchmetricsBot
SentiBot
SenutoBot
SeobilityBot
Sitebeam
Sosospider
Sucker
SuperBot
Swiftbot
T0PHackTeam
T8Abot
Telesphorep
Tracemyfile
Turingos
UnisterBot
Vacuum
WeSEE
Web Pix
Web Sucker
WebCopier
WebLeacher
Webalta
WebmasterWorldForumBot
Website Quester
Webster
Whatweb
Woobot
Zade
Zermelo
archive.org_bot
autoemailspider
check1.exe
crawl.sogou.com
instabid
internetVista monitor
mediawords
pcBrowser
seobility
seoscanners
sitechecker.pro
x09Mozilla