nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-09 22:04:49 +00:00

100 lines
1 KiB
Text

404enemy
Aboundexbot
Atomseobot
BBBike
BLEXBot
BackStreet
Backlink-Ceck
BacklinksExtendedBot
Barkrowler
Bigfoot
Black Hole
Blackboard
Buddy
Bullseye
Bytespider
Cegbfeieh
Claritybot
DataCha0s
Deusu
DomainCrawler
DomainStatsBot
Dotbot
Ebingbong
FHscan
FemtosearchBot
GalaxyBot
Genieo
GrabNet
HonoluluBot
HybridBot
IDBTE4M
InfoNaviRobot
InfoTekies
InternetMeasurement
JikeSpider
Kenjin Spider
LWP::Simple
Leap
Likse
Linkbot
MIIxpc
Mass Downloader
MeanPath Bot
Mister PiX
Msrabot
NetLyzer
Nibbler
Niki-bot
Ninja
Nutch
OnCrawl
PECL::HTTP
Pandalytics
Psbot
RankurBot
SEOstats
SemanticJuice
SeobilityBot
SiteSnagger
SiteSucker
Snoopy
Spammen
Spanner
Sqworm
Surfbot
Swiftbot
TinyTestBot
Twice
Typhoeus
V-BOT
Voltron
Web Auto
WebFetch
WebImageCollector
WebReaper
Widow
Woobot
Xaldon_WebSpider
Xenu
Zade
Zauba
Zermelo
ZyBorg
check1.exe
cognitiveseo
crawl.sogou.com
dataforseobot
eCatch
linkfluence
lwp-trivial
meanpathbot
netEstate NE Crawler
seostar
sysscan
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webprosbot
x09Mozilla
x22Mozilla