nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-09-19 10:07:41 +00:00

100 lines
1 KiB
Text

01h4x.com
Anarchy
Asterias
BDFetch
BLEXBot
Bandit
Battleztar Bazinga
Bigfoot
BotALot
Brandprotect
BuiltWith
CCBot
CSHttp
CheTeam
Claritybot
CrunchBot
DataCha0s
Deusu
Devil
Digincore
Discobot
DnyzBot
Drip
FrontPage
FyberSpider
GetRight
Go!Zilla
HTMLparser
HaosouSpider
Havij
HybridBot
IndeedBot
InfoNaviRobot
Iria
Jyxobot
Keybot Translation-Search-Machine
LinkScan
LinkpadBot
Masscan
Meanpathbot
Metauri
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Name Intelligence
NetLyzer
NetMechanic
Nettrack
Nutch
OutfoxBot
PHPCrawl
Panscient
Pimonster
Pump
RankurBot
Ripper
SEOkicks-Robot
SMTBot
ScrepyBot
SenutoBot
Siphon
SiteSnagger
SiteSucker
Snake
Sosospider
SpaceBison
Spinn3r
Stripper
Suzuran
TeleportPro
Toata
Turingos
Typhoeus
URLy Warning
UnisterBot
VidibleScraper
WBSearchBot
WWW-Collector-E
WebBandit
WebCopier
WebFetch
WebReaper
WebSauger
WebSucker
WebmasterWorldForumBot
WebsiteQuester
Whatweb
Wotbox
YoudaoBot
ZoomBot
ZumBot
eCatch
linkdexbot
lwp-trivial
magpie-crawler
pcBrowser
seocompany.store
serpstatbot
sitechecker.pro
sysscan