nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-11 22:04:50 +00:00

100 lines
1 KiB
Text

ADmantX
AIBOT
Aboundex
AfD-Verbotsverfahren
Alexibot
Anarchy99
BackWeb
Barkrowler
Battleztar Bazinga
Bigfoot
Blackboard
Blow
Bolt
BotALot
Buck
Bullseye
CODE87
Citoid
CopyRightCheck
Copyscape
CrunchBot
Custo
DIIbot
Devil
Dotbot
EMail Wolf
Extractor
Flunky
Freeuploader
Gotit
HTTP::Lite
HaosouSpider
Havij
Iblog
Internet Ninja
JennyBot
Joomla
Jyxobot
Kinza
LNSpiderguy
LWP::Simple
LeechGet
LibWeb
Lmspider
MFC_Tear_Sample
MJ12bot
Mass Downloader
MeanPath Bot
Meanpathbot
Metauri
MicroMessenger
Musobot
NICErsPRO
Net Vampire
Netvibes
Niki-bot
Offline Navigator
Openvas
OrangeSpider
PECL::HTTP
Proximic
RepoMonkey
SEOlyticsCrawler
SMTBot
SalesIntelligent
Screaming
SemanticJuice
SiteCheckerBotCrawler
SlySearch
Sogou web spider
Spammen
Spider_Bot
Spider_Bot/3.0
Sucuri
Telesoft
TightTwatBot
Toata
Turnitin
URLy.Warning
WWW::Mechanize
Wallpapers/3.0
WeSEE
Web Auto
Web Collage
Web Fetch
WebLeacher
WebSauger
WebWhacker
Wonderbot
Zade
Zitebot
ZmEu
arquivo-web-crawler
crawler4j
dataforseo.com
dataforseobot
evc-batch
facebookscraper
seocompany.store
x22Mozilla