nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-03-19 10:07:15 +00:00

100 lines
1,019 B
Text

ADmantX
AIBOT
AhrefsBot
Anarchy
Asterias
Battleztar Bazinga
BetaBot
CATExplorador
CCBot
CensysInspect
Cocolyzebot
CrunchBot
Custo
Demon
DomainAppender
DomainCrawler
Domains Project
Download Wonder
Exabot
Ezooms
Firefox/7.0
HaosouSpider
Havij
Humanlinks
Id-search
IlseBot
InfoNaviRobot
InterGET
Joomla
Jorgee
Likse
MFC_Tear_Sample
Majestic SEO
MauiBot
Meanpathbot
Moblie Safari
Morfeus Fucking Scanner
NICErsPRO
NetLyzer
NetMechanic
Nettrack
Netvibes
Nmap
Not
Nuclei
Octopus
Offline Navigator
PageAnalyzer
PageScorer
PageThing.com
Pixray
Pockey
ProPowerBot
SISTRIX
Scrapy
Seekport
SentiBot
SeobilityBot
Seomoz
Shodan
Sitebeam
SmartDownload
Sogou web spider
Spanner
Spbot
Sqworm
SuperBot
T0PHackTeam
Tracemyfile
Trendictionbot
URLy.Warning
Upflow
VB Project
Vacuum
Voltron
WASALive-Bot
WEBDAV
WeSEE
Web Enhancer
Web Fuck
Web Pix
WebCollage
WebStripper
WebSucker
WebsiteQuester
Whacker
Woobot
Xaldon WebSpider
Xenu
ZyBorg
crawler.feedback
evc-batch
gopher
mediawords
ripz
scalaj-http
scan.lol
sysscan
tAkeOut
webgains-bot