nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-09-24 22:04:47 +00:00

100 lines
1 KiB
Text

360Spider
AfD-Verbotsverfahren
Anarchie
Anarchy99
Ankit
Apexoo
BackDoorBot
BackStreet
BacklinksExtendedBot
Barkrowler
BatchFTP
Bitacle
BlackWidow
Blow
Brandprotect
BuiltBotTough
CensysInspect
CopyRightCheck
CrazyWebCrawler
CrunchBot
CyotekWebCopy
DBLBot
DatabaseDriverMysqli
Dirbuster
Discobot
Download Wonder
Drip
EMail Wolf
Evil
FHscan
FacebookBot
GT::WWW
GoZilla
Gotit
Grabber
GrapeFX
HTMLparser
HTTrack
Harvest
HonoluluBot
LNSpiderguy
LieBaoFast
MJ12bot
MTRobot
MeanPath Bot
Meanpathbot
MegaIndex.ru
Metauri
Mojolicious
NearSite
Needle
Nettrack
Nmap
Nutch
Offline Navigator
OutclicksBot
Picscout
Pimonster
Pump
PxBroker
RankingBot2
RebelMouse
SEOlyt
Searchestate
Semrush
SeobilityBot
SiteCheckerBotCrawler
SiteSnagger
Sitebeam
Sociscraper
Sogou web spider
Sosospider
Sottopop
Sucuri
Telesoft
The Intraformant
TinyTestBot
True_Robot
Typhoeus
URLy.Warning
Vagabondo
WPScan
WebStripper
Webster
Widow
Zeus
adscanner
arquivo-web-crawler
cah.io.community
crawl.sogou.com
crawler4j
page scorer
pcBrowser
ripz
scalaj-http
scan.lol
seobility
sitechecker.pro
sysscan
xpymep1.exe