nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-01-29 12:15:04 +00:00

100 lines
1 KiB
Text

404enemy
ADmantX
Acunetix
BBBike
BLEXBot
BackDoorBot
Badass
Bandit
BatchFTP
BetaBot
Bitacle
BlowFish
Bolt
BotALot
BuiltBotTough
BuiltWith
CazoodleBot
CensysInspect
CheeseBot
CopyRightCheck
Crawling at Home Project
CyotekWebCopy
DigitalPebble
DomCopBot
DomainStatsBot
Dotbot
Drip
Ebingbong
EyeNetIE
Firefox/7.0
Grafula
GrapeFX
GrapeshotCrawler
GridBot
Haansoft
Havij
Heritrix
HonoluluBot
Humanlinks
Image Fetch
InfoNaviRobot
JetCar
Joomla
Jorgee
LNSpiderguy
LeechFTP
LinkScan
Lipperhey
MIDown tool
Masscan
Microsoft URL Control
Morfeus Fucking Scanner
NetSpider
Nettrack
Petalbot
Probethenet
PyCurl
RankActive
Re-re
ReGet
SBIder
SEOkicks
SISTRIX
SalesIntelligent
Seekport
SenutoBot
SeobilityBot
SiteCheckerBotCrawler
Sqworm
Sucker
Surfbot
SurveyBot
TeleportPro
Thumbor
TightTwatBot
Turingos
Twice
UnisterBot
VeriCiteCrawler
WASALive-Bot
WebEnhancer
WebLeacher
WebReaper
WebStripper
WebWhacker
Webalta
Webster
Xaldon_WebSpider
Xenu
Zade
ZyBorg
arquivo-web-crawler
arquivo.pt
crawler4j
linkdexbot
meanpathbot
satoristudio.net
seobility
x09Mozilla
zgrab