nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-06-01 10:07:07 +00:00

100 lines
1.1 KiB
Text

AIBOT
Aboundexbot
AhrefsBot
Attach
BackWeb
Barkrowler
Battleztar Bazinga
Black Hole
Blackboard
Buck
CATExplorador
CCBot
Collector
CyotekWebCopy
Discoverybot
ECCP/1.0
EasyDL
Evil
ExtractorPro
Extreme Picture Finder
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
Flunky
Go-Ahead-Got-It
GoZilla
Havij
IDBot
IRLbot
Information Security Team InfraSec Scanner
InfraSec Scanner
Iskanie
IstellaBot
JetCar
LieBaoFast
Linkbot
LinqiaRSSBot
Mail.RU_Bot
MarkMonitor
MarkWatch
Mata Hari
Meanpathbot
Microsoft Data Access
Moblie Safari
MolokaiBot
NetAnts
PageScorer
Pu_iN
Pump
Rainbot
RankurBot
Recorder
RedesScrapy
SEOstats
ScoutJet
ScreenerBot
SemrushBot
SenutoBot
SeobilityBot
Siphon
Site Sucker
SiteLockSpider
Snake
Snapbot
Sottopop
SpankBot
Spinn3r
SputnikBot
Sqworm
TinyTestBot
Toata
Tracemyfile
True_Robot
VidibleScraper
WWW-Collector-E
WWW-Mechanize
WeSEE
WebReaper
Webalta
WebsiteQuester
Webster
Whatweb
WiseGuys Robot
Xenu
adscanner
cohere-ai
crawler.feedback
demandbase-bot
gopher
imagesift.com
ips-agent
linkdexbot
meanpathbot
page scorer
sp_auditbot
trendiction.com
webmeup-crawler
x09Mozilla
zauba.io