nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-06-30 22:04:52 +00:00

100 lines
1,008 B
Text

404enemy
80legs
AhrefsBot
AwarioBot
Bandit
BlackWidow
BlowFish
CCBot
CherryPicker
Cliqzbot
CrunchBot
Deusu
Devil
DomCopBot
DomainSigmaCrawler
EasyDL
Exabot
Extreme Picture Finder
FDM
Fuzz
GPTBot
GermCrawler
GetWeb
Go-Ahead-Got-It
Harvest
InfraSec Scanner
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
Kinza
LNSpiderguy
LeechFTP
LibWeb
LieBaoFast
Linkbot
Litemage_walker
Ltx71
MJ12bot
MarkWatch
Masscan
MauiBot
MegaIndex.ru
Mister PiX
Mojolicious
Mr.4x3
NICErsPRO
NPbot
Nameprotect
NearSite
Netvibes
Nikto
NimbleCrawler
Page Analyzer
Pi-Monster
Pu_iN
Pump
Rainbot
RankingBot2
Rankivabot
ReGet
Rogerbot
SEOkicks
SemanticJuice
SeobilityBot
Seomoz
SiteExplorer
SiteSnagger
Sitebeam
Siteimprove
Spinn3r
SputnikBot
Suzuran
Telesphoreo
Toata
True_Robot
Twice
VCI
VidibleScraper
WEBDAV
WISENutbot
WeSEE
Web Fetch
WebGo IS
WebImageCollector
Webster
Zade
anthropic-ai
awario.com
check1.exe
clark-crawler
coccocbot
com.plumanalytics
crawler4j
evc-batch
heritrix
instabid
seobility
siteripz
spyfu
x22Mozilla