nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-07-16 08:16:58 +00:00

100 lines
1 KiB
Text

404enemy
ADmantX
AIBOT
Alexibot
AwarioRssBot
BBBike
BDCbot
Badass
Bandit
BatchFTP
BlackWidow
Bolt
BuiltWith
Bullseye
Bytespider
CCBot
CODE87
CSHttp
Calculon
Citoid
ClaudeBot
Cloud mapping
CrazyWebCrawler
DBLBot
DIIbot
Domains Project
ECCP/1.0
Ebingbong
Express WebPictures
Go!Zilla
GrapeshotCrawler
HMView
HTTrack
Hloader
HonoluluBot
HybridBot
Image Fetch
Intelliseek
InterGET
Kozmosbot
LNSpiderguy
LWP::Simple
Larbin
LeechFTP
LexiBot
Lightspeedsystems
Likse
LinqiaMetadataDownloaderBot
MSIECrawler
Majestic12
MauiBot
MegaIndex.ru
Metauri
NPbot
NetLyzer
OpenLinkProfiler
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageScorer
Papa Foto
Petalbot
RankurBot
ReGet
SEOkicks-Robot
SEOlyt
ScanAlert
Scanbot
SeekportBot
SemanticJuice
Seomoz
Sitevigil
Spammen
SurveyBot
T0PHackTeam
Trendiction
URLy Warning
Upflow
VidibleScraper
VoidEYE
Wallpapers
Wallpapers/3.0
Web Fetch
WebmasterWorldForumBot
Webster
Whatweb
Xenu
Zeus
crawler4j
demandbase-bot
everyfeed-spider
instabid
oBot
probe-image-size
satoristudio.net
sp_auditbot
sysscan
tAkeOut
trendiction.de
webmeup-crawler