nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-08-07 10:14:30 +00:00

100 lines
1 KiB
Text

80legs
ASPSeek
Apexoo
AwarioBot
BDCbot
Backlink-Ceck
Bigfoot
Black Hole
BotALot
BuiltBotTough
BunnySlippers
CSHttp
Citoid
CopyRightCheck
CrunchBot
DTS Agent
Deusu
Digincore
DittoSpyder
Download Wonder
Drip
ECCP/1.0
Extractor
ExtractorPro
FDM
FacebookBot
FlashGet
Genieo
Gigabot
HMView
Harvest
Havij
IDBTE4M
IDBot
InfoNaviRobot
Iskanie
JamesBOT
Jbrofuzz
JetCar
Jetty
Jyxobot
Keyword Density
Kinza
LeechFTP
LeechGet
LinqiaRSSBot
Lipperhey Spider
MSIECrawler
Magnet
MarkMonitor
Mister PiX
Needle
NetLyzer
NetSpider
NetZIP
Niki-bot
OpenLinkProfiler
POE-Component-Client-HTTP
PictureFinder
PxBroker
SBIder
SEOkicks-Robot
ScrepyBot
SemrushBot-SI
SentiBot
Shodan
Siphon
SiteAuditBot
SiteSnagger
Sottopop
Sqlmap
Stripper
SuperHTTP
TinyTestBot
TwengaBot
VidibleScraper
WBSearchBot
Web Collage
Web Enhancer
WebPix
Webalta
Website Quester
ZmEu
ZyBorg
coccocbot
crawler.feedback
iubenda-radar
linkdexbot
lwp-request
muhstik-scan
plumanalytics
s1z.ru
scalaj-http
scan.lol
seobility
seocompany.store
serpstatbot
sogouspider
webgains-bot
webpros.com