nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-01-19 10:07:10 +00:00

100 lines
1 KiB
Text

Aboundex
Acunetix
AdsTxtCrawlerTP
Ankit
BackDoorBot
BackWeb
Bandit
Barkrowler
BatchFTP
BlackWidow
Blow
Buddy
CSHttp
CazoodleBot
CensysInspect
Citoid
Claritybot
Cloud mapping
Copyscape
Crescent
DataCha0s
DigitalPebble
Disco
Download Wonder
Dragonfly
Ebingbong
FemtosearchBot
Fimap
GrabNet
Heritrix
Humanlinks
Iblog
InterGET
IstellaBot
JOC Web Spider
Jorgee
Jyxobot
LieBaoFast
Likse
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
MarkWatch
Morfeus Fucking Scanner
NetAnts
NextGenSearchBot
Nmap
Nutch
Openfind
PHPCrawl
POE-Component-Client-HTTP
PageScorer
Pavuk
Picscout
PleaseCrawl
Ripper
SalesIntelligent
SearchmetricsBot
Seekport
SemanticJuice
SentiBot
Snoopy
Spammen
Spinn3r
Sucuri
SuperBot
Swiftbot
Teleport
TeleportPro
Titan
Tracemyfile
Trendiction
Typhoeus
URLy.Warning
VB Project
Voltron
Wallpapers/3.0
WeSEE
Web Auto
Web Fetch
Web Sucker
WebGo IS
WebLeacher
WebReaper
WebZIP
Website Quester
WebsiteExtractor
Webster
Widow
WiseGuys Robot
YoudaoBot
ZoomBot
coccocbot
crawl.sogou.com
page scorer
plumanalytics
seocompany.store
seostar
sogouspider
trendiction.de