nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-03-11 22:07:58 +00:00

100 lines
1.1 KiB
Text

404enemy
ADmantX
AiHitBot
AlphaBot
Aspiegel
AwarioBot
AwarioRssBot
Backlink-Ceck
Bandit
BatchFTP
BetaBot
Boardreader
Buddy
BunnySlippers
Bytespider
CODE87
ChinaClaw
Cliqzbot
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
Dirbuster
Disco
Dispatch
DomainStatsBot
Dragonfly
EyeNetIE
Fyrebot
GetRight
Getintent
HMView
Haansoft
HaosouSpider
Hloader
HybridBot
Indy Library
InfoNaviRobot
InternetMeasurement
InternetSeer
JikeSpider
Leap
LinqiaScrapeBot
Lmspider
MIDown tool
Mass Downloader
MauiBot
Mediatoolkitbot
Microsoft Data Access
Mojeek
Morfeus Fucking Scanner
NPbot
NetSpider
Nutch
OpenVAS
OrangeSpider
Petalbot
Pi-Monster
ProPowerBot
RealDownload
Searchestate
Semrush
SenutoBot
SeoCherryBot
SeobilityBot
Shodan
SiteSnagger
Siteimprove
SocialRankIOBot
Sosospider
SputnikBot
Steeler
TheNomad
Thumbor
TightTwatBot
TinyTestBot
VCI
WWW::Mechanize
WeSEE
Web Auto
WebsiteExtractor
Who.is Bot
Xaldon WebSpider
Xaldon_WebSpider
ZyBorg
archive.org_bot
cohere-ai
crawler.feedback
crawler4j
dataforseobot
demandbase-bot
lwp-trivial
meanpathbot
netEstate NE Crawler
pcBrowser
satoristudio.net
seoscanners
seostar
sitechecker.pro
zauba.io