nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-07-17 22:09:12 +00:00

100 lines
1 KiB
Text

Aboundex
AhrefsBot
Apexoo
Atomseobot
AwarioBot
AwarioRssBot
BackWeb
Backlink-Ceck
BacklinkCrawler
BatchFTP
BotALot
Buck
Buddy
Bytespider
CODE87
CensysInspect
CheTeam
CheeseBot
Collector
Cosmos
Crawling at Home Project
CrunchBot
DIIbot
DatabaseDriverMysqli
Demon
Download Wonder
EMail Wolf
EroCrawler
ExtractorPro
FlashGet
Flunky
FrontPage
Fuzz
GetWeb
Gigabot
Gotit
GridBot
HEADMasterSEO
HTTrack
Intelliseek
Internet Ninja
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
Kozmosbot
LNSpiderguy
Lmspider
Mass Downloader
Moblie Safari
Musobot
Needle
NetAnts
NetZIP
Nibbler
Nmap
Offline Explorer
Offline Navigator
PageAnalyzer
Picscout
ProWebWalker
PxBroker
Rainbot
RankActive
RankFlex
SBIder
SEOkicks
ScrepyBot
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Shodan
SiteAuditBot
Sociscraper
Sosospider
SputnikBot
Sucker
Telesphoreo
Trendictionbot
Typhoeus
Virusdie
Voltron
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Web Collage
Webshag
Xaldon WebSpider
Zitebot
anthropic-ai
cohere-ai
heritrix
muhstik-scan
pcBrowser
seobility
seocompany.store
serpstatbot
sogouspider
zgrab