nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-04-12 10:10:46 +00:00

100 lines
1.1 KiB
Text

80legs
Aboundex
Asterias
Attach
AwarioSmartBot
BDCbot
BotALot
Buck
Buddy
Bullseye
Bytespider
ChinaClaw
ClaudeBot
CyotekWebCopy
DatabaseDriverMysqli
Discoverybot
DnBCrawler-Analytics
DomCopBot
DomainAppender
Dragonfly
EasyDL
EirGrabber
ExtLinksBot
FDM
Fuzz
GPTBot
Grabber
Image Sucker
Information Security Team InfraSec Scanner
Internet Ninja
JOC Web Spider
Jorgee
Jyxobot
Kozmosbot
LWP::Simple
LexiBot
LinkScan
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
MJ12bot
Mass Downloader
Mb2345Browser
MeanPath Bot
MolokaiBot
Name Intelligence
Nameprotect
Nessus
NetAnts
Nettrack
Nibbler
OpenLinkProfiler
OutclicksBot
Pandalytics
PeoplePal
Pixray
ProWebWalker
Pu_iN
PyCurl
RSSingBot
Rankivabot
RankurBot
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
Screaming
SenutoBot
Seomoz
Shodan
SiteAuditBot
SiteExplorer
SiteSnagger
SiteSucker
SmartDownload
Sogou web spider
Spider_Bot/3.0
Sqworm
SuperBot
SurveyBot
TightTwatBot
Toata
VeriCiteCrawler
WBSearchBot
WebEnhancer
WebFetch
WebReaper
WebStripper
Webalta
WebmasterWorldForumBot
Xaldon WebSpider
autoemailspider
clark-crawler
iubenda-radar
omgili
scan.lol
sexsearcher
siteripz
sp_auditbot
sysscan
x09Mozilla