nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-07-19 22:08:17 +00:00

100 lines
1 KiB
Text

404checker
404enemy
Alligator
Anarchy
Attach
AwarioSmartBot
BDFetch
BLEXBot
Battleztar Bazinga
Boardreader
Brandwatch
BuiltBotTough
BunnySlippers
CCBot
CODE87
Calculon
CazoodleBot
CensysInspect
CheeseBot
ChinaClaw
Cliqzbot
Crawling at Home Project
DIIbot
DTS Agent
Demon
Deusu
DomainAppender
DomainCrawler
Dotbot
ECCP/1.0
EroCrawler
Exabot
FrontPage
FyberSpider
GPTBot
GermCrawler
GetRight
GetWeb
HTMLparser
IDBot
Iblog
Image Sucker
Information Security Team InfraSec Scanner
InfraSec Scanner
Larbin
LinkScan
LinqiaRSSBot
Lipperhey
Mass Downloader
Navroad
NetLyzer
Nikto
NimbleCrawler
PECL::HTTP
PageAnalyzer
PeoplePal
Picsearch
Piepmatz
PleaseCrawl
Pump
QueryN Metasearch
RocketCrawler
SEOlyticsCrawler
ScreenerBot
Searchestate
Seekport
Semrush
SiteExplorer
SpankBot
Spanner
SputnikBot
Sqlworm
Sqworm
Sucuri
Szukacz
T8Abot
TwengaBot
Typhoeus
URLy Warning
Upflow
VeriCiteCrawler
Voltron
WEBDAV
WebSauger
WebSucker
WebZIP
Whack
WinHTTrack
Xaldon_WebSpider
YaK
Zitebot
com.plumanalytics
eCatch
everyfeed-spider
gopher
plumanalytics
s1z.ru
scalaj-http
x09Mozilla
x22Mozilla