nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-08-03 22:08:24 +00:00

100 lines
1.1 KiB
Text

01h4x.com
404enemy
Aboundex
AhrefsBot
AliyunSecBot
Anarchy
Anthill
Attach
BBBike
BDFetch
BunnySlippers
Calculon
CheTeam
Cocolyzebot
Copyscape
Crawling at Home Project
CrunchBot
Curious
DBLBot
DSearch
DTS Agent
DnBCrawler-Analytics
DomCopBot
Domains Project
Extractor
EyeNetIE
Ezooms
FacebookBot
FemtosearchBot
Fimap
FyberSpider
GermCrawler
Getintent
Go!Zilla
Gotit
Id-search
Image Sucker
IndeedBot
Indy Library
InfraSec Scanner
Iria
Iskanie
JOC Web Spider
Jetty
Jyxobot
LNSpiderguy
LeechFTP
Lftp
LinkScan
LinkextractorPro
LinqiaMetadataDownloaderBot
MSFrontPage
MSIECrawler
MarkMonitor
NetLyzer
NetZIP
NimbleCrawler
Offline Explorer
OpenLinkProfiler
PageAnalyzer
PageThing.com
Papa Foto
Pixray
Reaper
Ripper
SEOlyt
ScrepyBot
SemanticJuice
SemrushBot
SemrushBot-SI
SeoCherryBot
SmartDownload
Sociscraper
Sottopop
SplitSignalBot
Telesphoreo
Trendiction
Typhoeus
URLy Warning
V-BOT
VB Project
WallpapersHD
Web Fuck
Web Sauger
WebEnhancer
WebFuck
WebsiteExtractor
Whacker
WinHTTrack
Wonderbot
YaK
ZyBorg
anthropic-ai
coccocbot
cohere-ai
muhstik-scan
openai
scalaj-http
sitechecker.pro
spyfu