nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-11-04 10:07:45 +00:00

100 lines
1,020 B
Text

01h4x.com
Abonti
Aboundex
Aboundexbot
Alexibot
Apexoo
Aspiegel
Asterias
Black Hole
BuiltWith
Bullseye
CATExplorador
CSHttp
Chlooe
Cloud mapping
Cocolyzebot
CrazyWebCrawler
DIIbot
Demon
DigitalPebble
DomainAppender
DomainCrawler
Dotbot
EroCrawler
EyeNetIE
FlashGet
GPTBot
Getintent
HybridBot
IRLbot
InfoTekies
Iskanie
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
Kinza
LNSpiderguy
Lftp
Lightspeedsystems
LinkextractorPro
LinksManager
MTRobot
Metauri
Mr.4x3
Msrabot
NetLyzer
NetSpider
Nibbler
Nmap
Octopus
OnCrawl
OpenVAS
PHPCrawl
PictureFinder
Pimonster
RankurBot
Re-re
RebelMouse
Rogerbot
SMTBot
ScanAlert
Scanbot
Screaming
SemanticJuice
SentiBot
Seomoz
Shodan
Sitebeam
Sottopop
Spbot
Sucker
SuperBot
SuperHTTP
Surfbot
Szukacz
The Intraformant
TheNomad
Thumbor
TinyTestBot
Tracemyfile
VB Project
VelenPublicWebCrawler
Virusdie
Web Auto
Web Collage
Web Fuck
Web Sucker
WebsiteQuester
ZumBot
autoemailspider
cohere-ai
crawler4j
eCatch
facebookscraper
gopher
lwp-request
oBot
page scorer
pcBrowser
sp_auditbot