nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-25 22:08:00 +00:00

100 lines
1 KiB
Text

ADmantX
AdsTxtCrawlerTP
BacklinksExtendedBot
BetaBot
BlackWidow
Blow
Cegbfeieh
ChinaClaw
Claritybot
Copier
DSearch
DigitalPebble
DnyzBot
DomainCrawler
Domains Project
EMail Siphon
Evil
Exabot
Ezooms
FacebookBot
FemtosearchBot
FyberSpider
GT::WWW
GermCrawler
HMView
InfraSec Scanner
InterGET
Jorgee
Keyword Density
Kinza
Lightspeedsystems
LinqiaRSSBot
MSIECrawler
Mag-Net
Majestic SEO
Mojolicious
MolokaiBot
Navroad
NearSite
Niki-bot
Nikto
Nmap
PECL::HTTP
Pavuk
Pi-Monster
ProWebWalker
Probethenet
Psbot
PxBroker
Rainbot
Re-re
RealDownload
RepoMonkey
SEOlyt
SMTBot
ScoutJet
Semrush
SiteAuditBot
SiteSnagger
SocialRankIOBot
Sociscraper
SpankBot
SputnikBot
Steeler
Sucuri
SuperBot
T0PHackTeam
Telesoft
The Intraformant
Titan
Toweyabot
Vacuum
Virusdie
WASALive-Bot
WeSEE
Web Enhancer
Web Fuck
Web Pix
WebAuto
WebEnhancer
WebLeacher
WebSucker
WebZIP
WebsiteExtractor
Whatweb
WiseGuys Robot
Zitebot
anthropic-ai
crawler.feedback
domainsproject.org
gopher
ips-agent
iubenda-radar
linkdexbot
openai
probe-image-size
scalaj-http
sitechecker.pro
webpros.com
zauba.io