nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-07-05 22:08:32 +00:00

100 lines
1 KiB
Text

Aboundexbot
AiHitBot
Alexibot
BBBike
BetaBot
Black Hole
Blow
Boardreader
Brandprotect
Buddy
BuiltWith
Bullseye
CATExplorador
CCBot
Claritybot
Cocolyzebot
Copier
CopyRightCheck
DIIbot
DSearch
Discoverybot
DomainAppender
Dotbot
Dragonfly
Exabot
EyeNetIE
Go!Zilla
Grafula
HTTrack
Humanlinks
HybridBot
Id-search
IlseBot
Internet Ninja
Iskanie
JOC Web Spider
JikeSpider
Keyword Density
LibWeb
Ltx71
Mag-Net
Majestic12
MauiBot
Metauri
Microsoft Data Access
Microsoft URL Control
Mojeek
NICErsPRO
Nameprotect
NetAnts
Niki-bot
Nmap
Offline Navigator
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
Pavuk
PleaseCrawl
ProPowerBot
Psbot
Rainbot
Rogerbot
Screaming
SeoSiteCheckup
Site Sucker
SiteExplorer
SiteSnagger
Sogou web spider
SuperBot
Swiftbot
The Intraformant
Titan
Voltron
WBSearchBot
Web Fetch
Web Sauger
WebCollage
WebEnhancer
WebFetch
WebFuck
WebLeacher
Webalta
WiseGuys Robot
Wonderbot
Wprecon
YoudaoBot
ZmEu
arquivo.pt
autoemailspider
dataforseo.com
domainsproject.org
scalaj-http
seobility
spyfu
tAkeOut
webmeup-crawler
zauba.io
zgrab