nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-18 22:04:48 +00:00

100 lines
1.1 KiB
Text

01h4x.com
AIBOT
ALittle Client
ASPSeek
Acunetix
AiHitBot
AlphaBot
Badass
BlackWidow
Blow
BotALot
Brandwatch
Citoid
Crawling at Home Project
DSearch
DTS Agent
Devil
Discoverybot
DnBCrawler-Analytics
DomainSigmaCrawler
EMail Siphon
Extractor
Fuzz
GPTBot
GetWeb
Go!Zilla
GridBot
HTMLparser
HTTrack
HybridBot
Image Fetch
Internet Ninja
JennyBot
LeechGet
LexiBot
LieBaoFast
Lightspeedsystems
LinkWalker
Majestic-SEO
MarkMonitor
Masscan
Meanpathbot
MegaIndex.ru
Musobot
NICErsPRO
Nessus
NetLyzer
Netcraft
Netvibes
NextGenSearchBot
Nmap
Offline Explorer
Offline Navigator
OpenLinkProfiler
PageScorer
QueryN Metasearch
RankActiveLinkBot
RocketCrawler
Rogerbot
SISTRIX
ScanAlert
Scrapy
Screaming
ScreenerBot
ScrepyBot
SeekportBot
SeobilityBot
SlySearch
Spammen
Sqlworm
Sucuri
SuperHTTP
TeleportPro
The Intraformant
Tracemyfile
Trendiction
V-BOT
Virusdie
WISENutbot
WWW::Mechanize
Wallpapers/3.0
WebCopier
WebImageCollector
WebSucker
WebWhacker
Whatweb
Who.is Bot
Xaldon WebSpider
ZmEu
anthropic-ai
archive.org_bot
arquivo-web-crawler
autoemailspider
check1.exe
crawler4j
domainsproject.org
lwp-trivial
sp_auditbot
spyfu
x22Mozilla