nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-08-01 22:04:50 +00:00

100 lines
1 KiB
Text

Aboundexbot
Acunetix
Alexibot
AlphaBot
Anarchy
BLEXBot
BotALot
Brandprotect
Brandwatch
Buddy
BunnySlippers
Bytespider
CCBot
Calculon
Cloud mapping
Copyscape
DBLBot
DIIbot
Dirbuster
DomCopBot
Drip
ECCP/1.0
Fimap
Flunky
Fuzz
GetRight
HTTP::Lite
HTTrack
Heritrix
InternetSeer
IstellaBot
Keybot Translation-Search-Machine
LWP::Simple
Leap
LinkScan
Ltx71
MSIECrawler
Majestic SEO
MarkWatch
Microsoft Data Access
Mozlila
Musobot
NearSite
Net Vampire
Netcraft
Nettrack
NextGenSearchBot
Niki-bot
Octopus
OpenLinkProfiler
Openfind
OutfoxBot
PageAnalyzer
Picscout
ProPowerBot
Psbot
Pump
QueryN Metasearch
Quick-Crawler
RankingBot2
ReGet
RealDownload
RocketCrawler
SEOkicks
Scrapy
ScrepyBot
SearchmetricsBot
SiteExplorer
SiteLockSpider
Sitebeam
Siteimprove
SmartDownload
Sociscraper
Sottopop
SpankBot
TeleportPro
Toata
VB Project
Vacuum
VoidEYE
WEBDAV
Web Sauger
WebFetch
WebFuck
WebLeacher
WebZIP
Whatweb
Widow
Wotbox
Zeus
anthropic-ai
backlink-check
domainsproject.org
gopher
imagesift.com
lwp-request
seobility
sp_auditbot
sysscan
zauba.io