nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-07-05 10:11:41 +00:00

100 lines
1.1 KiB
Text

Aboundexbot
Ankit
AwarioSmartBot
BackStreet
Backlink-Ceck
BacklinkCrawler
BlackWidow
Blackboard
Blow
Buddy
BuiltBotTough
CheeseBot
Chlooe
Cliqzbot
CrazyWebCrawler
DataCha0s
Digincore
Dirbuster
Domains Project
Download Wonder
Dragonfly
FemtosearchBot
Fuzz
FyberSpider
GalaxyBot
GrabNet
GrapeshotCrawler
GridBot
HybridBot
Iblog
Indy Library
IstellaBot
Kenjin Spider
Kozmosbot
LNSpiderguy
LibWeb
LinqiaScrapeBot
Lipperhey Spider
MQQBrowser
Magnet
Mass Downloader
MauiBot
MeanPath Bot
Mojeek
Morfeus Fucking Scanner
Needle
Nettrack
Octopus
OrangeBot
Page Analyzer
Pandalytics
Pavuk
ProPowerBot
Pump
RankActive
Rankivabot
SISTRIX
ScanAlert
ScreenerBot
SemrushBot
SmartDownload
Sogou web spider
Sottopop
SpaceBison
Spbot
Sucker
SuperBot
TeleportPro
Trendiction
TurnitinBot
Twice
Typhoeus
UnisterBot
WWW-Collector-E
WWW::Mechanize
Wallpapers
Web Enhancer
WebCopier
WebSucker
WebsiteExtractor
WiseGuys Robot
Wotbox
adscanner
arquivo.pt
check1.exe
crawler4j
dataforseobot
demandbase-bot
eCatch
evc-batch
everyfeed-spider
instabid
iubenda-radar
lwp-trivial
netEstate NE Crawler
ripz
seocompany.store
seostar
xpymep1.exe
zgrab