nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-06-04 22:04:46 +00:00

100 lines
1.1 KiB
Text

ASPSeek
Aboundexbot
Acunetix
AiHitBot
Asterias
AwarioSmartBot
BLEXBot
BatchFTP
Battleztar Bazinga
Blackboard
Brandprotect
Buddy
BuiltBotTough
Bullseye
Bytespider
CCBot
CherryPicker
ChinaClaw
Curious
CyotekWebCopy
DIIbot
Demon
DigitalPebble
Discobot
DomCopBot
DomainStatsBot
Download Wonder
Drip
ECCP/1.0
ExtLinksBot
Ezooms
Flunky
GalaxyBot
Getintent
Gotit
Id-search
JustView
Kozmosbot
LWP::Simple
LinqiaMetadataDownloaderBot
MQQBrowser
Majestic-SEO
Meanpathbot
Metauri
Microsoft URL Control
Minefield
Mr.4x3
Name Intelligence
Nameprotect
NetZIP
Netvibes
NimbleCrawler
Nmap
Offline Explorer
Offline Navigator
OnCrawl
OutclicksBot
PageGrabber
PageScorer
RankingBot
Ripper
RocketCrawler
Scrapy
SeobilityBot
Seomoz
SiteExplorer
SpaceBison
Stripper
Sucker
SuperBot
Swiftbot
T0PHackTeam
Telesoft
The Intraformant
Turnitin
URLy Warning
URLy.Warning
VB Project
WWW-Collector-E
WebPix
WebReaper
WebStripper
WebWhacker
WebsiteExtractor
WebsiteQuester
Webster
Woobot
Xaldon_WebSpider
Zade
Zauba
cah.io.community
check1.exe
dataforseobot
heritrix
instabid
iubenda-radar
lwp-request
page scorer
probe-image-size
webmeup-crawler