nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-12-01 22:07:24 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
80legs
AIBOT
ASPSeek
Abonti
Aboundex
Aboundexbot
Acunetix
AhrefsBot
AllSubmitter
AlphaBot
Anarchy
Anarchy99
Ankit
Asterias
AwarioRssBot
BDCbot
BDFetch
BLEXBot
BackStreet
BatchFTP
Battleztar Bazinga
BlackWidow
Blackboard
Brandwatch
BunnySlippers
CATExplorador
CensysInspect
CheeseBot
CherryPicker
ChinaClaw
Cloud mapping
CopyRightCheck
Crawling at Home Project
CrazyWebCrawler
Custo
CyotekWebCopy
DIIbot
DTS Agent
DatabaseDriverMysqli
Devil
Digincore
Discobot
Discoverybot
Dispatch
DittoSpyder
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
Dragonfly
EasyDL
Ebingbong
Exabot
ExtLinksBot
Ezooms
FDM
Fimap
Firefox/7.0
Flunky
Foobot
GT::WWW
GetRight
Gigabot
Grabber
Grafula
HMView
HTMLparser
HTTP::Lite
HTTrack
Harvest
Humanlinks
HybridBot
IRLbot
Iblog
InfoTekies
JOC Web Spider
JamesBOT
Jbrofuzz
JikeSpider
Joomla
Jorgee
Jyxobot
Keyword Density
Kinza
Kozmosbot
Lanshanbot
Larbin
Leap
LeechFTP
Lftp
LibWeb
Libwhisker
Lightspeedsystems
Linkbot
Linkdexbot
LinqiaMetadataDownloaderBot
Lipperhey Spider
Lmspider
Ltx71
MQQBrowser
MSIECrawler
Mag-Net
MarkMonitor
Masscan
MauiBot
MeanPath Bot
MegaIndex.ru
Metauri
Minefield
Mister PiX
Moblie Safari
Mojolicious
Mozlila
Mr.4x3
NICErsPRO
Nameprotect
Needle
Nessus
NetAnts
NetSpider
NetZIP
Netcraft
Netvibes
Nibbler
Niki-bot
NimbleCrawler
Ninja
Nuclei
Nutch
Offline Navigator
OpenLinkProfiler
Openvas
PHPCrawl
Page Analyzer
PageAnalyzer
PageScorer
Pandalytics
Panscient
PeoplePal
Petalbot
Picscout
ProWebWalker
Pu_iN
Pump
PyCurl
RankFlex
Rankivabot
RankurBot
ReGet
RebelMouse
RedesScrapy
RepoMonkey
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOprofiler
SMTBot
SalesIntelligent
ScoutJet
SearchmetricsBot
SemrushBot
SeoSiteCheckup
Shodan
Sitebeam
Siteimprove
SlySearch
SmartDownload
SocialRankIOBot
Sociscraper
Sogou web spider
SpaceBison
Spammen
Spbot
Sqlworm
Steeler
Stripper
Sucker
SurveyBot
TeleportPro
Telesphoreo
Telesphorep
TightTwatBot
Titan
Toweyabot
True_Robot
Turingos
Turnitin
TwengaBot
UnisterBot
Upflow
V-BOT
VB Project
VeriCiteCrawler
Virusdie
VoidEYE
Voil
WBSearchBot
WEBDAV
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Web Auto
Web Enhancer
Web Fetch
Web Pix
Web Sucker
WebCollage
WebFetch
WebImageCollector
WebLeacher
WebSucker
WebWhacker
Webster
Whacker
Whatweb
WinHTTrack
Wprecon
Xenu
Zauba
ZoominfoBot
ZumBot
ZyBorg
arquivo-web-crawler
arquivo.pt
clark-crawler
coccocbot-web
crawler.feedback
demandbase-bot
heritrix
internetVista monitor
lwp-request
mediawords
muhstik-scan
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seocompany.store
sexsearcher
siteripz
sogouspider
sp_auditbot
sysscan
trendiction.com
trendiction.de
ubermetrics-technologies.com
webprosbot