nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-test.list
2019-10-02 10:01:51 +02:00

250 lines
2.5 KiB
Text

80legs
Abonti
Aboundexbot
ADmantX
AIBOT
AllSubmitter
AlphaBot
ASPSeek
Attach
autoemailspider
BackDoorBot
Backlink-Ceck
backlink-check
BackStreet
BackWeb
Battleztar Bazinga
Bitacle
Blackboard
Black Hole
BlackWidow
Blow
BlowFish
Bolt
BotALot
Buddy
BuzzSumo
CATExplorador
CheeseBot
ChinaClaw
Cliqzbot
Cloud mapping
coccocbot-web
Collector
com.plumanalytics
Copier
Cosmos
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CrunchBot
Curious
DatabaseDriverMysqli
DataCha0s
Deusu
Digincore
DigitalPebble
DIIbot
Dirbuster
Discoverybot
DittoSpyder
DomainStatsBot
Dotbot
Dragonfly
Drip
DSearch
EirGrabber
evc-batch
Exabot
Extractor
ExtractorPro
Extreme Picture Finder
FHscan
Firefox/7.0
FrontPage
FyberSpider
Fyrebot
Genieo
GermCrawler
GetRight
GetWeb
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
GrapeFX
GrapeshotCrawler
Harvest
HEADMasterSEO
Heritrix
Hloader
HMView
HTMLparser
HTTP::Lite
Humanlinks
Iblog
IDBot
Id-search
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
InternetSeer
internetVista monitor
ips-agent
Iria
IRLbot
Iskanie
JetCar
Jetty
JikeSpider
JOC Web Spider
Joomla
JustView
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
Libwhisker
LinkextractorPro
LinqiaRSSBot
Lipperhey
Lipperhey Spider
LNSpiderguy
Ltx71
lwp-request
LWP::Simple
lwp-trivial
Magnet
magpie-crawler
Majestic12
Majestic SEO
MarkWatch
MauiBot
MeanPath Bot
mediawords
MJ12bot
Morfeus Fucking Scanner
Mr.4x3
MSFrontPage
Musobot
Navroad
Needle
Nessus
NetAnts
NetMechanic
Nettrack
NetZIP
Nibbler
NimbleCrawler
NPbot
Octopus
Offline Navigator
Openfind
OpenLinkProfiler
Openvas
OpenVAS
OutfoxBot
Page Analyzer
PageGrabber
page scorer
PageScorer
Pavuk
PECL::HTTP
plumanalytics
POE-Component-Client-HTTP
Probethenet
Psbot
Pump
PxBroker
RankActive
RankActiveLinkBot
RankingBot
Rankivabot
RealDownload
Reaper
ReGet
RepoMonkey
Ripper
s1z.ru
SBIder
ScanAlert
Scanbot
Scrapy
SearchmetricsBot
Semrush
SemrushBot
SEOlyticsCrawler
Seomoz
seoscanners
SEOstats
Shodan
SISTRIX
Sitebeam
Siteimprove
SiteSucker
Site Sucker
SlySearch
Sociscraper
sogouspider
Sogou web spider
Sottopop
SpaceBison
Spanner
SputnikBot
Steeler
Sucker
Sucuri
SuperBot
T8Abot
tAkeOut
Teleport
Telesoft
The Intraformant
Toata
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
Turnitin
Typhoeus
UnisterBot
Upflow
URLy.Warning
VB Project
VeriCiteCrawler
Voil
Wallpapers/3.0
WallpapersHD
WBSearchBot
WebAuto
WebBandit
WebCollage
WebCopier
WEBDAV
WebEnhancer
WebFuck
Web Fuck
WebPix
WebReaper
WebSauger
Webshag
Webster
WebStripper
Web Sucker
WebZIP
Who.is Bot
WiseGuys Robot
Woobot
Wprecon
xpymep1.exe
zauba.io
Zermelo
Zeus
ZmEu