nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-test.list
2019-06-27 12:09:51 +02:00

250 lines
2.6 KiB
Text

360Spider
404checker
80legs
Aboundex
ADmantX
AIBOT
AlphaBot
archive.org_bot
autoemailspider
BackDoorBot
backlink-check
BacklinkCrawler
BackStreet
BackWeb
BatchFTP
BBBike
BDFetch
BetaBot
Bigfoot
BLEXBot
BlowFish
Boardreader
Brandprotect
Brandwatch
Buddy
Calculon
CATExplorador
CazoodleBot
CCBot
Cegbfeieh
CherryPicker
ChinaClaw
Cliqzbot
coccocbot-web
CopyRightCheck
Copyscape
Cosmos
crawler4j
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CrunchBot
Custo
Demon
Deusu
Devil
Digincore
DIIbot
Disco
Dispatch
DnyzBot
DomainCrawler
DomainSigmaCrawler
Drip
DSearch
EasyDL
Ebingbong
Ecxi
evc-batch
FemtosearchBot
Fimap
Flunky
GalaxyBot
GermCrawler
Getintent
Gigabot
Grabber
Grafula
GrapeFX
GrapeshotCrawler
GT::WWW
Haansoft
HaosouSpider
Harvest
Heritrix
Humanlinks
Image Fetch
Image Sucker
InfoNaviRobot
Intelliseek
InterGET
internetVista monitor
ips-agent
IRLbot
Iskanie
JamesBOT
Jbrofuzz
JetCar
Jetty
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Kozmosbot
Lanshanbot
LeechFTP
LeechGet
Libwhisker
LinkextractorPro
LinkScan
LinkWalker
LinqiaScrapeBot
Lipperhey Spider
LWP::Simple
lwp-trivial
Magnet
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic SEO
Masscan
Mass Downloader
meanpathbot
MeanPath Bot
MegaIndex.ru
MFC_Tear_Sample
MIDown tool
MIIxpc
Mr.4x3
MSIECrawler
Msrabot
MS Web Services Client Protocol
muhstik-scan
Musobot
Name Intelligence
netEstate NE Crawler
NetLyzer
NetSpider
Nettrack
Net Vampire
Nibbler
Ninja
Nmap
oBot
Offline Explorer
Offline Navigator
Openvas
OrangeSpider
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
page scorer
pcBrowser
PHPCrawl
PictureFinder
Pimonster
Pi-Monster
PleaseCrawl
plumanalytics
Pockey
Probethenet
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
RealDownload
Reaper
RebelMouse
ReGet
RepoMonkey
Ripper
Rogerbot
SalesIntelligent
ScanAlert
scan.lol
ScoutJet
Scrapy
Searchestate
Semrush
SemrushBot
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SeoSiteCheckup
SEOstats
Siphon
SISTRIX
Sitebeam
Sitevigil
SmartDownload
Snapbot
Sociscraper
Sottopop
SpaceBison
sp_auditbot
Sqworm
SuperHTTP
Surfbot
SurveyBot
Swiftbot
sysscan
Szukacz
tAkeOut
Teleport
Telesphoreo
Telesphorep
TheNomad
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendictionbot
trendiction.com
True_Robot
Turingos
TurnitinBot
UnisterBot
Vacuum
VB Project
VCI
VeriCiteCrawler
Virusdie
Voltron
WallpapersHD
WBSearchBot
WebBandit
WebCollage
Web Collage
WebCopier
WebFuck
WebLeacher
WebmasterWorldForumBot
WebReaper
WebSauger
Web Sauger
Webshag
WebsiteExtractor
WebSucker
Web Sucker
WebZIP
WeSEE
WinHTTrack
Woobot
Wotbox
Wprecon
WWW::Mechanize
WWWOFFLE
x09Mozilla
Zade
Zauba
zauba.io
Zermelo
ZyBorg