nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-12-10 10:09:30 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
80legs
ADmantX
AIBOT
ALittle Client
Abonti
Aboundex
Aboundexbot
AhrefsBot
Alexibot
AlphaBot
Anarchy99
Ankit
Anthill
Aspiegel
Asterias
Attach
AwarioSmartBot
BLEXBot
BackDoorBot
Barkrowler
Battleztar Bazinga
BetaBot
Blow
Bolt
Brandwatch
Buddy
BuiltWith
BuzzSumo
CATExplorador
CODE87
Calculon
CherryPicker
Citoid
Cloud mapping
Collector
Copier
Cosmos
Craftbot
CrazyWebCrawler
DBLBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Demon
Devil
Digincore
Dispatch
DomCopBot
DomainAppender
DomainCrawler
DomainStatsBot
Domains Project
Download Wonder
ECCP/1.0
EMail Wolf
EasyDL
Express WebPictures
ExtLinksBot
Ezooms
Fimap
FlashGet
Flunky
Foobot
FrontPage
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Gigabot
Gotit
Grafula
GridBot
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
HTTrack
Heritrix
Hloader
Humanlinks
HybridBot
IDBTE4M
IDBot
IRLbot
Id-search
IndeedBot
InterGET
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
Jetty
JustView
Jyxobot
Keyword Density
LWP::Simple
Leap
LexiBot
Lftp
LibWeb
LinkScan
LinkWalker
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Ltx71
MJ12bot
MSIECrawler
Mag-Net
Magnet
Majestic-SEO
Masscan
Mb2345Browser
Meanpathbot
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Mojeek
Mojolicious
Morfeus Fucking Scanner
Msrabot
Musobot
NICErsPRO
Navroad
NearSite
Net Vampire
NetMechanic
Niki-bot
Nikto
Ninja
Not
Nutch
Offline Navigator
Openfind
OrangeSpider
PECL::HTTP
Page Analyzer
PageGrabber
Pandalytics
Pi-Monster
Picscout
Picsearch
PictureFinder
Pimonster
Pixray
PleaseCrawl
Pockey
ProPowerBot
Pu_iN
PxBroker
PyCurl
Quick-Crawler
RankActive
Rankivabot
RebelMouse
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SBIder
SEOprofiler
SISTRIX
SMTBot
Scrapy
Searchestate
SearchmetricsBot
Seomoz
SiteCheckerBotCrawler
SmartDownload
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
SpaceBison
SputnikBot
Stripper
SurveyBot
Suzuran
Szukacz
T0PHackTeam
TheNomad
Thumbor
Titan
Tracemyfile
Trendictionbot
Turingos
Twice
URLy.Warning
V-BOT
VCI
VeriCiteCrawler
Virusdie
WASALive-Bot
Wallpapers
Web Auto
Web Collage
Web Fetch
Web Pix
WebCollage
WebGo IS
WebImageCollector
WebLeacher
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
Xaldon_WebSpider
Zade
Zauba
Zeus
ZmEu
ZoomBot
ZumBot
ZyBorg
arquivo-web-crawler
backlink-check
com.plumanalytics
crawl.sogou.com
crawler.feedback
domainsproject.org
evc-batch
heritrix
ips-agent
isitwp.com
muhstik-scan
polaris version
probe-image-size
ripz
s1z.ru
scan.lol
seostar
serpstatbot
siteripz
sogouspider
ubermetrics-technologies.com
webmeup-crawler
webpros.com
zauba.io
zgrab