nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-06-02 22:07:25 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
404enemy
ADmantX
ALittle Client
ASPSeek
Abonti
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Aipbot
AlphaBot
Anarchie
Ankit
Apexoo
AwarioRssBot
AwarioSmartBot
BacklinkCrawler
Badass
Barkrowler
BatchFTP
Battleztar Bazinga
Bitacle
BlackWidow
Blow
BlowFish
Buddy
BuiltBotTough
BuzzSumo
CODE87
CazoodleBot
CheeseBot
ChinaClaw
Citoid
Cloud mapping
Cogentbot
Collector
Cosmos
Crawling at Home Project
CrazyWebCrawler
Custo
DIIbot
DTS Agent
Demon
Dirbuster
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dragonfly
ECCP/1.0
EasyDL
Ebingbong
Ecxi
EroCrawler
Extractor
FDM
FHscan
FemtosearchBot
Foobot
Freeuploader
FrontPage
FyberSpider
Genieo
GermCrawler
GoZilla
Grabber
GridBot
HMView
HTTrack
Harvest
Havij
Hloader
HonoluluBot
Humanlinks
IDBot
Id-search
Image Sucker
Internet Ninja
IstellaBot
JOC Web Spider
Jbrofuzz
Joomla
JustView
Kinza
Kozmosbot
LWP::Simple
LeechGet
Likse
Linkbot
LinkextractorPro
LinqiaScrapeBot
Lipperhey
Lmspider
MJ12bot
MQQBrowser
MTRobot
Magnet
Majestic12
MarkMonitor
MarkWatch
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
Metauri
Minefield
Morfeus Fucking Scanner
Needle
Nessus
Net Vampire
NetLyzer
NetZIP
Netvibes
NextGenSearchBot
Nikto
Nimbostratus
Nuclei
Offline Navigator
OpenLinkProfiler
Openvas
OrangeSpider
PHPCrawl
PageAnalyzer
PageScorer
PageThing.com
Papa Foto
Pavuk
PeoplePal
Picscout
PictureFinder
Piepmatz
ProPowerBot
Probethenet
Psbot
PxBroker
PyCurl
RSSingBot
RankFlex
Rankivabot
RealDownload
RedesScrapy
RocketCrawler
SEOkicks
SEOlyticsCrawler
SEOprofiler
SISTRIX
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
Scrapy
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
Seekport
SemanticJuice
Semrush
SentiBot
Shodan
SiteLockSpider
SiteSnagger
SlySearch
SmartDownload
Snake
Snoopy
Sottopop
SpaceBison
SpankBot
Spbot
Spinn3r
Sqworm
Steeler
Sucuri
SuperHTTP
T0PHackTeam
T8Abot
TeleportPro
TheNomad
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
TurnitinBot
Typhoeus
V-BOT
VeriCiteCrawler
VidibleScraper
WASALive-Bot
WEBDAV
WISENutbot
WWW-Collector-E
WWW::Mechanize
Wallpapers/3.0
Web Auto
Web Collage
Web Fuck
Web Pix
WebCollage
WebFuck
WebImageCollector
WebReaper
Webshag
Who.is Bot
WiseGuys Robot
Xenu
YoudaoBot
Zade
Zitebot
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
adscanner
arquivo.pt
autoemailspider
backlink-check
cah.io.community
crawl.sogou.com
crawler.feedback
domainsproject.org
eCatch
facebookscraper
heritrix
ips-agent
lwp-trivial
magpie-crawler
mediawords
netEstate NE Crawler
pcBrowser
polaris version
s1z.ru
scalaj-http
scan.lol
seobility
seocompany.store
seoscanners
seostar
voyagerx.com
webpros.com
x09Mozilla
x22Mozilla
zauba.io
zgrab