nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-12-17 08:09:39 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
404enemy
80legs
AIBOT
ASPSeek
Aboundex
Acunetix
AhrefsBot
Alligator
Anarchy99
Apexoo
Asterias
AwarioSmartBot
BackDoorBot
BackStreet
Badass
Bandit
BetaBot
Bigfoot
Bitacle
Blackboard
Blow
Boardreader
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Claritybot
Cloud mapping
Copier
CopyRightCheck
Copyscape
Crawling at Home Project
CrunchBot
DSearch
Demon
Deusu
DigitalPebble
Dirbuster
DnBCrawler-Analytics
DomainAppender
Dotbot
Dragonfly
EMail Siphon
Ebingbong
EirGrabber
EroCrawler
ExtractorPro
FemtosearchBot
Firefox/7.0
FlashGet
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GetRight
GetWeb
Gigabot
GoZilla
Grafula
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTTrack
Harvest
Humanlinks
HybridBot
IRLbot
IndeedBot
Indy Library
InfoNaviRobot
InterGET
Internet Ninja
InternetSeer
Iria
JOC Web Spider
JamesBOT
JetCar
Joomla
JustView
Keyword Density
Lanshanbot
LexiBot
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
LinkWalker
Linkdexbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
MFC_Tear_Sample
MIDown tool
MJ12bot
MTRobot
Majestic SEO
Majestic12
Meanpathbot
MicroMessenger
Mister PiX
Mojeek
Morfeus Fucking Scanner
Msrabot
NICErsPRO
Name Intelligence
Nameprotect
Navroad
NearSite
Nessus
Net Vampire
NetAnts
NetMechanic
Netcraft
Nettrack
Nibbler
Nimbostratus
Not
Nuclei
Offline Navigator
Openfind
Openvas
OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Panscient
Picscout
Pimonster
Psbot
PxBroker
Quick-Crawler
RSSingBot
RankFlex
ReGet
RocketCrawler
SEOlyticsCrawler
SEOprofiler
SMTBot
ScanAlert
ScoutJet
Scrapy
Searchestate
SearchmetricsBot
SemanticJuice
SemrushBot
SentiBot
SeobilityBot
Seomoz
Siphon
SiteExplorer
SiteLockSpider
SiteSucker
Sitevigil
SmartDownload
Snake
Sosospider
Spammen
SpankBot
Spanner
Spinn3r
SputnikBot
Sqlworm
Steeler
Sucker
Sucuri
Suzuran
T8Abot
Telesoft
Telesphoreo
TheNomad
Titan
Toata
Twice
Typhoeus
VB Project
VCI
Vacuum
Vagabondo
VeriCiteCrawler
WASALive-Bot
WPScan
WWW-Collector-E
WWWOFFLE
Wallpapers
Web Auto
Web Enhancer
Web Fuck
Web Sauger
WebAuto
WebCollage
WebFuck
WebGo IS
WebReaper
WebZIP
Webshag
WebsiteExtractor
WebsiteQuester
Whacker
Whatweb
Wotbox
Xaldon WebSpider
Xenu
YoudaoBot
Zermelo
ZoominfoBot
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
cognitiveseo
crawler.feedback
demandbase-bot
domainsproject.org
eCatch
evc-batch
gopher
heritrix
internetVista monitor
isitwp.com
lwp-trivial
meanpathbot
mediawords
muhstik-scan
oBot
pcBrowser
plumanalytics
ripz
scalaj-http
seocompany.store
seostar
sogouspider
trendiction.com
ubermetrics-technologies.com
webprosbot
x22Mozilla
xpymep1.exe
zauba.io