nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-09 10:09:13 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
80legs
ASPSeek
AiHitBot
Aipbot
Alexibot
Anthill
BDCbot
Bandit
Barkrowler
Black Hole
Blackboard
Bolt
BotALot
Brandprotect
Brandwatch
BuiltWith
Bullseye
BuzzSumo
CATExplorador
CCBot
CODE87
CazoodleBot
CensysInspect
CherryPicker
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Collector
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Custo
Deusu
Devil
Digincore
Discoverybot
DomCopBot
Domains Project
Download Wonder
EMail Wolf
EasyDL
EirGrabber
Evil
ExtLinksBot
Extractor
ExtractorPro
Ezooms
FemtosearchBot
Flunky
Foobot
Fuzz
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GetRight
GetWeb
Gigabot
Go!Zilla
GrabNet
Grafula
HMView
HTMLparser
HTTrack
Heritrix
HybridBot
IDBot
IlseBot
Image Sucker
InfoNaviRobot
Intelliseek
InterGET
Internet Ninja
JamesBOT
Jbrofuzz
Jetty
JikeSpider
JustView
Keyword Density
Kozmosbot
LNSpiderguy
LWP::Simple
Larbin
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
Linkbot
Linkdexbot
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Ltx71
MIDown tool
MQQBrowser
MTRobot
Mail.RU_Bot
Majestic-SEO
Masscan
MeanPath Bot
Meanpathbot
Metauri
Mojeek
Morfeus Fucking Scanner
Name Intelligence
NearSite
Needle
Net Vampire
NetAnts
NetZIP
Netcraft
Netvibes
NextGenSearchBot
Nibbler
NimbleCrawler
Nmap
Not
Nuclei
Nutch
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeSpider
Page Analyzer
PageGrabber
PageScorer
Pavuk
Pi-Monster
Picscout
Pixray
Pockey
Pu_iN
PxBroker
QueryN Metasearch
RSSingBot
RankActive
RankFlex
RankingBot
RealDownload
Recorder
RepoMonkey
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SalesIntelligent
ScrepyBot
SemanticJuice
SemrushBot
SeoSiteCheckup
Seomoz
Shodan
Site Sucker
Snake
SpankBot
SputnikBot
Sqworm
Steeler
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
SurveyBot
Teleport
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Titan
Toata
Trendictionbot
Turingos
TwengaBot
Typhoeus
URLy.Warning
VeriCiteCrawler
VidibleScraper
Voltron
WASALive-Bot
WISENutbot
WWW-Mechanize
Wallpapers/3.0
WallpapersHD
WeSEE
Web Auto
Web Enhancer
Web Pix
Web Sauger
WebCollage
WebFetch
WebFuck
WebLeacher
WebReaper
WebSucker
WebZIP
Webshag
Whacker
Who.is Bot
WiseGuys Robot
Wprecon
Xaldon_WebSpider
Xenu
Zade
Zauba
Zermelo
Zeus
Zitebot
ZmEu
ZumBot
archive.org_bot
autoemailspider
backlink-check
crawl.sogou.com
dataforseo.com
eCatch
instabid
magpie-crawler
mediawords
netEstate NE Crawler
plumanalytics
polaris version
probe-image-size
ripz
seobility
serpstatbot
siteripz
sp_auditbot
tAkeOut
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webpros.com
webprosbot
xpymep1.exe
zgrab