nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-26 10:09:34 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
AIBOT
Acunetix
AhrefsBot
AiHitBot
Aipbot
Alligator
Anarchie
Asterias
Attach
BBBike
BDFetch
BLEXBot
BackDoorBot
BacklinkCrawler
Badass
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
BlackWidow
Boardreader
Brandwatch
Buck
BuiltWith
BunnySlippers
CCBot
Calculon
CensysInspect
ChinaClaw
Claritybot
Cliqzbot
Cocolyzebot
Copier
Craftbot
DBLBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Demon
Deusu
DigitalPebble
Dirbuster
Discoverybot
DomainSigmaCrawler
Domains Project
Download Wonder
Dragonfly
ECCP/1.0
Ecxi
Exabot
ExtractorPro
EyeNetIE
Flunky
Freeuploader
FrontPage
Fyrebot
GalaxyBot
GermCrawler
Getintent
Go!Zilla
Grabber
GrapeshotCrawler
Heritrix
IDBTE4M
IDBot
Iblog
IlseBot
IndeedBot
InterGET
InternetSeer
JennyBot
JetCar
JikeSpider
Joomla
Jorgee
Jyxobot
Keyword Density
LeechFTP
LeechGet
LexiBot
LieBaoFast
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIDown tool
MJ12bot
MQQBrowser
MSIECrawler
Majestic SEO
Majestic12
Mass Downloader
Masscan
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Moblie Safari
Mojeek
Morfeus Fucking Scanner
NPbot
Name Intelligence
NearSite
Nessus
NetLyzer
NetSpider
Netvibes
NextGenSearchBot
Nimbostratus
Nmap
Not
Nuclei
Nutch
Offline Explorer
OpenVAS
Openvas
OrangeSpider
PHPCrawl
PageGrabber
PageThing.com
PeoplePal
PictureFinder
Pixray
Psbot
Pu_iN
Pump
PyCurl
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
ReGet
RealDownload
Reaper
RebelMouse
Recorder
RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot
SEOlyticsCrawler
SEOstats
SMTBot
Screaming
ScrepyBot
Searchestate
Semrush
SemrushBot
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
Siphon
Site Sucker
SiteSucker
Siteimprove
Snapbot
Snoopy
Sogou web spider
Spammen
Spinn3r
Steeler
Sucuri
Surfbot
Swiftbot
T0PHackTeam
T8Abot
Thumbor
Toata
Trendiction
Trendictionbot
True_Robot
Turnitin
Twice
Typhoeus
UnisterBot
V-BOT
VB Project
VCI
Vagabondo
VeriCiteCrawler
VidibleScraper
Voltron
WEBDAV
WISENutbot
WWW-Collector-E
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Auto
Web Fuck
Web Sauger
WebCollage
WebCopier
WebImageCollector
WebSucker
WebZIP
Webalta
Website Quester
WebsiteQuester
Webster
Whack
Whatweb
Wonderbot
Woobot
Zitebot
ZmEu
ZoomBot
adscanner
arquivo-web-crawler
arquivo.pt
backlink-check
coccocbot-web
crawler.feedback
dataforseo.com
demandbase-bot
instabid
isitwp.com
lwp-request
muhstik-scan
netEstate NE Crawler
pcBrowser
probe-image-size
ripz
s1z.ru
scan.lol
sitechecker.pro
siteripz
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webpros.com
webprosbot
xpymep1.exe
zauba.io
zgrab