nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-18 10:09:05 +00:00

250 lines
2.7 KiB
Text

ADmantX
ALittle Client
Abonti
Aboundexbot
AfD-Verbotsverfahren
Anarchie
Asterias
AwarioRssBot
BBBike
BDCbot
BLEXBot
BackWeb
Badass
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
Black Hole
BlackWidow
Blackboard
BlowFish
Boardreader
Bolt
Brandwatch
BuiltBotTough
BuiltWith
BuzzSumo
CATExplorador
CODE87
Calculon
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Claritybot
Cogentbot
Copier
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
Crescent
Curious
Custo
DIIbot
DTS Agent
Demon
Digincore
Dirbuster
Discoverybot
DittoSpyder
DomainCrawler
Download Wonder
Dragonfly
EMail Wolf
EasyDL
Ecxi
EirGrabber
Evil
Exabot
Extractor
EyeNetIE
Fuzz
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Gigabot
Go-Ahead-Got-It
GoZilla
Gotit
Grabber
GrapeFX
GridBot
HTMLparser
Humanlinks
HybridBot
IDBot
IRLbot
Iblog
IndeedBot
Iskanie
IstellaBot
JennyBot
Jyxobot
Kenjin Spider
Keyword Density
Kinza
LieBaoFast
LinkScan
Linkdexbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Ltx71
MIDown tool
MQQBrowser
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Masscan
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Moblie Safari
MolokaiBot
Mozlila
Nameprotect
Navroad
NetAnts
NetMechanic
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Nuclei
Octopus
Offline Explorer
OpenLinkProfiler
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Pandalytics
Panscient
Petalbot
Pi-Monster
Picscout
Picsearch
PictureFinder
Pixray
RebelMouse
Recorder
Rogerbot
SEOkicks
SEOlyticsCrawler
SEOprofiler
SISTRIX
SalesIntelligent
Scanbot
SemrushBot
SeoSiteCheckup
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
SlySearch
SmartDownload
Snake
SocialRankIOBot
Sogou web spider
Sosospider
Sottopop
SpaceBison
SpankBot
Sqlworm
Sqworm
SuperHTTP
Surfbot
Suzuran
Szukacz
Teleport
Telesoft
Telesphoreo
TightTwatBot
Tracemyfile
True_Robot
Turingos
URLy Warning
URLy.Warning
Upflow
V-BOT
VB Project
Vagabondo
VelenPublicWebCrawler
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WallpapersHD
WeSEE
Web Fetch
Web Fuck
Web Sucker
WebAuto
WebCopier
WebEnhancer
WebFetch
WebGo IS
WebLeacher
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
Whacker
Whatweb
Who.is Bot
WiseGuys Robot
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zade
Zeus
Zitebot
ZoominfoBot
ZyBorg
adscanner
archive.org_bot
arquivo-web-crawler
arquivo.pt
cah.io.community
crawler.feedback
crawler4j
demandbase-bot
evc-batch
isitwp.com
iubenda-radar
lwp-request
oBot
plumanalytics
probe-image-size
s1z.ru
scalaj-http
seocompany.store
sogouspider
trendiction.com
voyagerx.com
webpros.com
xpymep1.exe
zauba.io
zgrab