nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-10 10:09:30 +00:00

250 lines
2.6 KiB
Text

01h4x.com
80legs
AIBOT
ALittle Client
Aboundex
Acunetix
AiHitBot
Alexibot
Anarchie
Anthill
Aspiegel
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BDCbot
BDFetch
Backlink-Ceck
BlackWidow
Blow
Boardreader
BotALot
Brandprotect
Buck
BuzzSumo
CCBot
CODE87
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CheTeam
CheeseBot
ChinaClaw
Chlooe
Citoid
Cliqzbot
Cocolyzebot
Copier
CrunchBot
DIIbot
DTS Agent
DataCha0s
Demon
Deusu
Dirbuster
Discobot
Dispatch
DnBCrawler-Analytics
Domains Project
Dotbot
Download Wonder
ECCP/1.0
EMail Wolf
Ebingbong
Exabot
Express WebPictures
ExtLinksBot
Extractor
FHscan
FemtosearchBot
Fimap
Flunky
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
GetRight
Go-Ahead-Got-It
GoZilla
GrabNet
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
Haansoft
Harvest
Heritrix
Humanlinks
IDBot
Iblog
Id-search
Indy Library
InfoNaviRobot
InterGET
Internet Ninja
Iria
Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
Jyxobot
Keyword Density
Larbin
LexiBot
LinkScan
Linkbot
Linkdexbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Ltx71
MSFrontPage
Mag-Net
Majestic12
MarkMonitor
Mass Downloader
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
NICErsPRO
Navroad
Net Vampire
NetMechanic
Netcraft
Niki-bot
NimbleCrawler
Nimbostratus
Nmap
Nuclei
Octopus
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
OrangeSpider
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageThing.com
Pandalytics
PeoplePal
Picscout
PictureFinder
Piepmatz
Pockey
ProWebWalker
PxBroker
PyCurl
QueryN Metasearch
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
RankurBot
Reaper
RebelMouse
RedesScrapy
Ripper
Rogerbot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SISTRIX
ScanAlert
ScoutJet
Scrapy
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SeobilityBot
Shodan
Siphon
Site Sucker
SiteExplorer
SiteSucker
Sitebeam
Sitevigil
SocialRankIOBot
Sociscraper
Sottopop
SpaceBison
Spanner
Spinn3r
Steeler
SurveyBot
Suzuran
Swiftbot
The Intraformant
Titan
TwengaBot
Typhoeus
Upflow
VB Project
VidibleScraper
Virusdie
Voil
WASALive-Bot
WEBDAV
WallpapersHD
WeSEE
Web Fuck
WebEnhancer
WebLeacher
WebReaper
WebSauger
WebStripper
WebWhacker
WebZIP
Webalta
Webshag
WebsiteQuester
Webster
Whatweb
WiseGuys Robot
Wotbox
YoudaoBot
Zauba
Zermelo
Zeus
Zitebot
ZyBorg
arquivo.pt
clark-crawler
com.plumanalytics
dataforseo.com
eCatch
gopher
heritrix
ips-agent
meanpathbot
muhstik-scan
pcBrowser
plumanalytics
polaris version
satoristudio.net
serpstatbot
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webprosbot
x09Mozilla
zgrab