nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-04 22:07:02 +00:00

250 lines
2.6 KiB
Text

360Spider
80legs
Aboundexbot
Acunetix
AiHitBot
AllSubmitter
AlphaBot
Anarchie
Anarchy99
Ankit
Anthill
Apexoo
Aspiegel
AwarioRssBot
AwarioSmartBot
BDCbot
BackStreet
Backlink-Ceck
BacklinkCrawler
Bandit
Bigfoot
Bitacle
Black Hole
BlowFish
Bolt
Brandprotect
Buck
BuiltBotTough
Bullseye
CATExplorador
CheTeam
ChinaClaw
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
Copyscape
Craftbot
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Custo
CyotekWebCopy
DataCha0s
DomCopBot
DomainAppender
Domains Project
Dotbot
Dragonfly
EMail Siphon
EirGrabber
Evil
Extractor
FHscan
FemtosearchBot
Fimap
Firefox/7.0
Foobot
Freeuploader
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Genieo
Getintent
Go!Zilla
Go-Ahead-Got-It
Grabber
Grafula
GrapeFX
HMView
Haansoft
Harvest
Id-search
IlseBot
IndeedBot
InfoTekies
InternetSeer
Iskanie
JikeSpider
Jorgee
Jyxobot
Keyword Density
Lanshanbot
Larbin
LeechFTP
Libwhisker
Likse
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MIDown tool
MIIxpc
Majestic-SEO
MarkWatch
Mass Downloader
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Mojeek
Msrabot
NPbot
Needle
Net Vampire
NetAnts
NetLyzer
Netvibes
Nibbler
Nikto
Nimbostratus
Ninja
Nmap
Nutch
Octopus
OpenLinkProfiler
OpenVAS
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Panscient
Pavuk
PeoplePal
Picscout
Piepmatz
Pimonster
Pockey
Pu_iN
PyCurl
RSSingBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
RealDownload
Reaper
Recorder
RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
SalesIntelligent
Scanbot
Screaming
ScreenerBot
ScrepyBot
Semrush
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSucker
Sitevigil
SmartDownload
Snoopy
SocialRankIOBot
Sogou web spider
Sosospider
Sottopop
SpaceBison
SpankBot
Sqlmap
Sqworm
Steeler
Stripper
Sucuri
SuperHTTP
Surfbot
SurveyBot
Teleport
TeleportPro
Telesoft
Telesphorep
TheNomad
TightTwatBot
Titan
Toweyabot
Twice
Upflow
VeriCiteCrawler
Virusdie
Voltron
WEBDAV
WISENutbot
WWW::Mechanize
Web Pix
WebCopier
WebEnhancer
WebImageCollector
WebLeacher
WebReaper
WebSauger
WebWhacker
Webshag
Webster
Whatweb
Widow
WiseGuys Robot
Wotbox
Wprecon
YoudaoBot
Zauba
Zermelo
Zitebot
ZoomBot
ZumBot
ZyBorg
arquivo-web-crawler
arquivo.pt
backlink-check
coccocbot-web
cognitiveseo
com.plumanalytics
dataforseo.com
domainsproject.org
gopher
isitwp.com
meanpathbot
mediawords
netEstate NE Crawler
page scorer
pcBrowser
plumanalytics
polaris version
probe-image-size
scalaj-http
seobility
siteripz
spyfu
tAkeOut
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
webpros.com