nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2020-09-23 23:56:55 +02:00

250 lines
2.6 KiB
Text

360Spider
80legs
ADmantX
AfD-Verbotsverfahren
AIBOT
Alexibot
arquivo.pt
Aspiegel
Attach
AwarioSmartBot
backlink-check
BackWeb
BDCbot
BDFetch
Bitacle
Blackboard
Black Hole
Boardreader
Brandprotect
Cegbfeieh
CheeseBot
CheTeam
ChinaClaw
Claritybot
coccocbot-web
cognitiveseo
Collector
Copier
CopyRightCheck
Copyscape
Craftbot
crawler4j
CrazyWebCrawler
CrunchBot
DatabaseDriverMysqli
DBLBot
Demon
Deusu
DIIbot
Disco
Discobot
DittoSpyder
DomainCrawler
DomainSigmaCrawler
domainsproject.org
Drip
DSearch
DTS Agent
EasyDL
Ebingbong
ECCP/1.0
Ecxi
EMail Wolf
evc-batch
Evil
Express WebPictures
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
Firefox/7.0
FyberSpider
GalaxyBot
GetRight
Gigabot
Go-Ahead-Got-It
Gotit
Go!Zilla
GrabNet
GrapeFX
GrapeshotCrawler
GridBot
GT::WWW
Haansoft
HaosouSpider
Havij
HEADMasterSEO
heritrix
HTMLparser
Iblog
IlseBot
Image Fetch
Image Sucker
Indy Library
InfoTekies
Internet Ninja
InternetSeer
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jorgee
JustView
Kenjin Spider
Keyword Density
Kozmosbot
Lftp
LibWeb
Likse
LinkScan
LinkWalker
LinqiaRSSBot
LinqiaScrapeBot
LNSpiderguy
lwp-request
magpie-crawler
Mail.RU_Bot
Majestic12
MarkMonitor
MarkWatch
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
MeanPath Bot
MegaIndex.ru
Microsoft URL Control
Mister PiX
MJ12bot
Mojeek
Mojolicious
Mozlila
Mr.4x3
MSFrontPage
muhstik-scan
Navroad
Nessus
NetAnts
Netcraft
NetLyzer
NetSpider
NICErsPRO
NimbleCrawler
Nimbostratus
NPbot
oBot
OnCrawl
OpenLinkProfiler
Openvas
OrangeBot
OutfoxBot
PageAnalyzer
Page Analyzer
page scorer
PageScorer
Papa Foto
Pavuk
pcBrowser
PECL::HTTP
PeoplePal
Picsearch
Pi-Monster
PleaseCrawl
Probethenet
ProWebWalker
Psbot
QueryN Metasearch
RankActive
RankActiveLinkBot
RankurBot
Reaper
RebelMouse
RedesScrapy
RepoMonkey
Rogerbot
RSSingBot
s1z.ru
SalesIntelligent
SBIder
ScoutJet
Scrapy
SearchmetricsBot
SemrushBot
SEOkicks
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
Shodan
Siphon
SiteCheckerBotCrawler
Siteimprove
SmartDownload
Snapbot
Sociscraper
Sogou web spider
Sosospider
Sottopop
SputnikBot
Steeler
Sucuri
SuperBot
Surfbot
SurveyBot
Swiftbot
sysscan
Szukacz
T0PHackTeam
Teleport
Telesoft
Telesphoreo
TheNomad
Titan
Turingos
Turnitin
TwengaBot
Upflow
VB Project
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
Wallpapers/3.0
Webalta
Web Auto
WebBandit
WebCollage
Web Collage
WebCopier
WebEnhancer
Web Enhancer
WebImageCollector
WebLeacher
WebmasterWorldForumBot
WebPix
Web Sauger
Webshag
WebsiteExtractor
WebsiteQuester
WebWhacker
Whack
Whacker
Who.is Bot
WinHTTrack
Wonderbot
Woobot
Wprecon
WPScan
WWW-Collector-E
WWW-Mechanize
x22Mozilla
YoudaoBot
Zade
Zauba
zauba.io
Zeus
ZmEu
ZumBot
ZyBorg