nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2020-10-26 00:12:57 +02:00

250 lines
2.6 KiB
Text

404checker
Abonti
AfD-Verbotsverfahren
AllSubmitter
arquivo-web-crawler
Attach
BackDoorBot
BackStreet
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
Blackboard
BlackWidow
BLEXBot
Blow
Brandwatch
BuiltWith
Calculon
CATExplorador
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Collector
Crescent
CrunchBot
demandbase-bot
Demon
Deusu
Dirbuster
Disco
Discobot
DittoSpyder
DomainCrawler
DomainSigmaCrawler
domainsproject.org
DomainStatsBot
Dotbot
DTS Agent
EasyDL
eCatch
ECCP/1.0
EirGrabber
EroCrawler
Express WebPictures
EyeNetIE
Ezooms
facebookscraper
FHscan
Fimap
Foobot
FyberSpider
Genieo
GetRight
Gigablast
Go-Ahead-Got-It
GoZilla
Grabber
Grafula
Haansoft
HaosouSpider
Harvest
HEADMasterSEO
heritrix
HMView
Humanlinks
HybridBot
Id-search
Image Sucker
IndeedBot
Indy Library
InfoTekies
instabid
InterGET
Internet Ninja
InternetSeer
ips-agent
Iria
IstellaBot
JamesBOT
Jbrofuzz
JOC Web Spider
Joomla
Jorgee
Kenjin Spider
Kinza
Kozmosbot
Larbin
LeechGet
LibWeb
Libwhisker
Likse
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaRSSBot
LNSpiderguy
Ltx71
Mag-Net
magpie-crawler
Majestic12
MarkWatch
Mass Downloader
MauiBot
mediawords
Metauri
MFC_Tear_Sample
Microsoft Data Access
MIDown tool
Mister PiX
MJ12bot
Mojeek
Morfeus Fucking Scanner
MQQBrowser
Mr.4x3
MSFrontPage
Msrabot
Musobot
Name Intelligence
Nameprotect
Navroad
Nessus
NetAnts
netEstate NE Crawler
NimbleCrawler
Ninja
NPbot
Nutch
Offline Navigator
OnCrawl
Openfind
OPPO A33
OrangeSpider
Page Analyzer
PageScorer
Pandalytics
Papa Foto
pcBrowser
PECL::HTTP
Picscout
PictureFinder
Pimonster
plumanalytics
Psbot
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
RankurBot
Reaper
RedesScrapy
RepoMonkey
Ripper
Rogerbot
RSSingBot
s1z.ru
SalesIntelligent
ScanAlert
scan.lol
ScoutJet
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
SemrushBot
SEOkicks
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
SeoSiteCheckup
SEOstats
Siphon
SiteCheckerBotCrawler
SmartDownload
Snapbot
SocialRankIOBot
sogouspider
Sottopop
SpaceBison
SpankBot
Spanner
sp_auditbot
Spbot
spyfu
Sqlworm
Sucuri
SuperHTTP
SurveyBot
Telesoft
Telesphoreo
The Intraformant
Thumbor
Titan
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
trendiction.com
trendiction.de
True_Robot
Turingos
Turnitin
Twice
Typhoeus
Upflow
URLy Warning
URLy.Warning
Vagabondo
VB Project
VidibleScraper
Virusdie
VoidEYE
Webalta
WEBDAV
WebEnhancer
Web Fetch
WebFuck
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebSauger
Web Sauger
Webshag
WebsiteQuester
Website Quester
WebSucker
WeSEE
Whack
Whacker
Who.is Bot
Widow
Wotbox
WPScan
WWW-Collector-E
WWWOFFLE
x09Mozilla
x22Mozilla
Zade
Zauba
zauba.io
ZmEu