nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2020-11-07 00:42:00 +02:00

250 lines
2.6 KiB
Text

404checker
404enemy
80legs
Aboundexbot
Acunetix
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
AllSubmitter
archive.org_bot
arquivo-web-crawler
ASPSeek
Attach
AwarioRssBot
BackDoorBot
Backlink-Ceck
Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
Bitacle
Blackboard
BlackWidow
BLEXBot
Boardreader
Brandprotect
BuzzSumo
Calculon
CheTeam
ChinaClaw
Chlooe
Cliqzbot
coccocbot-web
cognitiveseo
com.plumanalytics
Copier
CopyRightCheck
Copyscape
CrazyWebCrawler
CSHttp
Custo
DataCha0s
DBLBot
demandbase-bot
Demon
Devil
Digincore
DigitalPebble
Disco
Discobot
Discoverybot
Dispatch
DnyzBot
DomainAppender
DomainCrawler
Domains Project
domainsproject.org
Dotbot
DSearch
DTS Agent
EasyDL
ECCP/1.0
Ecxi
EMail Siphon
EroCrawler
Extractor
Ezooms
facebookscraper
FDM
Foobot
FyberSpider
Getintent
G-i-g-a-b-o-t
Go!Zilla
GrapeshotCrawler
Havij
HEADMasterSEO
HTMLparser
HTTP::Lite
Humanlinks
Iblog
Image Fetch
Image Sucker
IndeedBot
isitwp.com
JetCar
Joomla
Jyxobot
Kenjin Spider
Kinza
Kozmosbot
LeechFTP
Lftp
LibWeb
LieBaoFast
Lightspeedsystems
LinkpadBot
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
Lmspider
lwp-trivial
Mag-Net
Mail.RU_Bot
MarkWatch
Masscan
Mass Downloader
Mata Hari
meanpathbot
MegaIndex.ru
Metauri
MFC_Tear_Sample
MicroMessenger
Microsoft URL Control
MIDown tool
Mister PiX
Mojeek
Morfeus Fucking Scanner
Mozlila
Mr.4x3
MSIECrawler
muhstik-scan
Name Intelligence
Navroad
Nessus
netEstate NE Crawler
NetSpider
Nettrack
Net Vampire
Niki-bot
Nmap
Nutch
oBot
Octopus
Offline Explorer
OnCrawl
Openvas
OpenVAS
OutclicksBot
Page Analyzer
Pandalytics
Papa Foto
pcBrowser
PHPCrawl
Pimonster
Pi-Monster
Psbot
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankingBot
RealDownload
RebelMouse
Recorder
ReGet
RocketCrawler
Rogerbot
satoristudio.net
ScanAlert
scan.lol
Scrapy
Screaming
ScreenerBot
Searchestate
SemrushBot
SEOlyticsCrawler
SEOprofiler
seoscanners
SeoSiteCheckup
SEOstats
serpstatbot
Siphon
SISTRIX
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Sitevigil
SlySearch
SMTBot
Snapbot
SocialRankIOBot
sogouspider
Sogou web spider
SpaceBison
Spanner
sp_auditbot
Spbot
Spinn3r
Sqlmap
Stripper
Sucuri
SuperBot
SuperHTTP
Szukacz
T0PHackTeam
T8Abot
tAkeOut
Teleport
Telesoft
TheNomad
Titan
Trendictionbot
Turingos
Turnitin
TurnitinBot
TwengaBot
Twice
UnisterBot
Upflow
URLy Warning
Vacuum
Vagabondo
VoidEYE
Voil
Voltron
Wallpapers/3.0
WallpapersHD
Web Auto
WEBDAV
WebEnhancer
Web Enhancer
WebFuck
WebImageCollector
WebPix
Web Pix
Web Sauger
Website Quester
Webster
WebStripper
WeSEE
Whack
Whacker
Widow
WiseGuys Robot
WISENutbot
Wonderbot
Woobot
WWW-Collector-E
x09Mozilla
Xaldon_WebSpider
YoudaoBot
Zade
zauba.io
Zermelo
Zitebot
ZumBot