nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-16 10:09:09 +00:00

250 lines
2.7 KiB
Text

360Spider
404enemy
80legs
ADmantX
AIBOT
Abonti
Acunetix
AhrefsBot
Alligator
AlphaBot
Anarchie
AwarioRssBot
AwarioSmartBot
BDCbot
BackStreet
BacklinkCrawler
Badass
Barkrowler
BatchFTP
Battleztar Bazinga
Black Hole
Blackboard
Brandprotect
Brandwatch
BuiltBotTough
CATExplorador
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CheTeam
Citoid
Claritybot
Copier
CopyRightCheck
Custo
CyotekWebCopy
DSearch
DTS Agent
Deusu
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Dragonfly
Drip
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
EirGrabber
Express WebPictures
ExtractorPro
EyeNetIE
Fimap
Fyrebot
G-i-g-a-b-o-t
GermCrawler
Getintent
Go!Zilla
GoZilla
Gotit
GrabNet
HMView
HTMLparser
HTTrack
Harvest
Havij
HonoluluBot
HybridBot
IDBot
Iblog
Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot
Indy Library
Internet Ninja
InternetSeer
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
Jorgee
Keybot Translation-Search-Machine
Keyword Density
Kinza
LWP::Simple
Lanshanbot
Larbin
Leap
LeechFTP
LeechGet
LexiBot
LibWeb
LieBaoFast
LinkWalker
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Mail.RU_Bot
Mata Hari
Mb2345Browser
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojeek
Morfeus Fucking Scanner
Msrabot
Musobot
Navroad
NetLyzer
Nibbler
Niki-bot
Ninja
Octopus
Openvas
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageScorer
Papa Foto
Pavuk
PeoplePal
Picscout
Picsearch
PictureFinder
Pimonster
Pockey
ProWebWalker
Pu_iN
PxBroker
RankActive
RankActiveLinkBot
RankingBot2
Rankivabot
RebelMouse
RedesScrapy
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
ScanAlert
Scanbot
ScoutJet
ScrepyBot
SemanticJuice
SemrushBot
Seomoz
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
Sitevigil
Snake
SocialRankIOBot
Sogou web spider
Spammen
Steeler
Stripper
Sucker
SuperHTTP
SurveyBot
Suzuran
Szukacz
T0PHackTeam
T8Abot
Telesphoreo
TheNomad
Thumbor
Trendiction
Turingos
Turnitin
Twice
Upflow
V-BOT
VB Project
VeriCiteCrawler
Virusdie
VoidEYE
WASALive-Bot
WBSearchBot
WWW-Collector-E
WWW-Mechanize
WallpapersHD
Web Auto
Web Enhancer
Web Sauger
WebCopier
WebFetch
WebFuck
WebReaper
WebSauger
WebSucker
WebWhacker
WebZIP
Website Quester
WebsiteExtractor
WiseGuys Robot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zauba
ZyBorg
arquivo-web-crawler
backlink-check
check1.exe
coccocbot
crawl.sogou.com
crawler.feedback
crawler4j
demandbase-bot
heritrix
internetVista monitor
ips-agent
isitwp.com
lwp-request
muhstik-scan
oBot
page scorer
plumanalytics
probe-image-size
s1z.ru
satoristudio.net
seocompany.store
seostar
sogouspider
spyfu
sysscan
webpros.com
x22Mozilla
xpymep1.exe
zauba.io