nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-14 10:09:24 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
ADmantX
ALittle Client
ASPSeek
Abonti
Acunetix
AhrefsBot
AllSubmitter
AlphaBot
Anarchy
Anarchy99
Ankit
Apexoo
Asterias
AwarioRssBot
BDFetch
BackDoorBot
BackStreet
BackWeb
BacklinkCrawler
Badass
BetaBot
BlackWidow
Blow
Boardreader
Bolt
BotALot
Buck
BuiltBotTough
CCBot
CSHttp
Calculon
CherryPicker
Claritybot
Cliqzbot
Collector
Copier
Cosmos
CrazyWebCrawler
Crescent
CrunchBot
DBLBot
DSearch
DTS Agent
DataCha0s
Devil
Digincore
Dirbuster
Disco
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
Domains Project
Download Wonder
Drip
EMail Siphon
EasyDL
Ecxi
EroCrawler
Express WebPictures
EyeNetIE
FHscan
Fimap
Firefox/7.0
FrontPage
G-i-g-a-b-o-t
Genieo
GermCrawler
GetWeb
Getintent
Go!Zilla
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
HMView
HTMLparser
Harvest
Iblog
IlseBot
Image Fetch
IndeedBot
InfoNaviRobot
Intelliseek
Internet Ninja
IstellaBot
JikeSpider
Kenjin Spider
Keyword Density
LeechGet
Lftp
LieBaoFast
LinkScan
LinkWalker
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Ltx71
MFC_Tear_Sample
Mail.RU_Bot
Mass Downloader
Meanpathbot
MicroMessenger
Microsoft URL Control
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Musobot
NICErsPRO
Nessus
Net Vampire
NetZIP
Nibbler
Niki-bot
Nikto
Ninja
Nmap
Octopus
OnCrawl
OpenVAS
Openfind
OrangeBot
OutclicksBot
PECL::HTTP
PageGrabber
Pandalytics
Pavuk
PeoplePal
Piepmatz
PleaseCrawl
ProPowerBot
Pump
QueryN Metasearch
RSSingBot
RankActive
RankActiveLinkBot
Re-re
Reaper
Recorder
RepoMonkey
Rogerbot
SBIder
SEOlyticsCrawler
SISTRIX
ScanAlert
Scrapy
ScreenerBot
ScrepyBot
SeoSiteCheckup
SeobilityBot
Site Sucker
SiteLockSpider
SiteSnagger
SiteSucker
Siteimprove
SlySearch
Sogou web spider
Sottopop
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Steeler
Stripper
Sucker
SuperBot
Surfbot
SurveyBot
Suzuran
Szukacz
T0PHackTeam
Titan
Toata
Trendictionbot
Turnitin
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
Upflow
VCI
Vagabondo
VeriCiteCrawler
Virusdie
Voltron
WASALive-Bot
WBSearchBot
WPScan
WWW-Collector-E
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Collage
Web Fuck
Web Pix
WebBandit
WebCollage
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebWhacker
Webalta
Webshag
WebsiteExtractor
Whacker
WinHTTrack
WiseGuys Robot
Woobot
Wotbox
Wprecon
Xenu
Zauba
ZoomBot
ZyBorg
archive.org_bot
autoemailspider
backlink-check
clark-crawler
coccocbot-web
com.plumanalytics
crawl.sogou.com
crawler4j
domainsproject.org
eCatch
instabid
internetVista monitor
meanpathbot
mediawords
page scorer
plumanalytics
probe-image-size
seostar
sp_auditbot
spyfu
voyagerx.com
webmeup-crawler
webpros.com
xpymep1.exe
zgrab