nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-01 10:20:22 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
ALittle Client
Aboundex
AhrefsBot
AiHitBot
Anarchie
Anarchy
Apexoo
Asterias
Atomseobot
AwarioRssBot
BDFetch
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
Barkrowler
Bigfoot
BlackWidow
Blackboard
Boardreader
BotALot
Brandprotect
Brandwatch
BuiltBotTough
BunnySlippers
BuzzSumo
Calculon
CazoodleBot
Cegbfeieh
Citoid
Cocolyzebot
Cogentbot
Collector
Copier
CopyRightCheck
Cosmos
Crawling at Home Project
Crescent
DIIbot
DTS Agent
DataCha0s
Demon
Dirbuster
Disco
Discobot
DnBCrawler-Analytics
DomainStatsBot
Domains Project
Dotbot
Drip
EMail Wolf
Ecxi
EroCrawler
Exabot
ExtLinksBot
Extractor
Extreme Picture Finder
FlashGet
Freeuploader
FrontPage
GT::WWW
GalaxyBot
Genieo
GermCrawler
GetRight
GetWeb
GoZilla
Gotit
GrabNet
Grafula
GrapeshotCrawler
HEADMasterSEO
HMView
HonoluluBot
HybridBot
IlseBot
Image Sucker
Indy Library
InfoTekies
Intelliseek
InternetSeer
Iskanie
JOC Web Spider
JennyBot
JetCar
JikeSpider
Jyxobot
Kenjin Spider
LNSpiderguy
Leap
LeechFTP
LexiBot
Lftp
Libwhisker
Lightspeedsystems
Linkdexbot
LinqiaRSSBot
Lipperhey Spider
MIIxpc
MJ12bot
MSFrontPage
MTRobot
Magnet
Mail.RU_Bot
Majestic SEO
Majestic12
MarkWatch
Masscan
Mata Hari
Mb2345Browser
MegaIndex.ru
Metauri
Moblie Safari
Mojeek
Mozlila
Msrabot
Musobot
Nameprotect
Net Vampire
NetMechanic
Nettrack
Netvibes
Nibbler
Niki-bot
Nuclei
Offline Explorer
OnCrawl
OpenLinkProfiler
Openfind
OrangeBot
OrangeSpider
PECL::HTTP
PHPCrawl
Page Analyzer
Pi-Monster
Piepmatz
Pixray
Psbot
Pu_iN
Pump
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankingBot
Rankivabot
Reaper
Recorder
RepoMonkey
Rogerbot
SEOkicks
SEOstats
SISTRIX
SalesIntelligent
Scanbot
ScoutJet
Scrapy
Screaming
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
Seomoz
SiteCheckerBotCrawler
SmartDownload
Snapbot
Sosospider
SpankBot
Spanner
Spbot
SputnikBot
Sqlmap
Sqworm
Steeler
Suzuran
Swiftbot
Teleport
TeleportPro
The Intraformant
Thumbor
TightTwatBot
Titan
Toweyabot
Trendiction
TwengaBot
Twice
Upflow
V-BOT
VB Project
VCI
Vagabondo
VeriCiteCrawler
Virusdie
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
Web Collage
Web Fuck
WebAuto
WebBandit
WebFuck
WebImageCollector
WebPix
WebReaper
WebStripper
WebWhacker
WebmasterWorldForumBot
Webster
Who.is Bot
Wprecon
YoudaoBot
Zermelo
ZumBot
arquivo.pt
autoemailspider
coccocbot
crawl.sogou.com
evc-batch
facebookscraper
gopher
heritrix
instabid
ips-agent
isitwp.com
iubenda-radar
lwp-request
lwp-trivial
meanpathbot
mediawords
page scorer
plumanalytics
polaris version
ripz
satoristudio.net
seobility
seoscanners
sitechecker.pro
sp_auditbot
sysscan
ubermetrics-technologies.com
webgains-bot
x09Mozilla
x22Mozilla
zauba.io