nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-16 10:09:00 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
AIBOT
Acunetix
AiHitBot
Alexibot
AllSubmitter
AlphaBot
Ankit
Aspiegel
Asterias
Attach
BackStreet
Bandit
BatchFTP
Battleztar Bazinga
Bitacle
Black Hole
Blackboard
Blow
BlowFish
Brandwatch
BuiltBotTough
CCBot
Cegbfeieh
CheTeam
Chlooe
Collector
CopyRightCheck
Cosmos
Crawling at Home Project
CrazyWebCrawler
Curious
Custo
CyotekWebCopy
DBLBot
DSearch
DTS Agent
DataCha0s
Demon
Dirbuster
Disco
Discoverybot
Dispatch
DnBCrawler-Analytics
DomainAppender
DomainStatsBot
Dragonfly
Drip
ECCP/1.0
Ecxi
Evil
Exabot
Extractor
FDM
Flunky
Foobot
Freeuploader
FyberSpider
GalaxyBot
Genieo
Go!Zilla
Go-Ahead-Got-It
GoZilla
Grabber
HTMLparser
Harvest
Havij
Hloader
HonoluluBot
Humanlinks
HybridBot
IRLbot
Id-search
Image Sucker
Internet Ninja
JOC Web Spider
Jbrofuzz
JetCar
Joomla
Jorgee
JustView
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot
LWP::Simple
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
LieBaoFast
LinkWalker
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MIIxpc
MQQBrowser
Mag-Net
Magnet
Mail.RU_Bot
Majestic12
MarkWatch
Mb2345Browser
Metauri
Mozlila
NearSite
Needle
Nessus
NetAnts
NetSpider
Netcraft
Nettrack
Niki-bot
Ninja
Nmap
Nuclei
Nutch
Octopus
Offline Explorer
Offline Navigator
Openfind
Openvas
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Pandalytics
Papa Foto
PeoplePal
Pi-Monster
Picscout
PleaseCrawl
Psbot
PxBroker
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RebelMouse
RepoMonkey
RocketCrawler
SEOkicks-Robot
SMTBot
SalesIntelligent
ScanAlert
Scanbot
Scrapy
ScreenerBot
Searchestate
Semrush
SemrushBot
SentiBot
Siphon
Site Sucker
SiteExplorer
SiteLockSpider
SiteSnagger
Sitebeam
Siteimprove
SmartDownload
Sociscraper
Sogou web spider
SpaceBison
Spammen
SpankBot
Spinn3r
SputnikBot
Sqlworm
Steeler
Stripper
Sucker
Sucuri
SuperHTTP
Swiftbot
T0PHackTeam
T8Abot
Telesphoreo
TightTwatBot
Titan
Trendiction
Turingos
TurnitinBot
URLy Warning
UnisterBot
VCI
Vacuum
VeriCiteCrawler
VoidEYE
Voil
Voltron
WASALive-Bot
WBSearchBot
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Auto
Web Collage
Web Enhancer
Web Sucker
WebBandit
WebCopier
WebFetch
WebImageCollector
WebmasterWorldForumBot
Webshag
Whacker
Whatweb
WiseGuys Robot
Wotbox
Wprecon
Xaldon_WebSpider
YoudaoBot
Zade
ZoomBot
arquivo.pt
autoemailspider
backlink-check
cah.io.community
coccocbot
cognitiveseo
crawler.feedback
demandbase-bot
domainsproject.org
heritrix
isitwp.com
lwp-request
lwp-trivial
netEstate NE Crawler
s1z.ru
scalaj-http
serpstatbot
sexsearcher
sitechecker.pro
sp_auditbot
sysscan
trendiction.com
trendiction.de
webmeup-crawler
webpros.com
webprosbot
x22Mozilla
xpymep1.exe
zauba.io