nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-12 10:10:30 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
80legs
ADmantX
ASPSeek
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AiHitBot
AllSubmitter
Anthill
Asterias
AwarioSmartBot
BackStreet
BackWeb
Badass
Bandit
Barkrowler
BetaBot
Black Hole
BlackWidow
Blackboard
Blow
Bolt
BotALot
Buddy
BunnySlippers
CCBot
CensysInspect
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
CopyRightCheck
Copyscape
Craftbot
CyotekWebCopy
DIIbot
DataCha0s
Digincore
DigitalPebble
Dirbuster
Disco
Discoverybot
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler
Domains Project
ECCP/1.0
EasyDL
Ecxi
Exabot
Extreme Picture Finder
FHscan
FemtosearchBot
Fimap
Firefox/7.0
Flunky
FrontPage
G-i-g-a-b-o-t
Genieo
Getintent
Go!Zilla
GoZilla
GrabNet
HTMLparser
Havij
Heritrix
HybridBot
IDBot
IRLbot
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Internet Ninja
JOC Web Spider
JetCar
JikeSpider
Joomla
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Larbin
LexiBot
Likse
LinkScan
LinkWalker
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
MSFrontPage
MSIECrawler
MTRobot
Majestic-SEO
Majestic12
Mata Hari
Meanpathbot
MicroMessenger
Mojolicious
MolokaiBot
Mr.4x3
NICErsPRO
NPbot
Nameprotect
Needle
NetZIP
Nikto
Octopus
Offline Navigator
OnCrawl
OpenVAS
Openfind
OrangeBot
OutclicksBot
PageGrabber
PageThing.com
Panscient
PeoplePal
Pi-Monster
Piepmatz
PleaseCrawl
ProPowerBot
Pump
PyCurl
QueryN Metasearch
RSSingBot
RankActive
RankActiveLinkBot
RankFlex
RankurBot
Re-re
ReGet
RealDownload
RebelMouse
Recorder
RedesScrapy
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOprofiler
SEOstats
SISTRIX
Scanbot
Screaming
ScreenerBot
SearchmetricsBot
Seekport
SemanticJuice
Seomoz
Siphon
SiteExplorer
SiteLockSpider
SlySearch
Snake
Snoopy
Sosospider
Spanner
Steeler
Stripper
Sucuri
SuperHTTP
Surfbot
SurveyBot
Suzuran
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesoft
Telesphoreo
Toata
True_Robot
TwengaBot
URLy.Warning
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
WASALive-Bot
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
WeSEE
Web Fetch
Web Sauger
WebBandit
WebCopier
WebEnhancer
WebImageCollector
WebLeacher
WebPix
WebReaper
WebStripper
WebWhacker
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
Whacker
Whatweb
Who.is Bot
Widow
Wotbox
Wprecon
Xaldon_WebSpider
YoudaoBot
Zauba
Zeus
ZoomBot
ZoominfoBot
adscanner
arquivo-web-crawler
autoemailspider
com.plumanalytics
crawl.sogou.com
demandbase-bot
eCatch
evc-batch
internetVista monitor
ips-agent
isitwp.com
lwp-trivial
meanpathbot
page scorer
pcBrowser
plumanalytics
polaris version
s1z.ru
scan.lol
seobility
seoscanners
siteripz
sogouspider
sysscan
tAkeOut
webprosbot
x09Mozilla
x22Mozilla
zgrab