nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-02 10:09:11 +00:00

250 lines
2.6 KiB
Text

ADmantX
Abonti
Aboundex
AfD-Verbotsverfahren
Alexibot
Alligator
Anarchie
Anarchy99
Ankit
Anthill
Aspiegel
Asterias
AwarioRssBot
AwarioSmartBot
BDCbot
BackStreet
BackWeb
BacklinkCrawler
Battleztar Bazinga
Black Hole
BlackWidow
Boardreader
Brandprotect
Brandwatch
Buck
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CODE87
CSHttp
CheTeam
CherryPicker
Copier
CopyRightCheck
Copyscape
Crawling at Home Project
CrazyWebCrawler
DBLBot
DIIbot
Demon
Devil
Discoverybot
DnyzBot
DomCopBot
DomainAppender
Domains Project
Dotbot
Download Wonder
ECCP/1.0
EMail Wolf
Ecxi
EroCrawler
Evil
Exabot
ExtLinksBot
Extractor
FHscan
Flunky
Foobot
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Genieo
GetRight
GetWeb
Getintent
Gigabot
Go-Ahead-Got-It
Grabber
GrapeFX
HTTP::Lite
Harvest
Heritrix
HybridBot
IDBTE4M
Iblog
Id-search
IndeedBot
InfoTekies
Internet Ninja
InternetSeer
IstellaBot
Jbrofuzz
JennyBot
JetCar
JikeSpider
Joomla
Keybot Translation-Search-Machine
Kozmosbot
Leap
LexiBot
LibWeb
Libwhisker
Likse
LinkScan
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
Ltx71
MIDown tool
MIIxpc
MQQBrowser
MSIECrawler
MTRobot
Magnet
Majestic SEO
Majestic12
MarkWatch
Masscan
MauiBot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft URL Control
Minefield
Moblie Safari
Mojeek
MolokaiBot
Mozlila
NPbot
Needle
Nessus
NetMechanic
NetSpider
Netcraft
Nettrack
Netvibes
Nibbler
Niki-bot
NimbleCrawler
Ninja
Nmap
Nutch
Offline Navigator
OpenVAS
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageThing.com
Papa Foto
Pavuk
PeoplePal
Petalbot
Pi-Monster
Picscout
Piepmatz
Pimonster
Pixray
Probethenet
Pu_iN
PxBroker
RankActive
RankFlex
RankingBot
Rankivabot
SMTBot
SalesIntelligent
ScanAlert
ScrepyBot
Searchestate
Semrush
SemrushBot
SeoSiteCheckup
SeobilityBot
Siphon
Site Sucker
SiteExplorer
SiteLockSpider
Sitebeam
Sitevigil
Snapbot
SocialRankIOBot
SpankBot
Steeler
Swiftbot
Szukacz
Telesoft
Telesphoreo
Telesphorep
TightTwatBot
Titan
Toata
Turnitin
Twice
URLy Warning
UnisterBot
V-BOT
VCI
VeriCiteCrawler
Voltron
WEBDAV
WPScan
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Auto
Web Fuck
Web Pix
WebBandit
WebCopier
WebGo IS
WebLeacher
WebSauger
WebSucker
WebWhacker
WebsiteExtractor
WebsiteQuester
Whatweb
WinHTTrack
Wonderbot
Woobot
Zade
Zermelo
Zeus
Zitebot
ZumBot
adscanner
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
cah.io.community
check1.exe
crawl.sogou.com
gopher
instabid
iubenda-radar
lwp-trivial
plumanalytics
s1z.ru
scalaj-http
seobility
seostar
sexsearcher
spyfu
sysscan
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla
zauba.io