nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-11-02 20:57:40 +02:00

250 lines
2.6 KiB
Text

360Spider
404checker
404enemy
Aboundexbot
Acunetix
AhrefsBot
AIBOT
AiHitBot
Aipbot
Alexibot
Alligator
AlphaBot
archive.org_bot
AwarioRssBot
AwarioSmartBot
Backlink-Ceck
BackStreet
Badass
Bandit
Barkrowler
Battleztar Bazinga
BDCbot
BetaBot
BlackWidow
Blow
BlowFish
Bolt
BotALot
Brandprotect
Buddy
Bullseye
BunnySlippers
CATExplorador
CherryPicker
CheTeam
ChinaClaw
Claritybot
Cloud mapping
coccocbot-web
cognitiveseo
Collector
com.plumanalytics
crawler4j
crawler.feedback
Crescent
CSHttp
Custo
demandbase-bot
Demon
Dirbuster
Disco
Discoverybot
Dispatch
DnyzBot
DomainSigmaCrawler
Drip
EasyDL
eCatch
ECCP/1.0
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
ExtractorPro
Extreme Picture Finder
Ezooms
facebookscraper
FemtosearchBot
Fimap
Firefox/7.0
Flunky
Freeuploader
Fyrebot
Genieo
GermCrawler
GetRight
Gigabot
G-i-g-a-b-o-t
Gotit
Grabber
GrabNet
GrapeshotCrawler
HaosouSpider
Harvest
Havij
HEADMasterSEO
heritrix
HMView
HybridBot
Iblog
IDBot
IlseBot
instabid
Intelliseek
ips-agent
IRLbot
JamesBOT
JennyBot
Joomla
JustView
Jyxobot
Kozmosbot
Larbin
LexiBot
Libwhisker
Lightspeedsystems
Likse
LinkextractorPro
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
lwp-request
lwp-trivial
Magnet
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru
Microsoft URL Control
MIDown tool
Mister PiX
Mojeek
MSFrontPage
MSIECrawler
Name Intelligence
Nameprotect
Nessus
netEstate NE Crawler
NetLyzer
Netvibes
NetZIP
NextGenSearchBot
Nibbler
NICErsPRO
Nikto
NimbleCrawler
Nutch
oBot
Octopus
OutclicksBot
PageAnalyzer
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Panscient
Papa Foto
PECL::HTTP
PHPCrawl
Pimonster
POE-Component-Client-HTTP
Probethenet
ProPowerBot
ProWebWalker
Psbot
PxBroker
QueryN Metasearch
Quick-Crawler
RankActive
RankingBot
Rankivabot
RankurBot
Recorder
RepoMonkey
RSSingBot
SBIder
Scanbot
Scrapy
ScreenerBot
SearchmetricsBot
SemrushBot
SEOkicks
SEOprofiler
Shodan
Siteimprove
SiteLockSpider
SiteSnagger
SiteSucker
Sitevigil
SlySearch
Snapbot
Sogou web spider
SpankBot
Spbot
Spinn3r
SputnikBot
spyfu
Sqlmap
Sqlworm
Stripper
Sucuri
SuperHTTP
Suzuran
Szukacz
T0PHackTeam
tAkeOut
TeleportPro
Trendiction
trendiction.com
trendiction.de
Turingos
Turnitin
Twice
Typhoeus
URLy Warning
URLy.Warning
Vagabondo
VCI
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
WASALive-Bot
Web Auto
WebBandit
WebCopier
WebFuck
WebGo IS
WebImageCollector
WebmasterWorldForumBot
WebPix
Web Pix
Website Quester
WebStripper
WebWhacker
WeSEE
WiseGuys Robot
Wotbox
WPScan
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
x09Mozilla
x22Mozilla
xpymep1.exe
Zade
Zermelo
Zeus
zgrab
Zitebot
ZyBorg