nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-08 10:09:18 +00:00

250 lines
2.5 KiB
Text

360Spider
Abonti
Acunetix
AhrefsBot
AiHitBot
Aipbot
Anarchie
Anarchy
Ankit
Anthill
Aspiegel
Asterias
Attach
BBBike
BDCbot
BLEXBot
BackWeb
Badass
Bandit
BatchFTP
Battleztar Bazinga
Black Hole
BlackWidow
Bolt
Brandprotect
Buddy
BuiltBotTough
Bullseye
CATExplorador
CODE87
Chlooe
Citoid
Cliqzbot
Cloud mapping
Collector
Copier
CrazyWebCrawler
Crescent
DBLBot
DSearch
DTS Agent
DataCha0s
Devil
Disco
Discoverybot
DittoSpyder
DnyzBot
DomainAppender
Dotbot
Dragonfly
ECCP/1.0
EMail Siphon
EMail Wolf
Ecxi
EroCrawler
Extractor
Ezooms
FDM
FHscan
FemtosearchBot
Fimap
Foobot
Fuzz
GT::WWW
GalaxyBot
Genieo
GermCrawler
GetWeb
Go!Zilla
Grafula
GridBot
Harvest
Havij
Hloader
HonoluluBot
HybridBot
Image Sucker
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
JikeSpider
Jorgee
JustView
Kenjin Spider
Keyword Density
LWP::Simple
Leap
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkWalker
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lmspider
MIIxpc
MJ12bot
MSIECrawler
Magnet
Mail.RU_Bot
Majestic-SEO
MarkMonitor
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Metauri
MicroMessenger
Microsoft Data Access
Mister PiX
MolokaiBot
Mr.4x3
Msrabot
NPbot
Nameprotect
Needle
Net Vampire
NetAnts
NetZIP
Netvibes
Niki-bot
NimbleCrawler
Not
Nutch
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
PECL::HTTP
PHPCrawl
PageScorer
PictureFinder
PleaseCrawl
ProWebWalker
Probethenet
Pump
PyCurl
QueryN Metasearch
RankActive
RankingBot
RankingBot2
Rankivabot
RankurBot
Re-re
ReGet
RealDownload
RedesScrapy
RepoMonkey
SBIder
SEOlyticsCrawler
SEOprofiler
SISTRIX
ScanAlert
Scanbot
Screaming
Seekport
Semrush
Shodan
SiteLockSpider
Sitebeam
Siteimprove
SmartDownload
Snake
Snoopy
Sosospider
Sottopop
SpankBot
Sqlworm
Sqworm
Steeler
Stripper
Sucuri
Suzuran
Szukacz
Telesphorep
TheNomad
Toweyabot
True_Robot
Turnitin
TurnitinBot
Twice
Typhoeus
URLy.Warning
Upflow
VCI
Vacuum
VoidEYE
Voil
Voltron
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Auto
WebEnhancer
WebFetch
WebImageCollector
WebLeacher
WebWhacker
WebZIP
Webshag
Webster
Woobot
Wprecon
Xenu
Zade
Zeus
Zitebot
ZyBorg
adscanner
backlink-check
cah.io.community
check1.exe
domainsproject.org
facebookscraper
heritrix
instabid
iubenda-radar
linkdexbot
magpie-crawler
meanpathbot
mediawords
muhstik-scan
oBot
page scorer
pcBrowser
ripz
s1z.ru
satoristudio.net
scalaj-http
seobility
seocompany.store
seoscanners
sexsearcher
sogouspider
sysscan
tAkeOut
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
x09Mozilla
zauba.io