nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-03 22:07:12 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
80legs
ASPSeek
Abonti
Aipbot
Alexibot
Alligator
Anarchy99
Ankit
Asterias
AwarioSmartBot
BDCbot
BLEXBot
BackWeb
Black Hole
BlackWidow
Blackboard
Boardreader
Buck
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CCBot
Calculon
CensysInspect
CheTeam
Chlooe
Cloud mapping
Collector
Copyscape
CrazyWebCrawler
CrunchBot
Curious
DBLBot
Demon
Deusu
DigitalPebble
DittoSpyder
DomainStatsBot
Dotbot
Drip
EMail Siphon
Ebingbong
Ecxi
EirGrabber
Extractor
Extreme Picture Finder
EyeNetIE
FHscan
FemtosearchBot
Flunky
Freeuploader
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GetRight
GetWeb
Getintent
Grabber
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTMLparser
HTTrack
Haansoft
Harvest
Hloader
IDBTE4M
Id-search
Image Fetch
Indy Library
Intelliseek
InternetSeer
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
Joomla
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
Larbin
LeechFTP
Lftp
LibWeb
Libwhisker
LinkWalker
Linkbot
LinkextractorPro
LinksManager
LinqiaScrapeBot
Litemage_walker
MIDown tool
MJ12bot
MQQBrowser
MSFrontPage
Mag-Net
Magnet
Mail.RU_Bot
Majestic SEO
MarkWatch
MauiBot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
Msrabot
Musobot
Name Intelligence
Nameprotect
Needle
NetLyzer
NetMechanic
NetZIP
Netcraft
Nibbler
Ninja
Nmap
Offline Explorer
OpenLinkProfiler
OpenVAS
OrangeSpider
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer
PageThing.com
Pandalytics
Panscient
Petalbot
Pi-Monster
Picscout
Picsearch
PleaseCrawl
Pockey
ProWebWalker
Probethenet
Psbot
Pu_iN
PxBroker
RankActiveLinkBot
RankingBot2
Re-re
RealDownload
RebelMouse
RepoMonkey
RocketCrawler
SBIder
SEOlyticsCrawler
ScanAlert
ScoutJet
Scrapy
Searchestate
SearchmetricsBot
SeoSiteCheckup
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
Spammen
Spbot
Sqlworm
Steeler
Sucker
SuperBot
Surfbot
Suzuran
TheNomad
Toweyabot
Tracemyfile
Turingos
TwengaBot
Upflow
VB Project
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voil
Voltron
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Web Collage
Web Fuck
WebAuto
WebGo IS
WebImageCollector
WebPix
WebReaper
WebSauger
WebStripper
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
WebsiteQuester
Webster
Who.is Bot
WiseGuys Robot
Woobot
Wprecon
Xaldon WebSpider
Xenu
YoudaoBot
Zade
Zermelo
Zeus
ZoomBot
ZumBot
ZyBorg
arquivo.pt
coccocbot-web
cognitiveseo
com.plumanalytics
facebookscraper
instabid
ips-agent
isitwp.com
meanpathbot
plumanalytics
ripz
satoristudio.net
seobility
seostar
serpstatbot
siteripz
sogouspider
spyfu
sysscan
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webpros.com
webprosbot
x22Mozilla
xpymep1.exe