nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2020-03-04 22:02:27 +02:00

250 lines
2.6 KiB
Text

80legs
Aboundex
ADmantX
AIBOT
AiHitBot
Aipbot
Alexibot
AllSubmitter
Anarchie
archive.org_bot
arquivo.pt
arquivo-web-crawler
Asterias
AwarioRssBot
AwarioSmartBot
BackDoorBot
Badass
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BDCbot
BDFetch
Black Hole
BlackWidow
BLEXBot
Blow
BlowFish
Boardreader
Bolt
BotALot
Brandwatch
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
Cegbfeieh
CheeseBot
CherryPicker
Chlooe
Cliqzbot
Cloud mapping
coccocbot-web
cognitiveseo
Collector
com.plumanalytics
CopyRightCheck
crawl.sogou.com
Crescent
CrunchBot
Curious
Custo
DataCha0s
demandbase-bot
Demon
Deusu
Digincore
DigitalPebble
Discobot
DittoSpyder
DomainAppender
DomainCrawler
Dotbot
DSearch
Ebingbong
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
Exabot
Express WebPictures
ExtLinksBot
ExtractorPro
Ezooms
Foobot
Go-Ahead-Got-It
Gotit
GoZilla
Grabber
Grafula
GrapeFX
GT::WWW
Harvest
Hloader
HTMLparser
Humanlinks
HybridBot
IDBot
Id-search
IlseBot
Image Sucker
Indy Library
InfoTekies
InterGET
Internet Ninja
internetVista monitor
Iria
IstellaBot
JamesBOT
JennyBot
JetCar
Joomla
Jyxobot
Kenjin Spider
LeechGet
Lftp
Likse
Linkdexbot
LinkpadBot
LinkScan
LinksManager
LinkWalker
LinqiaScrapeBot
Lipperhey Spider
Lmspider
Ltx71
LWP::Simple
lwp-trivial
Magnet
Majestic12
Majestic-SEO
Masscan
Mass Downloader
Mata Hari
meanpathbot
Meanpathbot
MeanPath Bot
mediawords
MegaIndex.ru
Metauri
MJ12bot
Mojolicious
MSIECrawler
Msrabot
Musobot
Name Intelligence
Needle
Nessus
netEstate NE Crawler
NetLyzer
NetSpider
NextGenSearchBot
Nibbler
NICErsPRO
Niki-bot
Nimbostratus
Nutch
oBot
Octopus
Offline Navigator
Openfind
Openvas
OrangeSpider
OutfoxBot
PageAnalyzer
PageScorer
Papa Foto
Pavuk
PECL::HTTP
PeoplePal
PHPCrawl
Picsearch
Pimonster
POE-Component-Client-HTTP
Probethenet
ProWebWalker
Pump
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot2
RankurBot
RealDownload
Reaper
Rogerbot
ScanAlert
ScoutJet
Scrapy
Screaming
SemrushBot
SEOlyticsCrawler
SeoSiteCheckup
SEOstats
Siphon
Sitebeam
SiteExplorer
SiteSnagger
SmartDownload
SMTBot
SocialRankIOBot
Sogou web spider
Sottopop
sp_auditbot
Spbot
spyfu
Sqlmap
Sucker
Sucuri
Surfbot
sysscan
Szukacz
T0PHackTeam
TeleportPro
Telesphoreo
Telesphorep
TheNomad
TightTwatBot
Titan
Toweyabot
trendiction.com
trendiction.de
Turingos
TurnitinBot
Twice
Typhoeus
Upflow
URLy.Warning
VCI
VeriCiteCrawler
VidibleScraper
Virusdie
Wallpapers/3.0
WASALive-Bot
Web Auto
Web Fetch
WebFuck
Web Fuck
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebsiteExtractor
Webster
WebSucker
Whacker
Who.is Bot
WinHTTrack
Wonderbot
Wotbox
WWW-Collector-E
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
xpymep1.exe
YoudaoBot
Zermelo
zgrab
ZmEu