nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2020-01-28 13:21:25 +02:00

250 lines
2.6 KiB
Text

Aboundex
ADmantX
AIBOT
Aipbot
Alligator
AlphaBot
Apexoo
archive.org_bot
arquivo.pt
ASPSeek
Attach
autoemailspider
AwarioSmartBot
BackDoorBot
Backlink-Ceck
backlink-check
BackStreet
BatchFTP
BBBike
BDCbot
BDFetch
Blackboard
Black Hole
BlowFish
Boardreader
Bolt
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CazoodleBot
CheTeam
Claritybot
Cliqzbot
Cloud mapping
coccocbot-web
Copyscape
Cosmos
Craftbot
CrunchBot
CSHttp
DataCha0s
DBLBot
Demon
Devil
Digincore
DigitalPebble
DIIbot
Discobot
DittoSpyder
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
Drip
DTS Agent
EasyDL
EirGrabber
EroCrawler
Extractor
ExtractorPro
EyeNetIE
Ezooms
facebookscraper
Firefox/7.0
Flunky
Freeuploader
Fyrebot
Genieo
GermCrawler
Getintent
GetRight
Gotit
GoZilla
Grafula
GrapeFX
GrapeshotCrawler
HaosouSpider
HEADMasterSEO
heritrix
HybridBot
IDBot
Id-search
IlseBot
Image Fetch
IndeedBot
InfoNaviRobot
InternetSeer
internetVista monitor
Iria
IRLbot
IstellaBot
JamesBOT
Jbrofuzz
Jetty
JikeSpider
Joomla
Jorgee
Jyxobot
Kenjin Spider
LeechFTP
Lftp
Libwhisker
Linkdexbot
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
LNSpiderguy
Ltx71
Mag-Net
Mail.RU_Bot
Majestic12
Majestic SEO
Masscan
Mata Hari
MauiBot
Meanpathbot
MeanPath Bot
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MIDown tool
MJ12bot
Mojeek
Morfeus Fucking Scanner
MSFrontPage
muhstik-scan
Name Intelligence
Nameprotect
Needle
NetAnts
NetMechanic
NetSpider
Nettrack
Net Vampire
Netvibes
NICErsPRO
NPbot
Nutch
oBot
Octopus
Offline Explorer
Offline Navigator
Openvas
OutfoxBot
PageAnalyzer
Pandalytics
Pavuk
PECL::HTTP
PHPCrawl
Picscout
PictureFinder
Pimonster
plumanalytics
POE-Component-Client-HTTP
Probethenet
ProWebWalker
Pump
RankActiveLinkBot
RankFlex
RankingBot2
Rankivabot
RankurBot
RedesScrapy
RSSingBot
SalesIntelligent
scan.lol
ScoutJet
Scrapy
Screaming
Searchestate
SemrushBot
SEOkicks
SEOlyticsCrawler
SEOstats
serpstatbot
sexsearcher
SISTRIX
Sitebeam
SiteLockSpider
SiteSnagger
SiteSucker
Site Sucker
Sociscraper
sogouspider
Sogou web spider
Sosospider
Sottopop
SpankBot
Spanner
spyfu
Sqlworm
Steeler
Sucker
Sucuri
SuperHTTP
SurveyBot
Suzuran
Swiftbot
Szukacz
T8Abot
Telesoft
Telesphorep
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
trendiction.com
True_Robot
TurnitinBot
TwengaBot
Twice
UnisterBot
URLy Warning
Vacuum
VB Project
VoidEYE
Voil
Wallpapers/3.0
WBSearchBot
Webalta
WebBandit
WebFetch
WebPix
Web Pix
WebsiteExtractor
WebsiteQuester
Website Quester
WebStripper
WebZIP
Whacker
WinHTTrack
WiseGuys Robot
Woobot
Wprecon
WPScan
WWW-Collector-E
x09Mozilla
Xenu
xpymep1.exe
Zermelo
Zeus
zgrab
ZmEu
ZumBot