nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2020-01-28 15:22:27 +02:00

250 lines
2.6 KiB
Text

404checker
Aboundex
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
AllSubmitter
Anarchie
Apexoo
ASPSeek
Attach
autoemailspider
AwarioRssBot
Backlink-Ceck
backlink-check
BackStreet
Badass
Battleztar Bazinga
BDCbot
BDFetch
BetaBot
Bigfoot
Bitacle
Blackboard
Blow
BlowFish
Boardreader
BotALot
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CazoodleBot
CCBot
Chlooe
Cloud mapping
cognitiveseo
com.plumanalytics
CopyRightCheck
Cosmos
Craftbot
CrazyWebCrawler
CSHttp
DBLBot
demandbase-bot
Deusu
Devil
Digincore
DigitalPebble
Discobot
DittoSpyder
DomainCrawler
DomainSigmaCrawler
Drip
DSearch
EasyDL
eCatch
ECCP/1.0
EMail Wolf
EroCrawler
evc-batch
Evil
Extreme Picture Finder
FlashGet
Flunky
Freeuploader
FrontPage
Fyrebot
Getintent
GetWeb
Go-Ahead-Got-It
GoZilla
GrapeFX
GrapeshotCrawler
GT::WWW
Harvest
Havij
heritrix
HMView
HTMLparser
HTTrack
Humanlinks
Iblog
IDBot
Id-search
IlseBot
Image Sucker
IndeedBot
InfoTekies
Intelliseek
Internet Ninja
InternetSeer
internetVista monitor
Iria
JennyBot
JOC Web Spider
Jorgee
Jyxobot
Kenjin Spider
Likse
LinkpadBot
LinkScan
Lipperhey
Lmspider
Ltx71
lwp-request
LWP::Simple
Magnet
magpie-crawler
Mail.RU_Bot
MarkMonitor
Masscan
meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
MIDown tool
MIIxpc
Mister PiX
MJ12bot
Morfeus Fucking Scanner
Mr.4x3
MSFrontPage
Msrabot
Name Intelligence
Nameprotect
NearSite
Needle
Nessus
netEstate NE Crawler
NetMechanic
Nettrack
Netvibes
NetZIP
Nibbler
NimbleCrawler
NPbot
OnCrawl
Openfind
OpenLinkProfiler
Openvas
OrangeBot
OrangeSpider
OutfoxBot
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Panscient
Pavuk
pcBrowser
PHPCrawl
Picscout
Pi-Monster
Pixray
plumanalytics
Pockey
Probethenet
Psbot
PxBroker
Quick-Crawler
RankActive
RankingBot2
Reaper
RocketCrawler
RSSingBot
s1z.ru
SalesIntelligent
ScanAlert
scan.lol
ScoutJet
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
serpstatbot
sexsearcher
Shodan
SISTRIX
Sitebeam
SiteExplorer
Siteimprove
SiteLockSpider
SlySearch
SmartDownload
Sociscraper
sogouspider
Sogou web spider
Sosospider
Sottopop
SpaceBison
Spanner
sp_auditbot
Spbot
spyfu
Sqlworm
Stripper
Sucker
Sucuri
SuperHTTP
Swiftbot
T8Abot
Teleport
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Thumbor
Toata
Tracemyfile
trendiction.de
Turingos
Turnitin
TurnitinBot
UnisterBot
Upflow
URLy Warning
Vagabondo
VCI
VeriCiteCrawler
WASALive-Bot
Web Auto
WebBandit
WebCollage
Web Collage
Web Enhancer
WebFuck
Web Fuck
WebLeacher
webmeup-crawler
Web Sauger
Webshag
WebSucker
WebWhacker
WeSEE
Whacker
WinHTTrack
WiseGuys Robot
WPScan
x09Mozilla
x22Mozilla
Xaldon WebSpider
Zauba
Zitebot