nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-12-02 21:12:22 +02:00

250 lines
2.6 KiB
Text

360Spider
404enemy
80legs
Aboundexbot
ADmantX
AfD-Verbotsverfahren
AIBOT
Alexibot
AllSubmitter
Apexoo
Asterias
Attach
BackDoorBot
backlink-check
Badass
Bandit
BDCbot
BDFetch
BetaBot
Bitacle
Black Hole
BlackWidow
Bolt
Brandprotect
Buddy
BuiltBotTough
BuzzSumo
CazoodleBot
CCBot
CherryPicker
CheTeam
Chlooe
coccocbot-web
cognitiveseo
Collector
com.plumanalytics
Copier
CopyRightCheck
Craftbot
crawler.feedback
CrazyWebCrawler
Crescent
CrunchBot
Curious
DataCha0s
demandbase-bot
Demon
Devil
Digincore
DigitalPebble
DIIbot
Discoverybot
DittoSpyder
DomainAppender
DomainCrawler
DomainSigmaCrawler
Download Wonder
Dragonfly
Drip
DSearch
DTS Agent
EMail Siphon
EroCrawler
Evil
Exabot
Express WebPictures
Extreme Picture Finder
EyeNetIE
FDM
FHscan
Flunky
Freeuploader
Fyrebot
Genieo
Getintent
GetWeb
Gigablast
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
Go!Zilla
GrabNet
GrapeshotCrawler
GT::WWW
Haansoft
HaosouSpider
heritrix
HTTP::Lite
HTTrack
HybridBot
IDBot
Image Fetch
IndeedBot
Indy Library
instabid
InterGET
Internet Ninja
internetVista monitor
IRLbot
IstellaBot
Jbrofuzz
JikeSpider
JOC Web Spider
Jorgee
JustView
Jyxobot
Kenjin Spider
LeechGet
Lftp
LibWeb
Lightspeedsystems
Likse
Linkdexbot
LinkpadBot
LinkScan
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
LNSpiderguy
Ltx71
lwp-request
LWP::Simple
Majestic SEO
Majestic-SEO
MarkMonitor
Masscan
Mata Hari
meanpathbot
MegaIndex.ru
Microsoft URL Control
MIDown tool
Mister PiX
Mojeek
Mojolicious
MSFrontPage
MSIECrawler
Msrabot
muhstik-scan
Musobot
Name Intelligence
Navroad
Needle
NetAnts
netEstate NE Crawler
NetSpider
Netvibes
Nikto
NimbleCrawler
Nimbostratus
oBot
Offline Explorer
OpenLinkProfiler
Openvas
PageAnalyzer
PageScorer
Papa Foto
Pavuk
PECL::HTTP
PeoplePal
PictureFinder
Pixray
PleaseCrawl
Pockey
POE-Component-Client-HTTP
ProPowerBot
ProWebWalker
Psbot
PyCurl
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot2
ReGet
RepoMonkey
SBIder
Scanbot
scan.lol
ScreenerBot
Searchestate
SemrushBot
Seomoz
SEOprofiler
sexsearcher
Siphon
SiteExplorer
Siteimprove
Sitevigil
SMTBot
Snake
Sociscraper
sogouspider
Sogou web spider
Sottopop
SpankBot
SputnikBot
spyfu
Sqlmap
Sqworm
SurveyBot
Suzuran
sysscan
T0PHackTeam
T8Abot
tAkeOut
Telesphorep
Titan
Toweyabot
trendiction.de
Turingos
Turnitin
TwengaBot
Twice
Typhoeus
URLy.Warning
Vacuum
VB Project
VCI
VidibleScraper
VoidEYE
Voltron
WallpapersHD
WASALive-Bot
Webalta
WebCopier
Web Enhancer
WebFetch
WebImageCollector
WebmasterWorldForumBot
WebPix
Web Pix
WebsiteExtractor
WebStripper
WebWhacker
WeSEE
Whacker
Who.is Bot
Woobot
Wotbox
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
xpymep1.exe
Zauba