nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-07-30 12:55:40 +02:00

250 lines
2.6 KiB
Text

360Spider
Abonti
Aboundexbot
AiHitBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anarchie
Apexoo
Asterias
autoemailspider
BackDoorBot
BackStreet
Bandit
Barkrowler
BDCbot
Bigfoot
BlackWidow
Blow
Boardreader
Brandprotect
Brandwatch
Buddy
Bullseye
BunnySlippers
CheeseBot
Cliqzbot
Collector
Copier
Copyscape
CrazyWebCrawler
Curious
DatabaseDriverMysqli
demandbase-bot
Deusu
Devil
Dirbuster
Disco
DomainCrawler
Dotbot
EasyDL
EMail Siphon
EroCrawler
Evil
Express WebPictures
Extreme Picture Finder
EyeNetIE
facebookscraper
FDM
Flunky
GalaxyBot
GermCrawler
Getintent
GetRight
GetWeb
GoZilla
Grafula
GrapeFX
GT::WWW
Haansoft
HaosouSpider
Hloader
HMView
HTMLparser
HybridBot
Iblog
IDBot
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
Internet Ninja
Iria
Iskanie
JamesBOT
Jbrofuzz
JetCar
JikeSpider
JOC Web Spider
JustView
Keyword Density
Kozmosbot
Lanshanbot
Lftp
LibWeb
Libwhisker
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Ltx71
Magnet
Mag-Net
Mail.RU_Bot
Majestic12
Majestic SEO
Mass Downloader
MauiBot
Meanpathbot
MeanPath Bot
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
MIDown tool
MSFrontPage
MS Web Services Client Protocol
Name Intelligence
Nameprotect
Nessus
NetAnts
NetLyzer
NetMechanic
Nettrack
Netvibes
NetZIP
Niki-bot
NimbleCrawler
NPbot
Nutch
Offline Navigator
Openvas
OpenVAS
OutclicksBot
OutfoxBot
PageAnalyzer
Page Analyzer
PageGrabber
Pandalytics
Panscient
pcBrowser
PECL::HTTP
PleaseCrawl
plumanalytics
Pockey
ProPowerBot
ProWebWalker
Pump
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
Reaper
Recorder
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SBIder
Scanbot
ScoutJet
Scrapy
Searchestate
SemrushBot
SEOkicks
SEOkicks-Robot
SEOprofiler
SeoSiteCheckup
sexsearcher
Siphon
SISTRIX
Sitebeam
Siteimprove
SiteLockSpider
Site Sucker
Sitevigil
SlySearch
SMTBot
Snake
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
Sottopop
SpaceBison
Spammen
SpankBot
Spanner
Spinn3r
spyfu
Sqlworm
Sqworm
Stripper
SurveyBot
Suzuran
Swiftbot
sysscan
T8Abot
Teleport
Telesoft
Telesphorep
Toweyabot
trendiction.com
trendiction.de
Turingos
TurnitinBot
TwengaBot
Upflow
URLy Warning
URLy.Warning
Vacuum
VCI
VeriCiteCrawler
VidibleScraper
Virusdie
Wallpapers/3.0
WASALive-Bot
Webalta
WebBandit
Web Collage
WebCopier
WebEnhancer
WebFetch
Web Fetch
Web Fuck
WebGo IS
webmeup-crawler
Web Pix
WebReaper
WebSauger
WebsiteExtractor
WebsiteQuester
Website Quester
Webster
WebStripper
WebWhacker
Whack
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Wprecon
WWW-Collector-E
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zeus
ZmEu
ZyBorg