404enemy
Acunetix
AhrefsBot
Alexibot
Anarchie
Apexoo
Asterias
Attach
BackDoorBot
Backlink-Ceck
BackWeb
Badass
Barkrowler
BatchFTP
Battleztar Bazinga
BBBike
BDCbot
BDFetch
Bigfoot
Bitacle
BlackWidow
BlowFish
Brandwatch
BuiltBotTough
Calculon
CCBot
Cegbfeieh
CheeseBot
CherryPicker
Chlooe
Cliqzbot
Cogentbot
cognitiveseo
Collector
com.plumanalytics
Copier
Copyscape
Cosmos
Craftbot
crawler4j
crawl.sogou.com
CrunchBot
CSHttp
Curious
DBLBot
Dirbuster
Discoverybot
Dispatch
DnyzBot
DomainAppender
DomainCrawler
DomainStatsBot
DTS Agent
EasyDL
Ebingbong
eCatch
EMail Wolf
EroCrawler
Evil
Exabot
Express WebPictures
Ezooms
facebookscraper
FHscan
Firefox/7.0
FrontPage
Genieo
GermCrawler
Gigablast
G-i-g-a-b-o-t
Gotit
GrabNet
Grafula
GridBot
Harvest
HEADMasterSEO
HMView
HTMLparser
Humanlinks
InfoTekies
instabid
Intelliseek
InterGET
Internet Ninja
internetVista monitor
Iskanie
IstellaBot
JennyBot
JikeSpider
Jorgee
JustView
Kenjin Spider
Keyword Density
Kozmosbot
Larbin
Likse
LinksManager
LinkWalker
LinqiaRSSBot
LinqiaScrapeBot
Lmspider
LNSpiderguy
Ltx71
Mag-Net
Majestic12
Majestic-SEO
Masscan
Mass Downloader
Mata Hari
MauiBot
Meanpathbot
mediawords
MegaIndex.ru
MIDown tool
MIIxpc
Mister PiX
Morfeus Fucking Scanner
MSIECrawler
MS Web Services Client Protocol
Musobot
NearSite
Needle
NetAnts
Netcraft
netEstate NE Crawler
NetMechanic
NetSpider
Nettrack
Netvibes
NetZIP
NextGenSearchBot
NICErsPRO
Nikto
NimbleCrawler
Ninja
NPbot
Nutch
Octopus
Openfind
OrangeSpider
PageAnalyzer
PageGrabber
page scorer
Papa Foto
Pavuk
pcBrowser
PHPCrawl
PictureFinder
Pi-Monster
plumanalytics
Pockey
Probethenet
ProPowerBot
Pump
PxBroker
PyCurl
RankActive
RankActiveLinkBot
RankingBot2
RebelMouse
Recorder
RedesScrapy
ReGet
RocketCrawler
SBIder
scan.lol
ScoutJet
Scrapy
SearchmetricsBot
Semrush
SemrushBot
SEOlyticsCrawler
SEOprofiler
seoscanners
SeoSiteCheckup
serpstatbot
Shodan
SiteLockSpider
SiteSnagger
SiteSucker
Site Sucker
SMTBot
Snapbot
SocialRankIOBot
sogouspider
SpaceBison
Spinn3r
Sqlmap
Stripper
Sucuri
SuperBot
SuperHTTP
sysscan
Telesoft
TheNomad
Thumbor
Toweyabot
Tracemyfile
Trendictionbot
trendiction.com
Turingos
Turnitin
TwengaBot
Twice
UnisterBot
Upflow
Vacuum
Vagabondo
VCI
VeriCiteCrawler
Virusdie
Voil
WASALive-Bot
WebBandit
WebCollage
WEBDAV
WebEnhancer
Web Fetch
Web Fuck
WebGo IS
WebImageCollector
WebLeacher
webmeup-crawler
Web Pix
WebReaper
WebsiteQuester
Website Quester
WebSucker
WebZIP
Whack
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wprecon
WWW::Mechanize
x22Mozilla
Xaldon_WebSpider
YoudaoBot
Zade
Zauba
zauba.io
Zeus
zgrab
Zitebot
ZmEu
ZumBot