360Spider
404enemy
AIBOT
ALittle Client
ASPSeek
Aboundex
Aboundexbot
Acunetix
AhrefsBot
Alexibot
AlphaBot
Ankit
Attach
BBBike
BLEXBot
BackStreet
Badass
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
Black Hole
BlackWidow
Blackboard
Blow
BlowFish
Boardreader
Bolt
Brandprotect
Buddy
BuiltBotTough
BuiltWith
CATExplorador
CODE87
Calculon
CazoodleBot
Cegbfeieh
CheTeam
CherryPicker
ChinaClaw
Cloud mapping
Copyscape
CrunchBot
Custo
DBLBot
DSearch
Demon
Deusu
Devil
Digincore
Disco
Discoverybot
DittoSpyder
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
DomainStatsBot
Drip
ECCP/1.0
EasyDL
Ebingbong
Ecxi
EirGrabber
Evil
Extractor
EyeNetIE
FHscan
Foobot
FrontPage
FyberSpider
GT::WWW
GalaxyBot
Go!Zilla
Go-Ahead-Got-It
GoZilla
GrabNet
GridBot
HTTP::Lite
Havij
IDBTE4M
Image Sucker
Indy Library
InterGET
Iria
Iskanie
Jetty
JikeSpider
JustView
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
Lanshanbot
Larbin
LeechGet
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
LinkWalker
Linkdexbot
LinkextractorPro
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
MIIxpc
MJ12bot
MQQBrowser
MSIECrawler
Mag-Net
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader
Masscan
Mata Hari
Mediatoolkitbot
Mister PiX
Moblie Safari
Nameprotect
Needle
Nessus
Net Vampire
NetAnts
NetMechanic
Netcraft
Nettrack
NextGenSearchBot
Nibbler
Niki-bot
NimbleCrawler
Nutch
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
Openvas
OrangeBot
OrangeSpider
OutclicksBot
Panscient
Pi-Monster
Picscout
Pimonster
Pixray
Pu_iN
Pump
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
RankurBot
Reaper
Recorder
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOstats
SalesIntelligent
ScanAlert
Scrapy
ScreenerBot
Semrush
SentiBot
Seomoz
Siphon
SiteExplorer
SiteSucker
Siteimprove
Sitevigil
SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider
Sottopop
SpaceBison
Spbot
Sucker
Sucuri
Surfbot
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Teleport
TeleportPro
The Intraformant
Titan
Toweyabot
TwengaBot
Twice
URLy Warning
URLy.Warning
VelenPublicWebCrawler
VoidEYE
WASALive-Bot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Web Fetch
Web Fuck
Web Sucker
WebBandit
WebCopier
WebFetch
WebFuck
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebStripper
WebWhacker
Webalta
WebmasterWorldForumBot
Webster
Whack
Who.is Bot
Wotbox
Xaldon_WebSpider
Xenu
ZmEu
ZyBorg
backlink-check
clark-crawler
cognitiveseo
com.plumanalytics
crawler.feedback
domainsproject.org
evc-batch
heritrix
instabid
internetVista monitor
lwp-request
meanpathbot
netEstate NE Crawler
pcBrowser
s1z.ru
scalaj-http
seoscanners
serpstatbot
sysscan
trendiction.com
trendiction.de
ubermetrics-technologies.com
zauba.io