360Spider
404checker
ADmantX
AIBOT
ALittle Client
Aboundex
Acunetix
AhrefsBot
AiHitBot
AllSubmitter
Anarchy99
AwarioRssBot
AwarioSmartBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Battleztar Bazinga
Bigfoot
Bitacle
Blackboard
Blow
Boardreader
Brandwatch
Buck
CATExplorador
CCBot
CSHttp
Cegbfeieh
ChinaClaw
Chlooe
Citoid
Claritybot
Cliqzbot
Cogentbot
Copier
CrazyWebCrawler
CrunchBot
Curious
DataCha0s
Demon
Devil
Dirbuster
Disco
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainSigmaCrawler
Domains Project
Dotbot
EMail Wolf
EasyDL
Ebingbong
Ecxi
EirGrabber
EroCrawler
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
Ezooms
FDM
FHscan
FemtosearchBot
Fimap
FlashGet
G-i-g-a-b-o-t
GT::WWW
Getintent
Grabber
GrapeFX
HaosouSpider
Harvest
Havij
Heritrix
Hloader
HybridBot
IDBTE4M
IDBot
Image Fetch
IndeedBot
InfoNaviRobot
InfoTekies
InterGET
Iria
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JetCar
JikeSpider
Joomla
Jorgee
Keyword Density
Kinza
LNSpiderguy
Lanshanbot
Larbin
LeechFTP
LeechGet
Libwhisker
Linkdexbot
LinkextractorPro
LinqiaScrapeBot
Ltx71
MIDown tool
MQQBrowser
Mag-Net
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Mb2345Browser
Meanpathbot
Mojolicious
NICErsPRO
Navroad
Nessus
NetSpider
NetZIP
Netcraft
Netvibes
Nikto
Nutch
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
OpenVAS
Openfind
OrangeSpider
PHPCrawl
PageAnalyzer
PageScorer
Panscient
Pavuk
Petalbot
Picscout
PictureFinder
Piepmatz
ProPowerBot
ProWebWalker
Psbot
PyCurl
Quick-Crawler
RSSingBot
RankActive
RankFlex
RankingBot
Rankivabot
Reaper
Recorder
RepoMonkey
SEOkicks
SISTRIX
SalesIntelligent
Scrapy
SearchmetricsBot
Seomoz
Shodan
Site Sucker
SiteExplorer
SiteSucker
Sitevigil
Snoopy
Sosospider
Spinn3r
Sqlmap
Sucuri
SuperBot
SuperHTTP
SurveyBot
Suzuran
TeleportPro
Telesphorep
Thumbor
Titan
Toata
Toweyabot
Trendiction
Turingos
URLy Warning
URLy.Warning
Upflow
VB Project
Vacuum
VeriCiteCrawler
VidibleScraper
Voil
WEBDAV
WPScan
WWW::Mechanize
WallpapersHD
WeSEE
Web Auto
Web Fuck
Web Sauger
WebAuto
WebBandit
WebCollage
WebCopier
WebEnhancer
WebFetch
WebLeacher
WebPix
WebReaper
WebStripper
WebSucker
WebWhacker
WebZIP
Webshag
Webster
Whatweb
Wotbox
Xenu
Zermelo
ZumBot
ZyBorg
adscanner
archive.org_bot
arquivo-web-crawler
crawler.feedback
crawler4j
demandbase-bot
domainsproject.org
evc-batch
facebookscraper
instabid
internetVista monitor
ips-agent
lwp-request
meanpathbot
netEstate NE Crawler
oBot
plumanalytics
seocompany.store
seoscanners
siteripz
spyfu
tAkeOut
trendiction.de
ubermetrics-technologies.com
x09Mozilla
zauba.io
zgrab