360Spider
404checker
80legs
ADmantX
AIBOT
ASPSeek
Aboundex
Acunetix
AiHitBot
Aipbot
Anarchie
Attach
AwarioSmartBot
BackWeb
BacklinkCrawler
Badass
Bandit
Battleztar Bazinga
BetaBot
Bigfoot
Blow
Brandprotect
Brandwatch
Buck
BuzzSumo
CCBot
CODE87
CensysInspect
CheTeam
CherryPicker
Chlooe
Claritybot
Cliqzbot
Copier
CopyRightCheck
Copyscape
Crawling at Home Project
CrunchBot
DBLBot
Demon
Devil
Discoverybot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
EirGrabber
FDM
FHscan
Firefox/7.0
Flunky
FrontPage
Fyrebot
GermCrawler
GetWeb
Getintent
GoZilla
Grafula
HEADMasterSEO
HMView
HTMLparser
Haansoft
Heritrix
Hloader
Humanlinks
HybridBot
IDBot
Image Fetch
Image Sucker
InfoNaviRobot
InfoTekies
InterGET
Internet Ninja
Iria
Iskanie
JOC Web Spider
JamesBOT
Jetty
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LNSpiderguy
Lanshanbot
Larbin
LeechGet
LibWeb
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkWalker
LinksManager
Lipperhey Spider
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
Mag-Net
Magnet
MarkMonitor
Mass Downloader
MeanPath Bot
Meanpathbot
Metauri
MicroMessenger
Mister PiX
Mojolicious
Mr.4x3
NICErsPRO
NPbot
Name Intelligence
Nameprotect
Navroad
Needle
NetMechanic
Netcraft
Nettrack
Ninja
Nmap
OnCrawl
OpenLinkProfiler
OrangeBot
OutclicksBot
PECL::HTTP
PageGrabber
PageScorer
PeoplePal
Piepmatz
Pimonster
PleaseCrawl
ProPowerBot
ProWebWalker
PxBroker
RankActive
RankingBot
Re-re
ReGet
RebelMouse
Recorder
Ripper
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SalesIntelligent
Scanbot
ScoutJet
Screaming
SentiBot
SeoSiteCheckup
Seomoz
Siphon
Siteimprove
SlySearch
SmartDownload
Snake
Snoopy
Sosospider
Sottopop
Spammen
Spanner
Sqlworm
Sqworm
Sucuri
SuperBot
Surfbot
Swiftbot
T8Abot
Teleport
TeleportPro
Telesoft
Telesphoreo
Thumbor
TightTwatBot
Titan
Toweyabot
Tracemyfile
Turingos
Turnitin
TurnitinBot
UnisterBot
VB Project
VCI
Vagabondo
Voil
Voltron
WASALive-Bot
WBSearchBot
WPScan
WWW-Mechanize
Wallpapers
Wallpapers/3.0
Web Sauger
WebAuto
WebBandit
WebCopier
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebReaper
WebSauger
WebSucker
Webshag
WebsiteExtractor
Webster
Whacker
Widow
WiseGuys Robot
Xenu
Zade
Zermelo
ZoomBot
archive.org_bot
arquivo-web-crawler
cah.io.community
com.plumanalytics
crawl.sogou.com
crawler4j
domainsproject.org
gopher
heritrix
instabid
internetVista monitor
ips-agent
mediawords
netEstate NE Crawler
plumanalytics
ripz
satoristudio.net
scalaj-http
seobility
seoscanners
seostar
siteripz
sysscan
trendiction.com
trendiction.de
zauba.io