360Spider
80legs
ADmantX
ASPSeek
Aboundex
Acunetix
AhrefsBot
AllSubmitter
Anarchie
Anarchy
Apexoo
Attach
AwarioRssBot
AwarioSmartBot
BDCbot
BackStreet
BackWeb
Barkrowler
Bitacle
Black Hole
Boardreader
BotALot
Brandwatch
BuiltWith
BuzzSumo
CATExplorador
CODE87
CSHttp
CazoodleBot
CheTeam
CherryPicker
Citoid
Claritybot
Cloud mapping
Cogentbot
Collector
CopyRightCheck
Cosmos
Curious
DBLBot
DSearch
DTS Agent
DataCha0s
Devil
Digincore
DigitalPebble
Dirbuster
Disco
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
Domains Project
Dragonfly
EMail Siphon
Ecxi
Exabot
Extractor
ExtractorPro
Ezooms
Firefox/7.0
Freeuploader
GT::WWW
GetRight
GetWeb
Go!Zilla
Go-Ahead-Got-It
GoZilla
GrapeFX
HTTP::Lite
HTTrack
Haansoft
Harvest
Havij
Heritrix
Humanlinks
IDBot
Iblog
Id-search
InfoNaviRobot
IstellaBot
Jbrofuzz
JennyBot
Jetty
Joomla
Jyxobot
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
Leap
LeechGet
LibWeb
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
MFC_Tear_Sample
MIDown tool
MIIxpc
MSFrontPage
MSIECrawler
MTRobot
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader
Mata Hari
Mb2345Browser
MegaIndex.ru
Metauri
MicroMessenger
Mojeek
Mojolicious
Mozlila
NICErsPRO
NPbot
Navroad
NearSite
Needle
Nessus
Netcraft
NextGenSearchBot
Nikto
Ninja
Not
OpenLinkProfiler
Openfind
Openvas
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
Pandalytics
Pavuk
Petalbot
Pi-Monster
Piepmatz
ProWebWalker
Probethenet
Pu_iN
PxBroker
PyCurl
RankActiveLinkBot
RankingBot
RankurBot
RealDownload
Reaper
RebelMouse
RepoMonkey
RocketCrawler
SEOlyticsCrawler
SISTRIX
Scanbot
Scrapy
ScreenerBot
Searchestate
SearchmetricsBot
SemanticJuice
SentiBot
SeoSiteCheckup
Shodan
Site Sucker
SiteLockSpider
SiteSnagger
Siteimprove
SlySearch
Snake
Sociscraper
Sottopop
SputnikBot
Sqworm
Steeler
SuperBot
Swiftbot
Szukacz
Teleport
TeleportPro
Telesoft
Telesphorep
The Intraformant
Thumbor
Trendiction
Turingos
Turnitin
Twice
UnisterBot
V-BOT
VCI
Vagabondo
Virusdie
WPScan
WWW-Collector-E
WWW-Mechanize
Wallpapers
WallpapersHD
Web Collage
Web Fuck
WebAuto
WebBandit
WebCollage
WebCopier
WebFuck
WebImageCollector
WebLeacher
WebReaper
WebStripper
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteQuester
Whatweb
Woobot
Wprecon
Xenu
YoudaoBot
Zermelo
adscanner
arquivo-web-crawler
backlink-check
check1.exe
com.plumanalytics
crawler.feedback
crawler4j
domainsproject.org
eCatch
evc-batch
gopher
heritrix
internetVista monitor
isitwp.com
magpie-crawler
page scorer
plumanalytics
s1z.ru
seocompany.store
siteripz
sp_auditbot
trendiction.com
trendiction.de
webgains-bot
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io
zgrab