360Spider
404checker
80legs
AIBOT
ALittle Client
ASPSeek
Abonti
Aboundexbot
AlphaBot
Ankit
Asterias
Attach
BLEXBot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Battleztar Bazinga
Bigfoot
Black Hole
BlowFish
Bolt
Brandprotect
Brandwatch
Buck
Bullseye
CATExplorador
CCBot
Calculon
Cegbfeieh
ChinaClaw
Cocolyzebot
Cogentbot
CopyRightCheck
Cosmos
Crescent
Curious
Custo
CyotekWebCopy
DBLBot
DTS Agent
DataCha0s
DigitalPebble
Disco
Discobot
Discoverybot
DnyzBot
DomCopBot
DomainCrawler
Dragonfly
ECCP/1.0
EMail Wolf
EasyDL
EirGrabber
EroCrawler
Evil
Express WebPictures
ExtLinksBot
EyeNetIE
FHscan
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
Foobot
Freeuploader
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GermCrawler
Gigabot
Go!Zilla
Go-Ahead-Got-It
GoZilla
Grabber
GrapeFX
GridBot
HTTP::Lite
Haansoft
Hloader
Humanlinks
Iblog
Id-search
IlseBot
Indy Library
Intelliseek
InterGET
Internet Ninja
JennyBot
Joomla
Kenjin Spider
LNSpiderguy
LWP::Simple
Larbin
Leap
LeechFTP
LeechGet
Lftp
LibWeb
Libwhisker
LinkextractorPro
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
MIDown tool
Magnet
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Masscan
Mata Hari
MauiBot
Mediatoolkitbot
MegaIndex.ru
Mojolicious
Mozlila
Mr.4x3
Musobot
NPbot
Needle
NetSpider
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nikto
Offline Explorer
OnCrawl
OpenVAS
Openfind
OutfoxBot
POE-Component-Client-HTTP
Papa Foto
Pavuk
Petalbot
Picscout
Picsearch
Piepmatz
Pixray
Pockey
ProPowerBot
RankActiveLinkBot
RankFlex
RankurBot
Re-re
ReGet
Recorder
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SEOkicks
SEOstats
SalesIntelligent
Scrapy
ScreenerBot
ScrepyBot
Semrush
SemrushBot
Seomoz
Shodan
SiteLockSpider
SiteSucker
Sitebeam
Sitevigil
SlySearch
SocialRankIOBot
Sociscraper
Spinn3r
Sqlmap
Sqlworm
Steeler
SurveyBot
T8Abot
Telesoft
Telesphoreo
The Intraformant
Toata
Trendiction
Turingos
URLy Warning
VelenPublicWebCrawler
Virusdie
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Auto
Web Fuck
Web Sauger
WebCollage
WebCopier
WebEnhancer
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebReaper
WebSauger
WebStripper
WebmasterWorldForumBot
WebsiteQuester
Whatweb
Widow
WinHTTrack
WiseGuys Robot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zade
Zauba
Zeus
ZoomBot
coccocbot-web
com.plumanalytics
domainsproject.org
eCatch
facebookscraper
heritrix
instabid
internetVista monitor
magpie-crawler
meanpathbot
netEstate NE Crawler
oBot
pcBrowser
polaris version
scalaj-http
sitechecker.pro
sogouspider
spyfu
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
x22Mozilla
zgrab