360Spider
80legs
Aboundex
Aboundexbot
AiHitBot
Alexibot
Anarchie
archive.org_bot
arquivo.pt
arquivo-web-crawler
Attach
autoemailspider
AwarioRssBot
Backlink-Ceck
Badass
BBBike
Bigfoot
Black Hole
BlackWidow
BotALot
Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
Bullseye
CATExplorador
Chlooe
Cliqzbot
Cloud mapping
coccocbot-web
cognitiveseo
Copier
CopyRightCheck
Copyscape
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CSHttp
Curious
Custo
DBLBot
Devil
DigitalPebble
DIIbot
Dirbuster
Discoverybot
DnyzBot
DomainAppender
DomainStatsBot
Dotbot
DTS Agent
EasyDL
Ebingbong
ECCP/1.0
EMail Siphon
EMail Wolf
EroCrawler
evc-batch
Evil
Exabot
Express WebPictures
ExtLinksBot
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FDM
FemtosearchBot
FlashGet
Flunky
Foobot
Freeuploader
FyberSpider
Fyrebot
GetRight
Gigabot
G-i-g-a-b-o-t
Go-Ahead-Got-It
Grabber
Grafula
GrapeFX
GridBot
Haansoft
heritrix
HMView
HTMLparser
HTTP::Lite
Humanlinks
HybridBot
IDBot
Image Fetch
Image Sucker
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
internetVista monitor
ips-agent
IstellaBot
JetCar
Jetty
Joomla
Kenjin Spider
Kozmosbot
Lanshanbot
Larbin
LeechFTP
Likse
Linkdexbot
LinkextractorPro
LinkWalker
Lipperhey
LNSpiderguy
lwp-request
Magnet
magpie-crawler
Majestic12
Majestic SEO
MauiBot
MeanPath Bot
mediawords
MegaIndex.ru
Metauri
MFC_Tear_Sample
Microsoft Data Access
MIDown tool
MJ12bot
Morfeus Fucking Scanner
MSFrontPage
MSIECrawler
Msrabot
muhstik-scan
Nessus
Netcraft
NetMechanic
NetSpider
Net Vampire
Nikto
Nimbostratus
NPbot
Octopus
Openfind
OpenLinkProfiler
OrangeSpider
OutclicksBot
OutfoxBot
Page Analyzer
page scorer
Papa Foto
Pavuk
PECL::HTTP
PHPCrawl
Picsearch
PictureFinder
Pi-Monster
plumanalytics
Pockey
Probethenet
ProWebWalker
Pump
PyCurl
RankActiveLinkBot
RankingBot2
Rankivabot
RankurBot
Reaper
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SBIder
ScoutJet
Scrapy
ScreenerBot
Semrush
SEOkicks
SEOlyticsCrawler
Seomoz
seoscanners
SISTRIX
Sitebeam
SiteLockSpider
SiteSnagger
Sitevigil
Snake
SpaceBison
sp_auditbot
Sqlmap
Sqworm
Steeler
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
SurveyBot
Swiftbot
sysscan
Telesphoreo
TheNomad
TightTwatBot
Titan
Toata
True_Robot
Typhoeus
UnisterBot
URLy.Warning
Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
Voltron
Wallpapers/3.0
WASALive-Bot
Web Auto
WebCollage
WEBDAV
WebFetch
WebGo IS
WebPix
Web Pix
WebReaper
WebSauger
Web Sauger
Webshag
Website Quester
Webster
WebStripper
WebWhacker
WeSEE
Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
WISENutbot
Wotbox
Wprecon
WPScan
WWW-Collector-E
WWW::Mechanize
x09Mozilla
YoudaoBot
Zauba
Zitebot
ZumBot
ZyBorg