404checker
80legs
Aboundex
Aboundexbot
ADmantX
Alexibot
Alligator
AlphaBot
Asterias
autoemailspider
Backlink-Ceck
BacklinkCrawler
BackStreet
BackWeb
BatchFTP
BDCbot
BetaBot
Bigfoot
Blow
Boardreader
Bolt
BotALot
Buddy
Bullseye
CazoodleBot
Cegbfeieh
ChinaClaw
Chlooe
Cloud mapping
coccocbot-web
Cogentbot
Copier
Craftbot
CrazyWebCrawler
Crescent
CSHttp
Curious
DatabaseDriverMysqli
DataCha0s
DBLBot
demandbase-bot
Deusu
Devil
Digincore
DigitalPebble
DIIbot
Disco
DittoSpyder
DomainAppender
DomainSigmaCrawler
Dotbot
Dragonfly
DSearch
DTS Agent
EMail Wolf
evc-batch
Exabot
ExtLinksBot
Extractor
Extreme Picture Finder
Ezooms
facebookscraper
FDM
FlashGet
Flunky
Foobot
Freeuploader
FrontPage
FyberSpider
GalaxyBot
Genieo
GetWeb
Gigablast
Gotit
Go!Zilla
GrabNet
GrapeFX
GrapeshotCrawler
GridBot
GT::WWW
HMView
HTMLparser
HTTP::Lite
HybridBot
Iblog
IDBot
IndeedBot
Intelliseek
InterGET
Internet Ninja
internetVista monitor
Iria
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JetCar
JikeSpider
JOC Web Spider
JustView
Kenjin Spider
Kozmosbot
LeechGet
LexiBot
LibWeb
Libwhisker
Linkdexbot
LinkextractorPro
LinkScan
Lipperhey
LNSpiderguy
LWP::Simple
lwp-trivial
Magnet
Mag-Net
magpie-crawler
MarkMonitor
MarkWatch
Mass Downloader
meanpathbot
Mediatoolkitbot
mediawords
Metauri
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MJ12bot
MSIECrawler
MS Web Services Client Protocol
Name Intelligence
Nameprotect
NearSite
Needle
Nessus
NetLyzer
NetMechanic
Net Vampire
NetZIP
Nibbler
Nikto
NimbleCrawler
Ninja
Nmap
NPbot
Nutch
Octopus
OpenLinkProfiler
Openvas
OrangeBot
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
page scorer
PageScorer
Pandalytics
Papa Foto
pcBrowser
PHPCrawl
Pi-Monster
Pixray
Pockey
POE-Component-Client-HTTP
ProPowerBot
ProWebWalker
Pump
PyCurl
Quick-Crawler
RankurBot
RealDownload
Recorder
ReGet
RepoMonkey
Ripper
RocketCrawler
Scanbot
Scrapy
Screaming
SearchmetricsBot
SemrushBot
SEOlyticsCrawler
Seomoz
SEOprofiler
SeoSiteCheckup
Siphon
SISTRIX
Sitebeam
SiteExplorer
Site Sucker
SlySearch
SmartDownload
Snake
Sociscraper
sogouspider
SpankBot
sp_auditbot
Sqlworm
Stripper
SuperBot
Surfbot
Swiftbot
T0PHackTeam
tAkeOut
Telesphoreo
Telesphorep
The Intraformant
Thumbor
Toata
Toweyabot
Trendictionbot
trendiction.com
trendiction.de
True_Robot
URLy Warning
Vacuum
Vagabondo
VB Project
VCI
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
WASALive-Bot
WebAuto
WebBandit
WebCollage
WebCopier
WEBDAV
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebmasterWorldForumBot
Web Pix
WebReaper
WebSauger
Web Sauger
WebsiteQuester
Webster
Widow
WinHTTrack
WISENutbot
WWW::Mechanize
WWWOFFLE
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zade
Zauba
ZumBot