360Spider
404checker
80legs
Aipbot
Alexibot
Alligator
AllSubmitter
AlphaBot
archive.org_bot
arquivo.pt
arquivo-web-crawler
ASPSeek
autoemailspider
BackStreet
Badass
BBBike
BetaBot
Bitacle
BlackWidow
BlowFish
Boardreader
Buddy
BuiltBotTough
BuiltWith
CazoodleBot
CCBot
CherryPicker
Cloud mapping
coccocbot-web
Cogentbot
cognitiveseo
Copyscape
Cosmos
Craftbot
crawl.sogou.com
Crescent
CrunchBot
Curious
Custo
DBLBot
Devil
DIIbot
Dispatch
DomainStatsBot
Download Wonder
DSearch
EasyDL
Ebingbong
EirGrabber
EMail Siphon
evc-batch
Evil
Extractor
ExtractorPro
Ezooms
FDM
FemtosearchBot
FHscan
Firefox/7.0
Foobot
FrontPage
FyberSpider
Fyrebot
GermCrawler
GetRight
GetWeb
Gigablast
Gotit
Go!Zilla
Grabber
GrapeFX
GridBot
Haansoft
Harvest
HEADMasterSEO
heritrix
Heritrix
HMView
HTMLparser
HTTP::Lite
HTTrack
HybridBot
IDBot
IlseBot
Image Fetch
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Internet Ninja
internetVista monitor
ips-agent
Iria
Iskanie
IstellaBot
JamesBOT
JennyBot
JikeSpider
JOC Web Spider
Joomla
Jorgee
Jyxobot
Keyword Density
LeechGet
Lftp
Libwhisker
Likse
LinkpadBot
LinkWalker
LinqiaRSSBot
Lmspider
Ltx71
Mag-Net
Majestic12
Majestic SEO
MarkMonitor
MarkWatch
Masscan
MauiBot
Meanpathbot
MFC_Tear_Sample
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Msrabot
muhstik-scan
Needle
NetLyzer
NetSpider
Net Vampire
NetZIP
NextGenSearchBot
NimbleCrawler
Nimbostratus
NPbot
oBot
Offline Explorer
Openfind
OpenLinkProfiler
OpenVAS
OrangeSpider
PageAnalyzer
Page Analyzer
Pandalytics
PECL::HTTP
PictureFinder
Pimonster
Pi-Monster
Pixray
plumanalytics
Probethenet
ProPowerBot
ProWebWalker
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
RankurBot
RealDownload
Recorder
ReGet
RepoMonkey
RocketCrawler
Rogerbot
ScanAlert
Scanbot
Screaming
SEOlyticsCrawler
Seomoz
seoscanners
serpstatbot
sexsearcher
SISTRIX
SiteExplorer
Siteimprove
SMTBot
Snake
Sogou web spider
SpaceBison
SpankBot
Spbot
spyfu
Sqlmap
Sqworm
Steeler
Sucker
Sucuri
SuperBot
SuperHTTP
Suzuran
sysscan
Thumbor
Titan
Trendiction
Trendictionbot
trendiction.de
Turingos
Turnitin
TurnitinBot
TwengaBot
Typhoeus
URLy.Warning
Vacuum
Vagabondo
VB Project
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
Voltron
Webalta
WebCollage
Web Collage
WebCopier
WebFuck
WebGo IS
WebImageCollector
Web Pix
WebSauger
WebsiteExtractor
Webster
WebWhacker
WebZIP
Whack
Whacker
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
WISENutbot
Wonderbot
Woobot
Wotbox
WPScan
WWW-Mechanize
WWW::Mechanize
x09Mozilla
Xaldon_WebSpider
Xenu
YoudaoBot
Zauba
Zeus
Zitebot
ZyBorg