360Spider
404checker
80legs
Abonti
Aboundexbot
ADmantX
Anarchie
ASPSeek
Attach
backlink-check
BackStreet
Badass
Bandit
Barkrowler
BBBike
BDCbot
BDFetch
Bigfoot
Bitacle
Black Hole
BlackWidow
BLEXBot
BlowFish
Boardreader
BotALot
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
Calculon
Claritybot
Cliqzbot
Cloud mapping
cognitiveseo
com.plumanalytics
Copyscape
crawler.feedback
Crescent
CSHttp
Curious
DataCha0s
DBLBot
demandbase-bot
Digincore
Disco
Discobot
Discoverybot
DomainCrawler
Dotbot
Dragonfly
EasyDL
eCatch
ECCP/1.0
Ecxi
EMail Siphon
Evil
ExtLinksBot
Extractor
FemtosearchBot
FHscan
Fimap
Firefox/7.0
Flunky
Foobot
FyberSpider
Fyrebot
GalaxyBot
GermCrawler
Getintent
GetWeb
GoZilla
Go!Zilla
Grabber
GrapeFX
HaosouSpider
Harvest
Havij
Hloader
HMView
HTMLparser
Humanlinks
IlseBot
Image Sucker
IndeedBot
Indy Library
InfoTekies
InterGET
internetVista monitor
ips-agent
IRLbot
Iskanie
JamesBOT
JennyBot
JetCar
Jetty
JOC Web Spider
JustView
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
Lightspeedsystems
LinkWalker
Lipperhey Spider
Litemage_walker
LNSpiderguy
Magnet
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic SEO
MarkMonitor
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
MFC_Tear_Sample
MIIxpc
Mr.4x3
MSIECrawler
Musobot
Name Intelligence
Navroad
Nessus
NetAnts
Netcraft
NetLyzer
NetMechanic
Nettrack
NextGenSearchBot
Nikto
NimbleCrawler
Nimbostratus
Nmap
oBot
Openvas
OpenVAS
OrangeBot
OutclicksBot
Page Analyzer
page scorer
Pandalytics
Papa Foto
Picscout
Picsearch
PictureFinder
plumanalytics
POE-Component-Client-HTTP
Probethenet
ProWebWalker
Quick-Crawler
RankActiveLinkBot
RankingBot2
Rankivabot
RankurBot
RealDownload
ReGet
RepoMonkey
SalesIntelligent
Scanbot
scan.lol
ScoutJet
Scrapy
Searchestate
Seomoz
SeoSiteCheckup
serpstatbot
sexsearcher
Shodan
Siphon
Sitebeam
SiteLockSpider
SiteSucker
Sitevigil
SlySearch
SMTBot
SocialRankIOBot
sogouspider
Sogou web spider
Sottopop
SpaceBison
SpankBot
sp_auditbot
Spbot
SputnikBot
Sqlworm
Sqworm
Stripper
SuperHTTP
SurveyBot
Suzuran
T0PHackTeam
T8Abot
Teleport
Telesphoreo
Telesphorep
The Intraformant
Thumbor
Titan
Toata
Toweyabot
Tracemyfile
TurnitinBot
Twice
Typhoeus
URLy Warning
Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
Voltron
WallpapersHD
WebAuto
WebCollage
WebFetch
Web Fetch
WebFuck
WebGo IS
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
Web Pix
WebSauger
Web Sauger
Webshag
Website Quester
WebStripper
WebSucker
Web Sucker
WebWhacker
Whack
Widow
WinHTTrack
WiseGuys Robot
Wprecon
WPScan
WWW-Collector-E
x22Mozilla
Xenu
YoudaoBot
Zade
Zeus
zgrab
ZyBorg