360Spider
404checker
404enemy
80legs
Abonti
Aboundex
Aboundexbot
Acunetix
Alexibot
AlphaBot
archive.org_bot
ASPSeek
Attach
Backlink-Ceck
BackStreet
Bandit
BatchFTP
BBBike
BDCbot
BDFetch
Blackboard
BlackWidow
BLEXBot
Blow
BotALot
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
Calculon
CATExplorador
CazoodleBot
CCBot
CheeseBot
Cloud mapping
Collector
com.plumanalytics
Copier
Copyscape
crawl.sogou.com
CrazyWebCrawler
Crescent
Curious
Custo
DatabaseDriverMysqli
DBLBot
demandbase-bot
Demon
Deusu
Digincore
DIIbot
Discobot
Dispatch
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
Dragonfly
Ebingbong
ECCP/1.0
EMail Siphon
EroCrawler
Evil
ExtractorPro
Extreme Picture Finder
EyeNetIE
facebookscraper
FDM
Fimap
Firefox/7.0
FlashGet
Foobot
Freeuploader
FrontPage
Fyrebot
Getintent
Gigablast
G-i-g-a-b-o-t
Go!Zilla
Grabber
GrapeFX
GrapeshotCrawler
Harvest
Havij
HTMLparser
HTTP::Lite
HTTrack
Iblog
IDBot
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
InterGET
internetVista monitor
ips-agent
IRLbot
Iskanie
IstellaBot
JamesBOT
JikeSpider
Joomla
Jyxobot
Kenjin Spider
Lanshanbot
LexiBot
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinkScan
Lmspider
LNSpiderguy
Magnet
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
meanpathbot
Meanpathbot
Mediatoolkitbot
Metauri
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
Mojeek
Morfeus Fucking Scanner
Mr.4x3
MSFrontPage
Msrabot
muhstik-scan
Musobot
Nessus
NetAnts
netEstate NE Crawler
NetLyzer
NetSpider
Nettrack
Net Vampire
Niki-bot
NimbleCrawler
Nmap
NPbot
Nutch
oBot
Openfind
Openvas
OpenVAS
OrangeBot
OutclicksBot
Page Analyzer
page scorer
PageScorer
Papa Foto
Pavuk
PeoplePal
PHPCrawl
Pi-Monster
Pockey
POE-Component-Client-HTTP
Probethenet
ProPowerBot
Psbot
PxBroker
QueryN Metasearch
Quick-Crawler
RankurBot
Recorder
RepoMonkey
Ripper
Rogerbot
SalesIntelligent
SBIder
Scanbot
scan.lol
Searchestate
SemrushBot
SEOlyticsCrawler
SEOprofiler
seoscanners
SEOstats
SISTRIX
SiteExplorer
Siteimprove
SiteLockSpider
SiteSucker
SlySearch
Snapbot
SocialRankIOBot
Sociscraper
SpaceBison
Spinn3r
spyfu
Sqlworm
Stripper
SuperBot
Surfbot
SurveyBot
Swiftbot
sysscan
T8Abot
tAkeOut
Teleport
TeleportPro
Telesphorep
Thumbor
Titan
Toata
Toweyabot
trendiction.com
Turnitin
Twice
Typhoeus
Upflow
VB Project
VidibleScraper
VoidEYE
Voil
Voltron
WallpapersHD
Web Auto
WebBandit
Web Collage
WebEnhancer
Web Fetch
WebImageCollector
Web Pix
Webshag
WebStripper
WebWhacker
Whack
Widow
WISENutbot
Woobot
Wprecon
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
x09Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Zade
Zermelo
Zitebot
ZmEu