360Spider
404enemy
Aboundexbot
ADmantX
AhrefsBot
AllSubmitter
Attach
autoemailspider
BackStreet
BackWeb
Badass
Barkrowler
BatchFTP
BBBike
BDCbot
BDFetch
BetaBot
BLEXBot
Boardreader
BotALot
Brandprotect
Buddy
BuiltBotTough
CCBot
Cegbfeieh
CheTeam
ChinaClaw
Chlooe
coccocbot-web
Cogentbot
com.plumanalytics
CopyRightCheck
Cosmos
crawl.sogou.com
Crescent
CrunchBot
CSHttp
DBLBot
Demon
Dirbuster
Dispatch
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Dragonfly
Drip
DSearch
EasyDL
Ebingbong
EMail Wolf
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
facebookscraper
FDM
FemtosearchBot
Fimap
Firefox/7.0
Freeuploader
FyberSpider
Getintent
GetRight
GetWeb
Gotit
GoZilla
GrapeFX
GridBot
GT::WWW
HaosouSpider
HEADMasterSEO
HTMLparser
Humanlinks
HybridBot
IDBot
Id-search
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
Intelliseek
internetVista monitor
ips-agent
Iria
IRLbot
IstellaBot
Jbrofuzz
JennyBot
JOC Web Spider
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Kozmosbot
Lanshanbot
Lftp
Libwhisker
Linkdexbot
LinksManager
LinkWalker
Lipperhey
LWP::Simple
Magnet
Mag-Net
Majestic SEO
MarkMonitor
Masscan
Mass Downloader
MauiBot
meanpathbot
Meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru
Microsoft URL Control
MIDown tool
Mister PiX
MJ12bot
Morfeus Fucking Scanner
Msrabot
Musobot
Name Intelligence
Nameprotect
NearSite
NetLyzer
NetSpider
Nettrack
Nibbler
NICErsPRO
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Ninja
NPbot
oBot
Offline Explorer
Openfind
OpenLinkProfiler
OrangeBot
OrangeSpider
OutfoxBot
page scorer
Panscient
Papa Foto
pcBrowser
PECL::HTTP
Picscout
Picsearch
PictureFinder
Pimonster
Pi-Monster
plumanalytics
Probethenet
ProPowerBot
ProWebWalker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
RealDownload
Recorder
RepoMonkey
s1z.ru
SalesIntelligent
SBIder
ScoutJet
Screaming
ScreenerBot
SemrushBot
Seomoz
SEOprofiler
SeoSiteCheckup
Shodan
SiteExplorer
Siteimprove
SlySearch
SMTBot
Sociscraper
Sogou web spider
Sottopop
SpankBot
Spanner
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Stripper
SuperHTTP
Swiftbot
T8Abot
Teleport
TeleportPro
The Intraformant
TheNomad
Titan
Trendiction
Trendictionbot
Turnitin
Twice
Upflow
URLy Warning
URLy.Warning
Vacuum
VCI
VidibleScraper
Virusdie
Voil
Webalta
Web Auto
WEBDAV
WebEnhancer
WebFetch
WebFuck
Web Fuck
WebImageCollector
WebLeacher
webmeup-crawler
WebSauger
Webshag
WebsiteExtractor
Website Quester
Webster
WebStripper
WebZIP
WeSEE
Whacker
WiseGuys Robot
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
x09Mozilla
Xenu
Zauba
zauba.io
Zermelo
Zitebot
ZmEu
ZumBot
ZyBorg