360Spider
80legs
Acunetix
ADmantX
AhrefsBot
AIBOT
Alligator
ASPSeek
Backlink-Ceck
backlink-check
Bandit
BatchFTP
BBBike
BDCbot
BetaBot
Bigfoot
BlackWidow
Blow
BlowFish
Boardreader
BotALot
BunnySlippers
CazoodleBot
CCBot
CherryPicker
CheTeam
Cliqzbot
Cloud mapping
Cogentbot
com.plumanalytics
Copyscape
Cosmos
Craftbot
crawl.sogou.com
CrazyWebCrawler
Crescent
CrunchBot
Deusu
Devil
DigitalPebble
Dirbuster
Disco
Discobot
Dispatch
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
Dragonfly
DTS Agent
EasyDL
Ecxi
Evil
ExtLinksBot
Extreme Picture Finder
EyeNetIE
FDM
FHscan
Firefox/7.0
Flunky
FrontPage
Genieo
Getintent
GetRight
Go-Ahead-Got-It
GoZilla
Go!Zilla
Grabber
GrapeshotCrawler
GridBot
Havij
HMView
HTMLparser
HTTP::Lite
Iblog
IDBot
Id-search
IlseBot
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
instabid
Intelliseek
InterGET
Internet Ninja
InternetSeer
Iria
IRLbot
Iskanie
IstellaBot
JamesBOT
JennyBot
Jetty
JOC Web Spider
Joomla
Kenjin Spider
Lanshanbot
Larbin
Lftp
LibWeb
Lightspeedsystems
LinkextractorPro
LinkWalker
Litemage_walker
lwp-request
LWP::Simple
Magnet
Mail.RU_Bot
Majestic12
MarkMonitor
Mata Hari
meanpathbot
Meanpathbot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MIDown tool
MIIxpc
Mister PiX
MJ12bot
MSFrontPage
Musobot
Nameprotect
Nessus
NetLyzer
NetMechanic
Nettrack
Netvibes
NICErsPRO
Niki-bot
Nikto
NimbleCrawler
NPbot
Nutch
oBot
Offline Navigator
OnCrawl
OpenLinkProfiler
Openvas
OrangeSpider
OutclicksBot
PageAnalyzer
Page Analyzer
PageGrabber
page scorer
Panscient
PECL::HTTP
Picscout
Picsearch
Pimonster
Pixray
POE-Component-Client-HTTP
ProPowerBot
Pump
PxBroker
PyCurl
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
Recorder
RedesScrapy
Ripper
SalesIntelligent
SBIder
ScoutJet
Screaming
Semrush
SemrushBot
SEOlyticsCrawler
SEOstats
serpstatbot
Shodan
Siphon
SISTRIX
Siteimprove
SiteSucker
Snake
Snoopy
SocialRankIOBot
sogouspider
Sottopop
Spammen
Spanner
Spinn3r
spyfu
Sqlmap
Sqlworm
Sqworm
Stripper
Sucker
SuperHTTP
Surfbot
Swiftbot
sysscan
T0PHackTeam
tAkeOut
Telesoft
Telesphoreo
Telesphorep
Titan
Trendiction
TurnitinBot
UnisterBot
Upflow
URLy.Warning
Vacuum
Vagabondo
VeriCiteCrawler
Voil
Voltron
Wallpapers/3.0
WebAuto
WebCollage
Web Collage
WebCopier
Web Enhancer
Web Fetch
WebFuck
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebPix
Web Pix
WebReaper
WebSauger
Webster
WebSucker
Web Sucker
WebZIP
Who.is Bot
WiseGuys Robot
WISENutbot
Woobot
Wotbox
Wprecon
WPScan
WWW::Mechanize
x09Mozilla
YoudaoBot
Zade
Zauba
zauba.io
Zermelo