360Spider
80legs
Abonti
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
Anarchie
ASPSeek
Asterias
Attach
BackDoorBot
Backlink-Ceck
backlink-check
BackStreet
BackWeb
Badass
Barkrowler
BatchFTP
BBBike
BDFetch
Bigfoot
Bitacle
BlowFish
Boardreader
BotALot
Brandwatch
Buddy
BuiltBotTough
BunnySlippers
BuzzSumo
Calculon
CATExplorador
CazoodleBot
CCBot
CheeseBot
Cliqzbot
coccocbot-web
Cogentbot
cognitiveseo
Copier
CopyRightCheck
Copyscape
Cosmos
crawler4j
crawl.sogou.com
Curious
Custo
DatabaseDriverMysqli
DataCha0s
DBLBot
demandbase-bot
Digincore
Disco
Dispatch
DittoSpyder
DomainSigmaCrawler
Dotbot
Dragonfly
Drip
DSearch
DTS Agent
EasyDL
eCatch
EirGrabber
EMail Wolf
ExtLinksBot
Extractor
EyeNetIE
facebookscraper
FDM
Firefox/7.0
FlashGet
Foobot
Freeuploader
GalaxyBot
GetRight
GetWeb
Gigabot
GoZilla
Grabber
Haansoft
HaosouSpider
Havij
HTMLparser
Humanlinks
Iblog
Id-search
IlseBot
Image Sucker
IndeedBot
Indy Library
instabid
Intelliseek
internetVista monitor
ips-agent
Iria
IRLbot
Jbrofuzz
JennyBot
JOC Web Spider
Joomla
JustView
Kenjin Spider
Keyword Density
Kozmosbot
Larbin
LeechGet
Libwhisker
Likse
LinkScan
LinqiaMetadataDownloaderBot
Litemage_walker
Ltx71
lwp-trivial
magpie-crawler
Mail.RU_Bot
MarkMonitor
MarkWatch
MauiBot
Meanpathbot
MeanPath Bot
Metauri
Microsoft Data Access
Mister PiX
Mojeek
MSIECrawler
Msrabot
muhstik-scan
Musobot
Nameprotect
Navroad
Needle
Nessus
NetAnts
NetSpider
Niki-bot
Nikto
Nmap
NPbot
Nutch
Offline Explorer
OnCrawl
OpenLinkProfiler
Openvas
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
PageScorer
Panscient
Papa Foto
pcBrowser
PECL::HTTP
Picscout
Picsearch
PictureFinder
Pimonster
Pixray
Probethenet
ProWebWalker
Psbot
PxBroker
PyCurl
RankActive
Rankivabot
RankurBot
Recorder
RepoMonkey
Ripper
s1z.ru
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
Scrapy
ScreenerBot
SemrushBot
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
SeoSiteCheckup
serpstatbot
Siphon
SISTRIX
SiteExplorer
Siteimprove
SiteLockSpider
SMTBot
Snake
Snoopy
SocialRankIOBot
Sosospider
SpaceBison
SpankBot
Spanner
Spinn3r
Sqlworm
Stripper
SuperBot
Surfbot
T0PHackTeam
Telesoft
Telesphorep
Thumbor
TightTwatBot
Titan
Toweyabot
Tracemyfile
trendiction.com
True_Robot
Turingos
Twice
Typhoeus
UnisterBot
Upflow
VB Project
Virusdie
Voil
Voltron
Wallpapers/3.0
WallpapersHD
WebAuto
Web Auto
WebBandit
Web Collage
WebCopier
WebFetch
Web Fetch
WebGo IS
WebmasterWorldForumBot
WebPix
Web Pix
WebReaper
WebsiteQuester
Website Quester
WebStripper
WebWhacker
Whack
Whacker
WinHTTrack
Wonderbot
Wotbox
x09Mozilla
Xaldon_WebSpider
Xenu
zauba.io
Zermelo
Zeus