360Spider
404checker
AIBOT
ASPSeek
Aboundex
Acunetix
AhrefsBot
Alligator
Anarchy99
Asterias
Attach
AwarioSmartBot
BDFetch
BLEXBot
Backlink-Ceck
BacklinkCrawler
Barkrowler
BatchFTP
BetaBot
Black Hole
Blackboard
Blow
Boardreader
Bolt
BotALot
Brandwatch
BuiltBotTough
BunnySlippers
Cegbfeieh
CensysInspect
ChinaClaw
Claritybot
Cocolyzebot
Collector
Copier
CopyRightCheck
Cosmos
Crawling at Home Project
Curious
CyotekWebCopy
DBLBot
Demon
Dirbuster
Discobot
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
Dotbot
EMail Wolf
EasyDL
Evil
Extreme Picture Finder
FHscan
Firefox/7.0
Foobot
Freeuploader
FrontPage
Fuzz
FyberSpider
GT::WWW
Genieo
GermCrawler
GetRight
Gotit
Grafula
GridBot
HEADMasterSEO
HMView
HTMLparser
HTTrack
Haansoft
Havij
Hloader
IDBot
IRLbot
Iblog
Id-search
Image Fetch
InfoTekies
Internet Ninja
InternetSeer
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JetCar
JikeSpider
Jorgee
JustView
Keyword Density
Kozmosbot
Lanshanbot
LinkextractorPro
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MIDown tool
MJ12bot
MSFrontPage
MSIECrawler
MTRobot
Magnet
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
Mb2345Browser
Mediatoolkitbot
Metauri
Minefield
Mister PiX
Moblie Safari
Mojeek
Mojolicious
Mozlila
Musobot
NPbot
Name Intelligence
NetAnts
NetMechanic
Ninja
Offline Navigator
OrangeSpider
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
PageScorer
Pavuk
PeoplePal
Picscout
Picsearch
PictureFinder
Piepmatz
Pockey
ProPowerBot
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
Re-re
Recorder
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SEOlyticsCrawler
SEOprofiler
SEOstats
ScanAlert
ScoutJet
Scrapy
ScreenerBot
ScrepyBot
Seekport
SentiBot
SeobilityBot
Seomoz
Siphon
SiteSnagger
SiteSucker
Siteimprove
Snapbot
Sociscraper
SpaceBison
Spammen
SpankBot
Spanner
Spinn3r
SputnikBot
Sqworm
Sucuri
SuperBot
SurveyBot
Swiftbot
Szukacz
Telesoft
TheNomad
Toweyabot
True_Robot
Turingos
Turnitin
TurnitinBot
Twice
URLy Warning
URLy.Warning
V-BOT
VCI
VidibleScraper
Virusdie
WASALive-Bot
WBSearchBot
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Web Enhancer
Web Fetch
WebGo IS
WebLeacher
WebPix
WebWhacker
Webalta
Webshag
WebsiteExtractor
Webster
Whack
Widow
Wonderbot
Xaldon_WebSpider
Xenu
Zade
ZoominfoBot
ZumBot
adscanner
arquivo-web-crawler
autoemailspider
backlink-check
clark-crawler
coccocbot
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
facebookscraper
isitwp.com
meanpathbot
mediawords
muhstik-scan
page scorer
pcBrowser
probe-image-size
s1z.ru
scan.lol
seobility
seostar
sexsearcher
siteripz
spyfu
sysscan
x09Mozilla
x22Mozilla