404enemy
80legs
ADmantX
AiHitBot
Alexibot
Anarchie
Aspiegel
Asterias
AwarioRssBot
AwarioSmartBot
BBBike
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Bandit
Battleztar Bazinga
BetaBot
Bigfoot
Black Hole
Blow
Boardreader
Bolt
Brandprotect
Buck
BuiltBotTough
BuzzSumo
CATExplorador
CODE87
CSHttp
CensysInspect
CheeseBot
CherryPicker
Cloud mapping
Collector
Copier
CopyRightCheck
Crescent
CrunchBot
Curious
Custo
DIIbot
DTS Agent
DataCha0s
Demon
Devil
Discobot
Dispatch
DittoSpyder
DomCopBot
DomainCrawler
Domains Project
Drip
ECCP/1.0
EasyDL
EirGrabber
Evil
ExtractorPro
FDM
FHscan
Fimap
Firefox/7.0
Foobot
Freeuploader
Fuzz
Fyrebot
G-i-g-a-b-o-t
GrabNet
Grabber
GrapeshotCrawler
GridBot
HTMLparser
HTTrack
Harvest
Havij
Humanlinks
IDBTE4M
IRLbot
Iblog
Id-search
Image Fetch
Image Sucker
Internet Ninja
InternetSeer
JOC Web Spider
JikeSpider
Jorgee
Lanshanbot
Larbin
Leap
LeechFTP
Likse
LinkScan
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Litemage_walker
Ltx71
MJ12bot
MTRobot
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkWatch
MauiBot
Mb2345Browser
MicroMessenger
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mozlila
NICErsPRO
Name Intelligence
Nameprotect
Navroad
NetMechanic
NetSpider
NetZIP
Netvibes
NextGenSearchBot
Nikto
NimbleCrawler
Ninja
Nutch
OrangeBot
OutfoxBot
PHPCrawl
Page Analyzer
Petalbot
Picscout
Picsearch
Piepmatz
Pixray
PxBroker
RSSingBot
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
RealDownload
Recorder
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SEOkicks
SEOlyticsCrawler
SEOprofiler
SMTBot
ScoutJet
Searchestate
SearchmetricsBot
SemanticJuice
SemrushBot
SiteExplorer
SiteLockSpider
SiteSnagger
Sitebeam
Sitevigil
Snoopy
Sogou web spider
Sosospider
Sottopop
SpankBot
Spanner
Sucuri
Surfbot
SurveyBot
T8Abot
TeleportPro
Telesphoreo
Telesphorep
The Intraformant
Titan
Toweyabot
True_Robot
TurnitinBot
TwengaBot
Twice
Typhoeus
UnisterBot
VCI
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voil
Voltron
WISENutbot
WWWOFFLE
WallpapersHD
Web Auto
Web Enhancer
Web Fetch
Web Fuck
Web Pix
Web Sucker
WebAuto
WebBandit
WebEnhancer
WebFuck
WebImageCollector
WebLeacher
WebPix
WebReaper
WebSauger
Webalta
Website Quester
Webster
Whack
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Xaldon_WebSpider
Xenu
YoudaoBot
Zeus
Zitebot
ZyBorg
archive.org_bot
arquivo-web-crawler
clark-crawler
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
eCatch
heritrix
internetVista monitor
ips-agent
isitwp.com
lwp-request
lwp-trivial
mediawords
oBot
page scorer
satoristudio.net
seobility
sexsearcher
siteripz
sp_auditbot
sysscan
tAkeOut
voyagerx.com
webmeup-crawler
x22Mozilla