404enemy
80legs
ASPSeek
Aboundex
Aboundexbot
Aipbot
AlphaBot
Anarchy
Attach
BDCbot
BackStreet
BackWeb
BacklinkCrawler
Bandit
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
Black Hole
BlackWidow
BlowFish
Boardreader
Bolt
Brandwatch
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
Calculon
CensysInspect
CheTeam
ChinaClaw
Claritybot
Cloud mapping
Cocolyzebot
Collector
Copier
CopyRightCheck
Cosmos
Crawling at Home Project
CrunchBot
Custo
DIIbot
DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon
Dirbuster
Disco
Discobot
Discoverybot
DnyzBot
DomainAppender
DomainCrawler
Drip
EMail Wolf
EasyDL
EirGrabber
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
Ezooms
FemtosearchBot
Fimap
Firefox/7.0
Flunky
Foobot
FrontPage
FyberSpider
GetWeb
Go!Zilla
Go-Ahead-Got-It
Gotit
Grabber
Grafula
GridBot
HTTrack
Haansoft
Havij
Heritrix
Humanlinks
IDBot
IRLbot
Iblog
Id-search
IlseBot
Image Fetch
InterGET
Internet Ninja
InternetSeer
Iskanie
JOC Web Spider
Jbrofuzz
Jetty
Jorgee
JustView
Jyxobot
Keyword Density
LeechFTP
LeechGet
LexiBot
Libwhisker
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Ltx71
MJ12bot
MQQBrowser
Mag-Net
Mail.RU_Bot
Mata Hari
Mb2345Browser
Mediatoolkitbot
Microsoft Data Access
Microsoft URL Control
Mister PiX
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Name Intelligence
Navroad
NearSite
Net Vampire
NetAnts
NetLyzer
NetMechanic
NetSpider
NetZIP
Netcraft
Nettrack
Niki-bot
Offline Navigator
OnCrawl
OpenVAS
Openfind
Openvas
OrangeSpider
POE-Component-Client-HTTP
Pandalytics
Pavuk
Picsearch
ProWebWalker
Probethenet
Psbot
Pump
PyCurl
QueryN Metasearch
RSSingBot
RankActive
RankingBot
Rankivabot
RankurBot
RepoMonkey
Ripper
SBIder
SEOkicks-Robot
SEOprofiler
SEOstats
SISTRIX
SMTBot
ScanAlert
ScoutJet
ScrepyBot
SemrushBot
SeobilityBot
Seomoz
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
Sitebeam
SmartDownload
Snake
Sociscraper
SpaceBison
SputnikBot
Sqlmap
Sqworm
Stripper
Suzuran
Swiftbot
TeleportPro
Telesoft
Telesphoreo
Toata
Tracemyfile
Trendiction
True_Robot
Turnitin
URLy Warning
URLy.Warning
UnisterBot
V-BOT
VelenPublicWebCrawler
VidibleScraper
Virusdie
WEBDAV
WPScan
WallpapersHD
Web Auto
Web Pix
Web Sucker
WebFetch
WebImageCollector
WebLeacher
WebPix
WebSauger
WebSucker
Webalta
WebsiteExtractor
Webster
Whack
Widow
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Zitebot
autoemailspider
backlink-check
coccocbot-web
cognitiveseo
domainsproject.org
eCatch
facebookscraper
heritrix
ips-agent
lwp-trivial
mediawords
oBot
polaris version
satoristudio.net
scan.lol
seobility
seostar
siteripz
sogouspider
tAkeOut
trendiction.de
webmeup-crawler
x09Mozilla