360Spider
80legs
ASPSeek
Abonti
Aboundex
Aboundexbot
AiHitBot
Aipbot
AllSubmitter
Alligator
Anarchy99
Anthill
Asterias
Attach
AwarioRssBot
BDCbot
BackStreet
BackWeb
Backlink-Ceck
Badass
Bandit
Barkrowler
Battleztar Bazinga
Black Hole
BlackWidow
Blow
Boardreader
BotALot
Buddy
BuiltBotTough
BuiltWith
Bullseye
CATExplorador
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CheTeam
CherryPicker
Chlooe
Cloud mapping
Collector
Copier
CopyRightCheck
Craftbot
Crawling at Home Project
Curious
CyotekWebCopy
DataCha0s
Devil
Discobot
Dispatch
DomCopBot
Domains Project
Dragonfly
EMail Siphon
Ecxi
Evil
Exabot
ExtLinksBot
Extractor
ExtractorPro
FDM
FlashGet
Flunky
FrontPage
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
GoZilla
GrabNet
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTrack
Havij
Heritrix
Hloader
IDBTE4M
Iblog
IlseBot
Image Sucker
Intelliseek
InterGET
Internet Ninja
InternetSeer
Iria
JOC Web Spider
Jbrofuzz
JikeSpider
JustView
Kinza
LNSpiderguy
Larbin
LibWeb
Lightspeedsystems
LinkScan
LinkWalker
Linkbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Ltx71
MFC_Tear_Sample
MIIxpc
MQQBrowser
MSFrontPage
MSIECrawler
Mail.RU_Bot
MarkMonitor
Mass Downloader
Masscan
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Musobot
NICErsPRO
NPbot
Name Intelligence
Nameprotect
Navroad
Nessus
NetLyzer
Netcraft
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Nmap
OpenLinkProfiler
Openvas
OrangeBot
PHPCrawl
Pandalytics
Pavuk
PictureFinder
Pixray
ProWebWalker
RankActiveLinkBot
Rankivabot
RankurBot
Re-re
ReGet
RealDownload
Reaper
RebelMouse
Recorder
Ripper
RocketCrawler
SBIder
SEOkicks
SEOlyticsCrawler
SISTRIX
ScoutJet
ScrepyBot
Searchestate
Semrush
SemrushBot
SeoSiteCheckup
SeobilityBot
Site Sucker
SiteExplorer
SiteSucker
Sitebeam
Siteimprove
SlySearch
Snapbot
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
Spanner
Spbot
Spinn3r
Stripper
Sucuri
Telesoft
Telesphoreo
True_Robot
TurnitinBot
TwengaBot
URLy Warning
V-BOT
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
Voil
Voltron
WBSearchBot
WISENutbot
WWW::Mechanize
WallpapersHD
WeSEE
WebBandit
WebFuck
WebLeacher
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
Webster
Whack
Who.is Bot
Widow
Wonderbot
Wotbox
Xenu
YoudaoBot
Zermelo
Zeus
ZoominfoBot
ZumBot
ZyBorg
archive.org_bot
autoemailspider
crawl.sogou.com
demandbase-bot
gopher
instabid
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
mediawords
netEstate NE Crawler
page scorer
pcBrowser
plumanalytics
probe-image-size
satoristudio.net
scalaj-http
scan.lol
seostar
serpstatbot
sexsearcher
sp_auditbot
spyfu
sysscan
trendiction.com
webmeup-crawler
x09Mozilla
zauba.io
zgrab