80legs
Abonti
Acunetix
Aipbot
AllSubmitter
Alligator
Anarchy
Ankit
Asterias
BDCbot
BLEXBot
BackStreet
Bandit
Barkrowler
BlackWidow
Blackboard
Buddy
BuiltWith
CCBot
CSHttp
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Copier
Copyscape
CrazyWebCrawler
CrunchBot
CyotekWebCopy
DSearch
DTS Agent
DatabaseDriverMysqli
Demon
DigitalPebble
Dirbuster
Disco
Discoverybot
DomainAppender
DomainCrawler
DomainStatsBot
Domains Project
Download Wonder
ECCP/1.0
Extractor
Extreme Picture Finder
Ezooms
Fimap
FlashGet
Freeuploader
Fuzz
FyberSpider
Fyrebot
GermCrawler
Gigabot
Go!Zilla
GoZilla
Gotit
Grabber
Grafula
GridBot
HEADMasterSEO
HMView
HTMLparser
Harvest
Havij
Heritrix
Hloader
IDBTE4M
IDBot
IRLbot
Iblog
IlseBot
Image Fetch
Indy Library
InfoTekies
Intelliseek
Internet Ninja
Iria
JOC Web Spider
JamesBOT
JetCar
Jetty
JikeSpider
Keyword Density
LNSpiderguy
LWP::Simple
LeechFTP
LeechGet
LieBaoFast
Lightspeedsystems
Likse
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lmspider
MFC_Tear_Sample
MIDown tool
MIIxpc
MQQBrowser
MSFrontPage
Mail.RU_Bot
Majestic-SEO
MarkWatch
Masscan
Meanpathbot
Mediatoolkitbot
MicroMessenger
Microsoft Data Access
Mojolicious
Msrabot
Musobot
Name Intelligence
Navroad
NearSite
Nessus
NetMechanic
NetSpider
Netcraft
Nibbler
Ninja
Nmap
Nuclei
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
PECL::HTTP
PageAnalyzer
PageThing.com
Panscient
Papa Foto
Pavuk
PeoplePal
Petalbot
Picscout
Picsearch
Piepmatz
Pimonster
Pixray
PleaseCrawl
Pockey
ProPowerBot
Psbot
PyCurl
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
ReGet
Ripper
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SMTBot
ScanAlert
ScoutJet
Scrapy
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SemrushBot
SentiBot
Seomoz
Siphon
Site Sucker
SiteExplorer
SiteLockSpider
SiteSnagger
Sitevigil
SlySearch
SocialRankIOBot
Sogou web spider
Sosospider
Sottopop
Sqlworm
Sqworm
Steeler
Sucker
Suzuran
Swiftbot
T0PHackTeam
T8Abot
Teleport
Toata
Toweyabot
Trendictionbot
Turnitin
TurnitinBot
TwengaBot
Twice
UnisterBot
Upflow
V-BOT
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
WISENutbot
WWW-Collector-E
WeSEE
Web Auto
Web Enhancer
Web Fetch
Web Pix
Web Sucker
WebAuto
WebBandit
WebCollage
WebGo IS
WebPix
WebSucker
WebmasterWorldForumBot
Whatweb
WiseGuys Robot
Woobot
Xaldon_WebSpider
Zermelo
Zeus
arquivo-web-crawler
autoemailspider
crawler4j
demandbase-bot
domainsproject.org
eCatch
gopher
lwp-request
lwp-trivial
magpie-crawler
mediawords
page scorer
pcBrowser
probe-image-size
ripz
satoristudio.net
scan.lol
sexsearcher
siteripz
sp_auditbot
tAkeOut
trendiction.com
trendiction.de
webmeup-crawler
x09Mozilla
x22Mozilla
zauba.io