360Spider
ALittle Client
Abonti
Aboundexbot
Acunetix
AhrefsBot
Alexibot
Alligator
Anarchy99
Apexoo
Aspiegel
Asterias
Atomseobot
BDCbot
BDFetch
BackDoorBot
BackStreet
BackWeb
Black Hole
Blow
BlowFish
Brandwatch
BuiltWith
CATExplorador
CODE87
CheeseBot
Chlooe
Cliqzbot
Cloud mapping
Cogentbot
Collector
Copyscape
Cosmos
Craftbot
CrunchBot
Curious
Custo
CyotekWebCopy
DBLBot
DSearch
Deusu
DigitalPebble
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomCopBot
Dragonfly
EMail Siphon
Ecxi
Extractor
FDM
FHscan
FemtosearchBot
FlashGet
Flunky
Freeuploader
Fuzz
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GermCrawler
Gigabot
Go!Zilla
Go-Ahead-Got-It
GoZilla
GrabNet
GrapeFX
HTTrack
Haansoft
Harvest
Havij
IDBot
Id-search
IlseBot
Image Fetch
IndeedBot
Indy Library
Intelliseek
InternetSeer
Iskanie
IstellaBot
Jbrofuzz
JennyBot
JikeSpider
Jorgee
Keybot Translation-Search-Machine
Kinza
Kozmosbot
LNSpiderguy
Lanshanbot
Leap
LeechGet
LieBaoFast
Likse
LinqiaMetadataDownloaderBot
LinqiaRSSBot
MFC_Tear_Sample
MQQBrowser
MSFrontPage
Magnet
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojolicious
MolokaiBot
Musobot
Nameprotect
Navroad
NearSite
Nessus
NetAnts
NetLyzer
NetMechanic
Netvibes
Nibbler
Nimbostratus
Nuclei
Nutch
Offline Explorer
PageAnalyzer
Panscient
PeoplePal
Petalbot
Pi-Monster
Picscout
Picsearch
Pixray
Pockey
ProPowerBot
ProWebWalker
Probethenet
Psbot
PyCurl
Quick-Crawler
RankFlex
Rankivabot
RankurBot
RealDownload
Reaper
Recorder
RepoMonkey
Ripper
Rogerbot
ScanAlert
Searchestate
Seekport
SiteExplorer
SiteLockSpider
Sitebeam
Sitevigil
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
Spammen
Spbot
Spinn3r
Sqlmap
Sqlworm
Sqworm
Stripper
Sucuri
SuperHTTP
Szukacz
T8Abot
Teleport
TeleportPro
Telesphoreo
Telesphorep
TheNomad
Thumbor
TightTwatBot
Titan
Tracemyfile
True_Robot
Turnitin
TwengaBot
Twice
URLy.Warning
UnisterBot
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
WASALive-Bot
WBSearchBot
WPScan
WWW::Mechanize
Web Collage
Web Fetch
Web Fuck
WebEnhancer
WebGo IS
WebPix
WebReaper
WebStripper
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Webster
Whatweb
WiseGuys Robot
Wotbox
Xenu
YoudaoBot
Zauba
Zermelo
ZumBot
adscanner
arquivo-web-crawler
autoemailspider
cah.io.community
com.plumanalytics
crawl.sogou.com
domainsproject.org
instabid
isitwp.com
lwp-request
magpie-crawler
meanpathbot
muhstik-scan
oBot
plumanalytics
ripz
satoristudio.net
seobility
sitechecker.pro
siteripz
sp_auditbot
trendiction.com
trendiction.de
webgains-bot
webprosbot
x09Mozilla
zgrab