360Spider
80legs
ADmantX
ALittle Client
ASPSeek
Aboundex
AiHitBot
Anarchy99
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Barkrowler
BatchFTP
Battleztar Bazinga
Black Hole
Blow
BlowFish
Brandprotect
Brandwatch
BuiltBotTough
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CODE87
CSHttp
CheTeam
CheeseBot
ChinaClaw
Citoid
Claritybot
Collector
Crawling at Home Project
CrazyWebCrawler
CrunchBot
DIIbot
DSearch
Deusu
DigitalPebble
Discobot
Discoverybot
Dispatch
DittoSpyder
DomCopBot
DomainCrawler
Domains Project
Dotbot
Drip
ECCP/1.0
EasyDL
EirGrabber
Exabot
Express WebPictures
ExtLinksBot
Extractor
FDM
FHscan
FemtosearchBot
Fimap
FlashGet
Freeuploader
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Gigabot
Grafula
GrapeFX
HTTP::Lite
HTTrack
Haansoft
HaosouSpider
Heritrix
IRLbot
InfoNaviRobot
Intelliseek
InternetSeer
Iria
Iskanie
IstellaBot
JamesBOT
JennyBot
JustView
Kenjin Spider
LWP::Simple
Lanshanbot
Larbin
Leap
LeechGet
LexiBot
Libwhisker
LieBaoFast
LinkScan
LinkWalker
Linkbot
LinqiaMetadataDownloaderBot
Lipperhey
MFC_Tear_Sample
MJ12bot
MTRobot
Magnet
Majestic-SEO
MarkMonitor
Masscan
Mb2345Browser
Mediatoolkitbot
Microsoft URL Control
Minefield
Morfeus Fucking Scanner
Mozlila
Mr.4x3
NICErsPRO
NPbot
NetAnts
NetSpider
NetZIP
Netcraft
NextGenSearchBot
Nibbler
Ninja
Nmap
Not
Nutch
Offline Explorer
OnCrawl
Openfind
OrangeBot
OrangeSpider
OutclicksBot
PHPCrawl
Page Analyzer
PageGrabber
PageThing.com
Pandalytics
Panscient
Picscout
Piepmatz
Pimonster
Pixray
PleaseCrawl
Psbot
Pu_iN
Quick-Crawler
ReGet
RealDownload
Reaper
RepoMonkey
RocketCrawler
Rogerbot
SEOkicks-Robot
SMTBot
SalesIntelligent
ScreenerBot
Semrush
SemrushBot
SentiBot
SeobilityBot
Siphon
SiteSnagger
Sitebeam
Siteimprove
Snake
SocialRankIOBot
Sosospider
SpankBot
SputnikBot
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP
Suzuran
Telesphoreo
Telesphorep
TheNomad
Titan
Tracemyfile
Trendiction
Trendictionbot
Turingos
TwengaBot
URLy.Warning
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Web Pix
Web Sauger
Web Sucker
WebBandit
WebEnhancer
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebReaper
WebStripper
Website Quester
WebsiteExtractor
WebsiteQuester
Widow
Woobot
Xaldon_WebSpider
Zitebot
ZoomBot
ZoominfoBot
ZyBorg
arquivo.pt
cah.io.community
clark-crawler
coccocbot-web
com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
evc-batch
facebookscraper
heritrix
instabid
iubenda-radar
meanpathbot
mediawords
muhstik-scan
polaris version
satoristudio.net
serpstatbot
spyfu
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
webprosbot
xpymep1.exe
zauba.io