360Spider
80legs
Anarchie
Asterias
Attach
BackWeb
Bytespider
Chlooe
Cliqzbot
Copyscape
CrazyWebCrawler
CrunchBot
DigitalPebble
DomainCrawler
Dragonfly
Exabot
EyeNetIE
GermCrawler
Getintent
Go!Zilla
GoZilla
Google-Extended
Haansoft
IDBot
IlseBot
InfoNaviRobot
Iskanie
IstellaBot
JustView
LNSpiderguy
Lftp
Libwhisker
Lipperhey
Litemage_walker
MIIxpc
Mail.RU_Bot
Mass Downloader
Meanpathbot
Microsoft URL Control
Mojeek
Mojolicious
Name Intelligence
Niki-bot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
PageScorer
Panscient
Papa Foto
Pi-Monster
Picsearch
PleaseCrawl
Proximic
Pu_iN
PyCurl
QueryN Metasearch
Quick-Crawler
Re-re
SEOprofiler
ScoutJet
Searchestate
SenutoBot
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
Siteimprove
Snapbot
SocialRankIOBot
Spinn3r
SputnikBot
Swiftbot
T8Abot
TheNomad
Toweyabot
Trendictionbot
TurnitinBot
Typhoeus
URLy.Warning
WASALive-Bot
WWW::Mechanize
Web Enhancer
Web Fuck
WebStripper
Webster
Whack
WiseGuys Robot
Xaldon_WebSpider
ZumBot
adscanner
archive.org_bot
arquivo.pt
iubenda-radar
lwp-request
lwp-trivial
magpie-crawler
mediawords
netEstate NE Crawler
seocompany.store
trendiction.de