360Spider
80legs
Abonti
Aboundexbot
Acunetix
AiHitBot
Aipbot
Alexibot
Badass
Barkrowler
Battleztar Bazinga
Boardreader
Bolt
Brandprotect
Bullseye
BunnySlippers
CATExplorador
CCBot
CODE87
CensysInspect
CheeseBot
Claritybot
Cloud mapping
Copier
Copyscape
CrazyWebCrawler
CrunchBot
Custo
DBLBot
DIIbot
DSearch
DTS Agent
DatabaseDriverMysqli
Demon
Digincore
DigitalPebble
Disco
DnBCrawler-Analytics
DomainAppender
DomainCrawler
DomainStatsBot
Domains Project
Dotbot
Download Wonder
Dragonfly
ECCP/1.0
EMail Wolf
EasyDL
EirGrabber
EroCrawler
ExtLinksBot
Extractor
EyeNetIE
Ezooms
FDM
Fimap
Firefox/7.0
Foobot
Fuzz
FyberSpider
Fyrebot
GalaxyBot
GetRight
GetWeb
Getintent
GoZilla
Gotit
GrapeFX
GridBot
HTTP::Lite
HTTrack
HonoluluBot
HybridBot
IDBTE4M
Iblog
Indy Library
InterGET
Jbrofuzz
JustView
Jyxobot
Kinza
LWP::Simple
Leap
LeechFTP
LexiBot
Libwhisker
Likse
LinqiaScrapeBot
Lipperhey
MIDown tool
MQQBrowser
MTRobot
Mag-Net
Magnet
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot
Microsoft URL Control
Mojolicious
MolokaiBot
Mozlila
Mr.4x3
Musobot
NICErsPRO
Name Intelligence
NearSite
Net Vampire
NetAnts
NetMechanic
Netcraft
Niki-bot
NimbleCrawler
Nmap
Offline Navigator
OnCrawl
OrangeBot
PECL::HTTP
PageGrabber
PageScorer
Pandalytics
Panscient
Pavuk
Pi-Monster
Picsearch
PictureFinder
ProPowerBot
Pump
RankActive
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
RankurBot
Re-re
RepoMonkey
Rogerbot
SBIder
SEOkicks-Robot
SEOprofiler
SMTBot
SalesIntelligent
ScreenerBot
Searchestate
SearchmetricsBot
Seekport
SemanticJuice
SeoSiteCheckup
SeobilityBot
SiteSnagger
SlySearch
Snapbot
Sogou web spider
Spammen
Spbot
Spinn3r
Sqworm
Steeler
Sucker
SuperBot
SuperHTTP
Szukacz
T0PHackTeam
TeleportPro
Titan
Trendiction
True_Robot
Turingos
TurnitinBot
TwengaBot
Twice
URLy.Warning
UnisterBot
VB Project
VCI
Vacuum
Vagabondo
VidibleScraper
Voil
WASALive-Bot
WISENutbot
WWW::Mechanize
WWWOFFLE
WeSEE
Web Auto
Web Collage
Web Fetch
Web Fuck
Web Pix
Web Sauger
WebCollage
WebEnhancer
WebFuck
WebImageCollector
WebStripper
WebSucker
WebZIP
Webalta
WebmasterWorldForumBot
WebsiteQuester
Webster
Whack
Widow
WiseGuys Robot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
ZmEu
ZoomBot
ZyBorg
arquivo-web-crawler
arquivo.pt
backlink-check
coccocbot
com.plumanalytics
crawler.feedback
demandbase-bot
domainsproject.org
gopher
iubenda-radar
mediawords
muhstik-scan
netEstate NE Crawler
ripz
scalaj-http
scan.lol
seocompany.store
seoscanners
sitechecker.pro
siteripz
sp_auditbot
spyfu
sysscan
tAkeOut
trendiction.com
trendiction.de
voyagerx.com
webprosbot
x09Mozilla
xpymep1.exe
zauba.io
zgrab