80legs
ALittle Client
Aboundex
Aboundexbot
Aipbot
AllSubmitter
Alligator
Ankit
Anthill
Apexoo
BBBike
BLEXBot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
Bandit
BatchFTP
Bigfoot
Black Hole
Brandwatch
Buddy
BuiltBotTough
CATExplorador
CSHttp
CazoodleBot
CensysInspect
Citoid
Cliqzbot
Copier
CopyRightCheck
Crescent
Curious
DSearch
DTS Agent
Demon
DigitalPebble
Discobot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomainCrawler
DomainStatsBot
Dragonfly
ECCP/1.0
EMail Wolf
Ebingbong
Exabot
Extractor
Ezooms
FDM
FHscan
FemtosearchBot
Foobot
FrontPage
Fuzz
FyberSpider
Fyrebot
Getintent
Go-Ahead-Got-It
GrabNet
Grafula
GrapeFX
HEADMasterSEO
Havij
Hloader
HybridBot
IDBTE4M
Iblog
Id-search
InfoNaviRobot
InterGET
Joomla
JustView
Jyxobot
Kinza
LNSpiderguy
Lanshanbot
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
Likse
LinkScan
Linkdexbot
LinkextractorPro
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
MJ12bot
MTRobot
Mag-Net
Magnet
Majestic12
Mass Downloader
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Microsoft URL Control
Minefield
Mojeek
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Musobot
NICErsPRO
NPbot
Nessus
Netvibes
Nimbostratus
Nmap
Not
Nuclei
Nutch
Offline Navigator
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OrangeBot
OrangeSpider
OutclicksBot
PECL::HTTP
PHPCrawl
Page Analyzer
Pandalytics
Papa Foto
Petalbot
Picscout
PictureFinder
Piepmatz
Pockey
ProPowerBot
ProWebWalker
Probethenet
Pu_iN
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
RealDownload
Recorder
RedesScrapy
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SMTBot
ScanAlert
Scrapy
Screaming
ScreenerBot
SemanticJuice
SeoSiteCheckup
SiteSnagger
Sitevigil
Snake
Snapbot
Snoopy
Sogou web spider
Spammen
Spbot
Sqworm
Steeler
Sucker
Sucuri
SuperHTTP
Surfbot
SurveyBot
Suzuran
Szukacz
T0PHackTeam
T8Abot
Teleport
Telesphorep
The Intraformant
Thumbor
Titan
Toata
Toweyabot
Trendictionbot
Turingos
Turnitin
TwengaBot
URLy.Warning
VCI
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Voil
WEBDAV
WISENutbot
Wallpapers
WeSEE
Web Enhancer
Web Fetch
WebFetch
WebLeacher
WebReaper
WebSauger
WebStripper
WebWhacker
WebmasterWorldForumBot
Website Quester
Whack
Whatweb
WinHTTrack
WiseGuys Robot
Woobot
Wprecon
YoudaoBot
Zauba
Zermelo
ZmEu
ZoomBot
autoemailspider
cah.io.community
demandbase-bot
facebookscraper
gopher
heritrix
internetVista monitor
lwp-trivial
magpie-crawler
meanpathbot
muhstik-scan
netEstate NE Crawler
page scorer
pcBrowser
ripz
scalaj-http
seoscanners
seostar
sexsearcher
sitechecker.pro
siteripz
sp_auditbot
tAkeOut
webgains-bot
webmeup-crawler
webprosbot
x09Mozilla