360Spider
404checker
ALittle Client
Aboundexbot
AiHitBot
Alexibot
Alligator
Anarchie
Anarchy
Apexoo
Asterias
AwarioRssBot
BDCbot
BackDoorBot
BackStreet
BacklinkCrawler
Bandit
BetaBot
Blow
BlowFish
BotALot
Buck
Buddy
Bullseye
BunnySlippers
CCBot
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot
Cliqzbot
Copier
CopyRightCheck
Cosmos
CrazyWebCrawler
CrunchBot
Curious
Custo
CyotekWebCopy
DSearch
Deusu
Devil
Digincore
DigitalPebble
Disco
Discobot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Domains Project
Dotbot
Dragonfly
EMail Siphon
Ebingbong
EroCrawler
Exabot
Express WebPictures
FHscan
Freeuploader
FrontPage
Fuzz
FyberSpider
Fyrebot
Genieo
GetRight
GetWeb
Gigabot
GrabNet
Grafula
HEADMasterSEO
HTMLparser
HTTP::Lite
Heritrix
Humanlinks
Id-search
IlseBot
Indy Library
InterGET
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
Jetty
JikeSpider
JustView
Jyxobot
Keyword Density
Kinza
LNSpiderguy
Leap
LeechGet
Lftp
LinkScan
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Ltx71
MFC_Tear_Sample
MQQBrowser
MSFrontPage
MSIECrawler
Magnet
MarkWatch
Masscan
Mata Hari
MeanPath Bot
Mediatoolkitbot
Metauri
MicroMessenger
Microsoft Data Access
Minefield
Mister PiX
Mozlila
Msrabot
NPbot
Needle
Net Vampire
NetLyzer
NetMechanic
NetSpider
NetZIP
Netvibes
NextGenSearchBot
Ninja
Nuclei
Offline Navigator
OnCrawl
Openfind
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageScorer
Pavuk
Pi-Monster
Pimonster
Pockey
ProPowerBot
Probethenet
Psbot
Pump
PxBroker
PyCurl
Quick-Crawler
RSSingBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RealDownload
RebelMouse
RocketCrawler
SEOlyticsCrawler
SEOprofiler
ScanAlert
Scanbot
ScrepyBot
Searchestate
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
SiteLockSpider
SiteSucker
SlySearch
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
SpankBot
Spinn3r
SputnikBot
Stripper
Sucker
Sucuri
SuperHTTP
Suzuran
Szukacz
Telesphoreo
Telesphorep
The Intraformant
Thumbor
Toweyabot
True_Robot
Turnitin
Twice
URLy Warning
V-BOT
VCI
VeriCiteCrawler
VidibleScraper
WPScan
WWW-Mechanize
WWW::Mechanize
Web Fuck
Web Sucker
WebBandit
WebEnhancer
WebFuck
WebSauger
WebsiteQuester
Whacker
WinHTTrack
Wonderbot
Wprecon
Xaldon_WebSpider
Xenu
Zeus
Zitebot
ZoomBot
ZoominfoBot
adscanner
arquivo-web-crawler
backlink-check
coccocbot
cognitiveseo
crawl.sogou.com
crawler.feedback
crawler4j
domainsproject.org
facebookscraper
ips-agent
isitwp.com
iubenda-radar
muhstik-scan
netEstate NE Crawler
page scorer
polaris version
probe-image-size
ripz
satoristudio.net
scalaj-http
seoscanners
sitechecker.pro
sp_auditbot
sysscan
trendiction.com
trendiction.de
webgains-bot
webmeup-crawler
x09Mozilla
zauba.io