360Spider
404enemy
80legs
ADmantX
ALittle Client
ASPSeek
AiHitBot
Aipbot
Alexibot
AllSubmitter
Alligator
Anarchie
Ankit
Anthill
AwarioSmartBot
BDCbot
BackStreet
BacklinkCrawler
BatchFTP
Battleztar Bazinga
BetaBot
Black Hole
Blackboard
Boardreader
Bolt
BotALot
Brandwatch
BuiltBotTough
CATExplorador
CSHttp
CensysInspect
CheeseBot
Cocolyzebot
Collector
Cosmos
Craftbot
Crawling at Home Project
Curious
Custo
CyotekWebCopy
Demon
Dirbuster
Discoverybot
DomainSigmaCrawler
Domains Project
Dragonfly
Drip
EasyDL
EirGrabber
Exabot
ExtractorPro
Fimap
Flunky
Foobot
Fuzz
FyberSpider
Genieo
GetRight
Getintent
Gigabot
Go!Zilla
Gotit
GrabNet
Grabber
Grafula
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTP::Lite
Havij
Heritrix
Humanlinks
HybridBot
IDBTE4M
IRLbot
Image Fetch
Indy Library
IstellaBot
JOC Web Spider
Jbrofuzz
JennyBot
JikeSpider
Joomla
JustView
Jyxobot
Kozmosbot
Lanshanbot
Leap
Lftp
LieBaoFast
LinkWalker
Linkbot
LinksManager
Ltx71
MFC_Tear_Sample
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
Magnet
MarkWatch
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Msrabot
Musobot
NearSite
Net Vampire
NetAnts
NetMechanic
Netvibes
Nimbostratus
Octopus
Openfind
Openvas
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageScorer
Panscient
Papa Foto
Petalbot
Pi-Monster
Picscout
PictureFinder
Pixray
PxBroker
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
Re-re
ReGet
RealDownload
Reaper
RebelMouse
SEOkicks-Robot
SEOprofiler
SISTRIX
ScanAlert
ScoutJet
ScreenerBot
SearchmetricsBot
SeobilityBot
Siphon
Site Sucker
SiteSnagger
Sitebeam
Siteimprove
Snoopy
Sociscraper
Sogou web spider
SpaceBison
Spammen
SpankBot
Sqworm
SuperBot
SuperHTTP
Swiftbot
Szukacz
T0PHackTeam
Teleport
TeleportPro
Telesoft
Telesphoreo
Thumbor
Titan
Tracemyfile
Trendiction
Trendictionbot
Turnitin
TwengaBot
Twice
Typhoeus
URLy.Warning
UnisterBot
Upflow
VB Project
VCI
VeriCiteCrawler
VidibleScraper
Voil
WPScan
WWW-Mechanize
Wallpapers/3.0
Web Collage
Web Enhancer
Web Fetch
Web Pix
Web Sauger
WebBandit
WebCopier
WebFetch
WebStripper
WebWhacker
Webshag
WebsiteQuester
Whack
Whatweb
Who.is Bot
Widow
WinHTTrack
Wotbox
Xaldon_WebSpider
Xenu
Zade
Zermelo
Zeus
Zitebot
ZmEu
ZoominfoBot
ZyBorg
archive.org_bot
autoemailspider
cah.io.community
coccocbot-web
cognitiveseo
crawl.sogou.com
crawler.feedback
demandbase-bot
facebookscraper
heritrix
instabid
isitwp.com
lwp-request
lwp-trivial
meanpathbot
mediawords
satoristudio.net
scalaj-http
sitechecker.pro
spyfu
sysscan
trendiction.de
voyagerx.com
webpros.com
webprosbot
x22Mozilla
zauba.io