80legs
Aboundex
Aipbot
Alligator
AlphaBot
Anarchie
Apexoo
archive.org_bot
ASPSeek
Attach
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BBBike
BetaBot
Bigfoot
Bitacle
Blackboard
BlowFish
Bolt
BotALot
Brandprotect
BuiltWith
Bullseye
BuzzSumo
Calculon
CheTeam
Claritybot
Cliqzbot
Cloud mapping
Collector
Copyscape
Craftbot
crawler4j
CrazyWebCrawler
Crescent
CSHttp
DataCha0s
demandbase-bot
Demon
Devil
Digincore
DittoSpyder
DnyzBot
Drip
EasyDL
Ebingbong
ECCP/1.0
Ecxi
EMail Wolf
EroCrawler
Evil
Express WebPictures
Extractor
ExtractorPro
FemtosearchBot
Firefox/7.0
FlashGet
FrontPage
FyberSpider
Fyrebot
GalaxyBot
Getintent
GetWeb
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
Grabber
GrapeFX
Haansoft
Harvest
HEADMasterSEO
Hloader
HTMLparser
HTTrack
Humanlinks
Iblog
Id-search
IlseBot
Image Fetch
Indy Library
InfoTekies
InterGET
Internet Ninja
InternetSeer
ips-agent
Iria
JamesBOT
Jbrofuzz
Joomla
Jorgee
Jyxobot
Keyword Density
Lanshanbot
Larbin
LeechFTP
LibWeb
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LWP::Simple
lwp-trivial
Mail.RU_Bot
MarkMonitor
MarkWatch
Masscan
Mass Downloader
MauiBot
meanpathbot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
MIIxpc
Mister PiX
Mojeek
Morfeus Fucking Scanner
Mr.4x3
MSFrontPage
MSIECrawler
MS Web Services Client Protocol
Name Intelligence
Navroad
Netcraft
netEstate NE Crawler
NetMechanic
NICErsPRO
Niki-bot
Nikto
Nimbostratus
Ninja
Nmap
Nutch
oBot
Offline Navigator
OnCrawl
Openfind
OrangeSpider
OutclicksBot
OutfoxBot
PageAnalyzer
Page Analyzer
PageGrabber
page scorer
Panscient
Pavuk
PeoplePal
PHPCrawl
Picscout
Picsearch
Pixray
PleaseCrawl
plumanalytics
Probethenet
Quick-Crawler
RankActive
RankurBot
RepoMonkey
SalesIntelligent
Scanbot
ScoutJet
Screaming
Searchestate
Semrush
SemrushBot
SEOlyticsCrawler
SEOprofiler
serpstatbot
Shodan
SISTRIX
Sitebeam
Site Sucker
SmartDownload
SMTBot
SocialRankIOBot
Sociscraper
Sogou web spider
Sottopop
SputnikBot
spyfu
Sqworm
Steeler
Stripper
SuperBot
Surfbot
SurveyBot
Suzuran
Swiftbot
Szukacz
Telesphoreo
The Intraformant
TheNomad
Toata
Tracemyfile
Trendictionbot
trendiction.com
trendiction.de
True_Robot
Turingos
Turnitin
Twice
Typhoeus
Upflow
URLy.Warning
Vagabondo
Virusdie
Voil
WBSearchBot
WebAuto
WebBandit
WebCollage
WEBDAV
WebEnhancer
Web Enhancer
WebFuck
WebImageCollector
WebLeacher
webmeup-crawler
Web Pix
WebSauger
Webshag
Website Quester
WebSucker
WeSEE
Whack
Whacker
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
WISENutbot
Wotbox
WPScan
WWW-Mechanize
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
Zauba
Zermelo
zgrab
Zitebot
ZmEu
ZumBot
ZyBorg