360Spider
404checker
Abonti
Aboundex
Acunetix
Aipbot
Alexibot
archive.org_bot
Attach
autoemailspider
AwarioSmartBot
BackDoorBot
Badass
Bandit
BatchFTP
BDFetch
Bigfoot
BlackWidow
BLEXBot
Blow
Boardreader
Bolt
BotALot
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
Calculon
CazoodleBot
CCBot
Cegbfeieh
CheeseBot
CherryPicker
CheTeam
ChinaClaw
Cloud mapping
cognitiveseo
Collector
com.plumanalytics
Copier
CopyRightCheck
Copyscape
Cosmos
Craftbot
crawler4j
crawler.feedback
Custo
DatabaseDriverMysqli
DataCha0s
demandbase-bot
Demon
Devil
DIIbot
Disco
Discoverybot
Dispatch
DittoSpyder
DomainAppender
DomainSigmaCrawler
Dotbot
Download Wonder
Dragonfly
EasyDL
eCatch
ECCP/1.0
EirGrabber
EMail Siphon
EMail Wolf
evc-batch
ExtractorPro
Extreme Picture Finder
FDM
FemtosearchBot
FHscan
Fimap
FlashGet
Flunky
Foobot
Freeuploader
FrontPage
Getintent
Go-Ahead-Got-It
Gotit
GoZilla
Grabber
GrabNet
Grafula
GridBot
Haansoft
HTMLparser
HTTP::Lite
HTTrack
Humanlinks
Id-search
IndeedBot
InfoTekies
Intelliseek
InterGET
Internet Ninja
internetVista monitor
ips-agent
Iskanie
IstellaBot
JikeSpider
Kozmosbot
Larbin
LeechFTP
LeechGet
Lftp
LibWeb
Libwhisker
Lightspeedsystems
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
lwp-request
lwp-trivial
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkMonitor
MarkWatch
Masscan
meanpathbot
MeanPath Bot
mediawords
MFC_Tear_Sample
Microsoft URL Control
MIDown tool
Mister PiX
MJ12bot
Mr.4x3
MSFrontPage
MSIECrawler
Nameprotect
Nessus
Netcraft
netEstate NE Crawler
NetLyzer
NetSpider
Net Vampire
Netvibes
Nimbostratus
NPbot
Octopus
Offline Navigator
OpenLinkProfiler
Openvas
OrangeSpider
OutclicksBot
PageAnalyzer
Page Analyzer
PageGrabber
page scorer
PECL::HTTP
PHPCrawl
Picscout
PictureFinder
Pimonster
Pixray
plumanalytics
Pockey
Probethenet
ProPowerBot
Pump
PxBroker
PyCurl
QueryN Metasearch
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RealDownload
Reaper
RebelMouse
ReGet
RepoMonkey
RocketCrawler
Rogerbot
RSSingBot
scan.lol
Scrapy
Semrush
SEOkicks-Robot
Seomoz
seoscanners
SEOstats
sexsearcher
Shodan
Siphon
SISTRIX
SiteExplorer
Siteimprove
SiteLockSpider
Sociscraper
SpankBot
Spanner
spyfu
Sqlworm
Steeler
Stripper
Sucker
SuperHTTP
Surfbot
SurveyBot
Suzuran
T8Abot
Telesphoreo
Toata
Tracemyfile
True_Robot
TurnitinBot
UnisterBot
URLy.Warning
VB Project
VidibleScraper
Voil
Voltron
WASALive-Bot
WebAuto
WebBandit
WebCollage
Web Enhancer
WebFetch
Web Fetch
WebGo IS
WebPix
Web Pix
WebReaper
Webshag
WebsiteExtractor
Website Quester
Webster
WebStripper
WebSucker
WebWhacker
Whack
Who.is Bot
WiseGuys Robot
Wotbox
WPScan
WWW-Collector-E
WWWOFFLE
Xenu
zauba.io
Zermelo
ZmEu