360Spider
80legs
Acunetix
AIBOT
AiHitBot
Aipbot
Alexibot
Anarchie
ASPSeek
Asterias
Attach
backlink-check
BacklinkCrawler
BackWeb
Bandit
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Blow
BlowFish
Bolt
Brandwatch
Bullseye
BuzzSumo
Calculon
CheeseBot
CherryPicker
ChinaClaw
Claritybot
Cloud mapping
Cogentbot
CopyRightCheck
Cosmos
CrazyWebCrawler
CSHttp
Curious
DataCha0s
Demon
Deusu
Devil
Dirbuster
Discoverybot
Dispatch
DittoSpyder
DomainSigmaCrawler
Dragonfly
DTS Agent
EasyDL
Ebingbong
eCatch
Ecxi
EirGrabber
evc-batch
Express WebPictures
facebookscraper
FemtosearchBot
Fimap
Firefox/7.0
Flunky
Foobot
FyberSpider
GalaxyBot
Genieo
GermCrawler
Getintent
GetRight
GetWeb
G-i-g-a-b-o-t
Go-Ahead-Got-It
GoZilla
GrabNet
Grafula
GridBot
GT::WWW
HaosouSpider
Harvest
HEADMasterSEO
HTTP::Lite
HTTrack
Humanlinks
Iblog
IDBot
Id-search
Image Fetch
InfoNaviRobot
InfoTekies
instabid
Internet Ninja
internetVista monitor
ips-agent
Iria
IRLbot
JamesBOT
Jetty
JikeSpider
Joomla
Jorgee
Jyxobot
Keyword Density
LexiBot
Lftp
LibWeb
Lightspeedsystems
Likse
LinkScan
LinkWalker
Lipperhey
Lipperhey Spider
lwp-request
Magnet
Mag-Net
Majestic12
Majestic-SEO
MarkMonitor
Masscan
Mata Hari
MauiBot
meanpathbot
Meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru
Metauri
MIIxpc
MJ12bot
Mojeek
MSIECrawler
MS Web Services Client Protocol
Musobot
Navroad
Needle
Nessus
Netcraft
NetMechanic
Nettrack
NetZIP
NextGenSearchBot
Nibbler
NimbleCrawler
Ninja
Nmap
NPbot
Offline Explorer
Offline Navigator
OnCrawl
OrangeSpider
OutfoxBot
PageGrabber
page scorer
pcBrowser
Picscout
Picsearch
PictureFinder
Pimonster
PleaseCrawl
Pockey
POE-Component-Client-HTTP
ProPowerBot
ProWebWalker
Quick-Crawler
RankFlex
RankurBot
RealDownload
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SalesIntelligent
scan.lol
ScoutJet
Screaming
SearchmetricsBot
Semrush
SemrushBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SeoSiteCheckup
SEOstats
serpstatbot
SiteExplorer
Siteimprove
SiteLockSpider
SiteSucker
SMTBot
Snapbot
Snoopy
Sociscraper
sogouspider
Sosospider
SpankBot
Spanner
Spbot
Sqlmap
Sqlworm
Steeler
Stripper
Sucuri
SuperHTTP
Swiftbot
sysscan
Szukacz
T0PHackTeam
T8Abot
Thumbor
TightTwatBot
Titan
TurnitinBot
TwengaBot
Typhoeus
UnisterBot
URLy Warning
Vagabondo
VB Project
Virusdie
VoidEYE
Voltron
Wallpapers/3.0
Webalta
WebAuto
WebBandit
WebCollage
Web Collage
WEBDAV
Web Fetch
WebGo IS
WebLeacher
WebSauger
Web Sauger
Website Quester
WebZIP
Whacker
Whatweb
Widow
WiseGuys Robot
Woobot
WPScan
WWW-Collector-E
WWW::Mechanize
x22Mozilla
Xenu
xpymep1.exe
YoudaoBot
Zade
Zermelo
Zitebot
ZyBorg