80legs
Aboundexbot
Acunetix
ADmantX
AhrefsBot
AiHitBot
Aipbot
AlphaBot
Anarchie
ASPSeek
Asterias
autoemailspider
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BBBike
BDFetch
BetaBot
Bigfoot
BlackWidow
BLEXBot
Boardreader
Buddy
BuiltWith
CATExplorador
CheTeam
Cliqzbot
coccocbot-web
cognitiveseo
Copier
CopyRightCheck
Cosmos
crawl.sogou.com
Crescent
CrunchBot
CSHttp
Custo
DataCha0s
Digincore
DIIbot
Disco
Discobot
Discoverybot
DnyzBot
DomainCrawler
Dotbot
Download Wonder
Dragonfly
Drip
DSearch
DTS Agent
EasyDL
EirGrabber
evc-batch
EyeNetIE
Ezooms
FemtosearchBot
Firefox/7.0
Flunky
GalaxyBot
GetWeb
Gigabot
G-i-g-a-b-o-t
Go!Zilla
Grabber
Grafula
GrapeFX
GrapeshotCrawler
Haansoft
HaosouSpider
HEADMasterSEO
Hloader
HTMLparser
HTTrack
Humanlinks
HybridBot
IDBot
IlseBot
Indy Library
InfoNaviRobot
instabid
Intelliseek
Internet Ninja
InternetSeer
internetVista monitor
ips-agent
Iria
JetCar
JikeSpider
Joomla
Jorgee
Jyxobot
Kenjin Spider
Lanshanbot
LeechFTP
Lftp
Lightspeedsystems
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Litemage_walker
Lmspider
LWP::Simple
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic-SEO
MarkMonitor
MeanPath Bot
mediawords
Metauri
Microsoft Data Access
Microsoft URL Control
MIDown tool
Mister PiX
MJ12bot
MSIECrawler
Msrabot
Name Intelligence
Navroad
Nessus
NetLyzer
Nettrack
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nutch
Octopus
Openvas
OpenVAS
OrangeBot
OrangeSpider
OutfoxBot
PageAnalyzer
page scorer
Pandalytics
Panscient
Papa Foto
Pavuk
pcBrowser
PeoplePal
PHPCrawl
Picsearch
PictureFinder
Pimonster
Pi-Monster
Pockey
Psbot
PxBroker
QueryN Metasearch
RankActive
RebelMouse
Recorder
ReGet
Ripper
s1z.ru
SalesIntelligent
ScanAlert
scan.lol
ScoutJet
Scrapy
Searchestate
SearchmetricsBot
SEOkicks-Robot
SEOlyticsCrawler
seoscanners
serpstatbot
sexsearcher
Siphon
SISTRIX
SiteExplorer
SiteSnagger
SiteSucker
SMTBot
Snake
Snapbot
Sociscraper
sogouspider
Sogou web spider
Sottopop
SpankBot
Spanner
Spbot
spyfu
Sqworm
Sucuri
SurveyBot
Teleport
Telesphorep
Thumbor
Titan
Toata
Toweyabot
Trendiction
Trendictionbot
trendiction.com
trendiction.de
TurnitinBot
Vacuum
Vagabondo
VB Project
VeriCiteCrawler
WASALive-Bot
WebAuto
Web Collage
WebCopier
WebEnhancer
WebFuck
Web Fuck
WebGo IS
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
WebReaper
Web Sauger
Webshag
Website Quester
Webster
WebSucker
Web Sucker
WebWhacker
WebZIP
Whack
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
WISENutbot
Wotbox
WPScan
WWW::Mechanize
x09Mozilla
Xenu
xpymep1.exe
Zade
zauba.io
zgrab
ZmEu
ZumBot
ZyBorg