404enemy
80legs
AIBOT
Aboundex
Aboundexbot
AhrefsBot
Aipbot
AllSubmitter
Alligator
AlphaBot
Anarchie
AwarioSmartBot
BackStreet
BackWeb
BacklinkCrawler
Badass
Bandit
Barkrowler
BatchFTP
Bigfoot
Black Hole
Blackboard
Brandprotect
Buck
Buddy
Bullseye
BunnySlippers
CATExplorador
CSHttp
Calculon
Cegbfeieh
CheTeam
CheeseBot
CherryPicker
Chlooe
Citoid
Cocolyzebot
Crawling at Home Project
Custo
DIIbot
DataCha0s
DatabaseDriverMysqli
Demon
Devil
Digincore
Discobot
Discoverybot
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
Drip
EasyDL
Ecxi
Exabot
Express WebPictures
EyeNetIE
Ezooms
FHscan
Firefox/7.0
Flunky
Freeuploader
FrontPage
G-i-g-a-b-o-t
Genieo
Getintent
Gigabot
GoZilla
Grafula
GrapeFX
GrapeshotCrawler
HTTrack
Harvest
Havij
HonoluluBot
Humanlinks
HybridBot
IDBot
InfoTekies
IstellaBot
JOC Web Spider
Joomla
JustView
Kenjin Spider
Keyword Density
Kozmosbot
LNSpiderguy
LWP::Simple
LibWeb
Libwhisker
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Ltx71
MFC_Tear_Sample
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
Mag-Net
Magnet
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Masscan
MauiBot
MeanPath Bot
Mediatoolkitbot
Microsoft URL Control
Mozlila
Msrabot
Musobot
NICErsPRO
Needle
NetZIP
Netcraft
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Not
Nuclei
Nutch
Offline Navigator
OnCrawl
OpenVAS
Openvas
OutclicksBot
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageScorer
Pandalytics
Panscient
Pavuk
PictureFinder
Piepmatz
Pixray
PleaseCrawl
Pockey
Quick-Crawler
RSSingBot
ReGet
RebelMouse
Recorder
RocketCrawler
Scanbot
Scrapy
ScreenerBot
ScrepyBot
SearchmetricsBot
Semrush
SemrushBot
Seomoz
Siphon
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
SmartDownload
Snapbot
Sogou web spider
Sosospider
Spanner
SputnikBot
Sqlworm
Sucker
Sucuri
Swiftbot
Szukacz
Teleport
TeleportPro
Telesoft
Titan
Toweyabot
TurnitinBot
Typhoeus
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
WallpapersHD
WeSEE
Web Enhancer
Web Sauger
Web Sucker
WebBandit
WebCopier
WebEnhancer
WebFuck
WebImageCollector
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
WebmasterWorldForumBot
Website Quester
Whack
Whatweb
Who.is Bot
Widow
WiseGuys Robot
Woobot
Wotbox
Xenu
Zade
Zauba
Zeus
Zitebot
ZmEu
ZoominfoBot
ZyBorg
adscanner
autoemailspider
cah.io.community
com.plumanalytics
crawler4j
demandbase-bot
gopher
ips-agent
iubenda-radar
linkdexbot
magpie-crawler
muhstik-scan
pcBrowser
probe-image-size
satoristudio.net
scalaj-http
seobility
seoscanners
tAkeOut
trendiction.com
voyagerx.com
webmeup-crawler
x09Mozilla
zauba.io
zgrab