360Spider
ADmantX
Aipbot
Alligator
AlphaBot
Anarchie
Apexoo
arquivo-web-crawler
ASPSeek
Asterias
Attach
AwarioSmartBot
Barkrowler
BatchFTP
Battleztar Bazinga
BBBike
BDFetch
BetaBot
Bigfoot
Black Hole
BlackWidow
BLEXBot
Blow
Boardreader
Bolt
BuiltBotTough
BunnySlippers
BuzzSumo
Calculon
CATExplorador
CazoodleBot
Cegbfeieh
ChinaClaw
Chlooe
Claritybot
coccocbot-web
Copier
Cosmos
CrazyWebCrawler
Crescent
CSHttp
Curious
DataCha0s
DBLBot
Demon
Devil
DIIbot
Dirbuster
Discoverybot
Dispatch
DittoSpyder
DomainAppender
DomainCrawler
Dotbot
DSearch
DTS Agent
EasyDL
eCatch
EMail Siphon
Extractor
Extreme Picture Finder
EyeNetIE
Ezooms
facebookscraper
Fimap
Firefox/7.0
FlashGet
Freeuploader
FrontPage
Genieo
Gigablast
Gigabot
G-i-g-a-b-o-t
Gotit
GoZilla
Go!Zilla
Grafula
GridBot
Haansoft
HaosouSpider
Havij
Heritrix
HTTP::Lite
HTTrack
Humanlinks
HybridBot
IDBot
Id-search
IlseBot
Image Sucker
Indy Library
instabid
Intelliseek
InterGET
internetVista monitor
ips-agent
Iria
IRLbot
JetCar
Jetty
Joomla
Jorgee
JustView
Jyxobot
LeechFTP
LexiBot
Libwhisker
Linkdexbot
LinkextractorPro
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
Lmspider
LNSpiderguy
Ltx71
lwp-request
LWP::Simple
lwp-trivial
Magnet
Majestic-SEO
Mass Downloader
MauiBot
Mediatoolkitbot
mediawords
Metauri
MFC_Tear_Sample
Microsoft URL Control
MIIxpc
MJ12bot
Morfeus Fucking Scanner
Msrabot
Navroad
NearSite
NetAnts
Netcraft
NetMechanic
Netvibes
NICErsPRO
NimbleCrawler
Nimbostratus
Ninja
NPbot
Nutch
oBot
Offline Explorer
Offline Navigator
OpenLinkProfiler
OpenVAS
Page Analyzer
Pandalytics
pcBrowser
PHPCrawl
Picscout
Picsearch
Pimonster
Pixray
Pockey
POE-Component-Client-HTTP
Psbot
RankActive
RankActiveLinkBot
RankingBot
Rankivabot
RebelMouse
ReGet
RepoMonkey
s1z.ru
SalesIntelligent
ScanAlert
Scanbot
scan.lol
SearchmetricsBot
Semrush
SemrushBot
SEOkicks
SEOlyticsCrawler
sexsearcher
Shodan
SiteExplorer
SiteSucker
Site Sucker
SmartDownload
SMTBot
Snake
Snoopy
SpaceBison
SpankBot
Spbot
SputnikBot
SuperBot
SuperHTTP
sysscan
Szukacz
tAkeOut
TeleportPro
Telesphoreo
TheNomad
Titan
Tracemyfile
Trendiction
True_Robot
Turingos
TurnitinBot
Twice
Typhoeus
URLy Warning
URLy.Warning
Vacuum
Vagabondo
VidibleScraper
Voil
Voltron
WallpapersHD
Webalta
WebBandit
WebCollage
WebCopier
WEBDAV
Web Enhancer
Web Fetch
Web Fuck
WebmasterWorldForumBot
webmeup-crawler
WebPix
Web Pix
WebReaper
Web Sauger
WebStripper
Web Sucker
WeSEE
Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Wotbox
Wprecon
WPScan
WWW-Collector-E
WWW::Mechanize
x09Mozilla
xpymep1.exe
Zade
Zauba
Zeus
zgrab
Zitebot
ZmEu
ZyBorg