360Spider
404enemy
80legs
Abonti
Aboundex
Aboundexbot
Acunetix
AIBOT
Aipbot
Alligator
Apexoo
arquivo.pt
arquivo-web-crawler
autoemailspider
Backlink-Ceck
backlink-check
BacklinkCrawler
BackWeb
Badass
Barkrowler
BatchFTP
BBBike
BDFetch
BetaBot
Bigfoot
Black Hole
BLEXBot
BlowFish
CATExplorador
CCBot
Chlooe
Claritybot
Cloud mapping
coccocbot-web
cognitiveseo
com.plumanalytics
CopyRightCheck
crawler4j
CrazyWebCrawler
Crescent
CrunchBot
DataCha0s
DBLBot
demandbase-bot
Demon
DIIbot
Dirbuster
Discobot
Discoverybot
DomainSigmaCrawler
DomainStatsBot
Dotbot
DTS Agent
EasyDL
Ecxi
EirGrabber
EMail Wolf
EroCrawler
evc-batch
Extreme Picture Finder
Ezooms
FDM
FemtosearchBot
Fimap
Firefox/7.0
Flunky
Freeuploader
FrontPage
Genieo
GermCrawler
GetWeb
Gigablast
Gigabot
Go-Ahead-Got-It
GoZilla
GrabNet
Grafula
GrapeFX
Haansoft
Harvest
HMView
HTTP::Lite
IDBot
Id-search
IlseBot
Image Fetch
InfoNaviRobot
InfoTekies
InterGET
internetVista monitor
Iskanie
Jbrofuzz
JennyBot
Jetty
Joomla
JustView
Jyxobot
Kozmosbot
Lanshanbot
LeechGet
Lftp
LibWeb
Likse
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
Lmspider
LNSpiderguy
Ltx71
lwp-request
lwp-trivial
Magnet
Mag-Net
magpie-crawler
Majestic SEO
MarkWatch
meanpathbot
Meanpathbot
mediawords
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MIDown tool
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
MSFrontPage
MSIECrawler
Musobot
Navroad
Needle
Nessus
NetLyzer
NetMechanic
NetSpider
Nettrack
Niki-bot
NPbot
Nutch
oBot
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeSpider
OutfoxBot
PageGrabber
PageScorer
Pavuk
pcBrowser
PECL::HTTP
PHPCrawl
Picscout
PictureFinder
Pixray
PleaseCrawl
POE-Component-Client-HTTP
ProWebWalker
PxBroker
PyCurl
RankActiveLinkBot
RankFlex
RankingBot2
Rankivabot
RankurBot
RealDownload
Reaper
Recorder
RedesScrapy
RepoMonkey
RocketCrawler
RSSingBot
s1z.ru
SalesIntelligent
Screaming
ScreenerBot
SearchmetricsBot
seoscanners
SeoSiteCheckup
SEOstats
Siphon
SISTRIX
Sitebeam
SiteExplorer
SiteSnagger
Site Sucker
SmartDownload
Sociscraper
SpankBot
Spinn3r
Sqlmap
Sqlworm
Sqworm
SurveyBot
Suzuran
sysscan
T8Abot
Teleport
TeleportPro
Telesphoreo
TheNomad
TightTwatBot
Titan
Toata
Toweyabot
Tracemyfile
trendiction.com
Turingos
TurnitinBot
TwengaBot
Typhoeus
URLy.Warning
Vacuum
VB Project
VCI
VeriCiteCrawler
VoidEYE
Wallpapers/3.0
WallpapersHD
WASALive-Bot
WebCollage
WEBDAV
Web Enhancer
WebImageCollector
WebLeacher
Web Pix
WebSauger
Webshag
WebsiteExtractor
WebWhacker
WebZIP
WeSEE
WinHTTrack
WISENutbot
Wprecon
WPScan
WWW-Collector-E
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
Zauba
Zitebot
ZyBorg