360Spider
404checker
ADmantX
Aboundex
AhrefsBot
AiHitBot
Alexibot
AllSubmitter
Alligator
Apexoo
Aspiegel
Attach
BDFetch
BLEXBot
BacklinkCrawler
Badass
BetaBot
BlowFish
Bolt
BotALot
Brandprotect
Buck
Buddy
BuiltBotTough
BuiltWith
BuzzSumo
CATExplorador
CCBot
CODE87
CSHttp
Calculon
ChinaClaw
Copyscape
Craftbot
CrazyWebCrawler
Crescent
Curious
CyotekWebCopy
DSearch
DTS Agent
DataCha0s
DigitalPebble
Discobot
DittoSpyder
DomainCrawler
DomainSigmaCrawler
Domains Project
Download Wonder
Evil
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FemtosearchBot
Firefox/7.0
Foobot
Freeuploader
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
GetRight
Gigabot
Go!Zilla
Go-Ahead-Got-It
Grabber
HMView
HTTP::Lite
HTTrack
Haansoft
Humanlinks
HybridBot
IDBot
IlseBot
Image Fetch
Image Sucker
Intelliseek
InterGET
JOC Web Spider
Jbrofuzz
JikeSpider
Jorgee
Keyword Density
Kinza
Kozmosbot
Lanshanbot
Larbin
LeechGet
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
MIIxpc
MJ12bot
MQQBrowser
Mag-Net
Magnet
Majestic-SEO
MarkMonitor
Mata Hari
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Metauri
Moblie Safari
Mojeek
Mojolicious
NICErsPRO
Navroad
Nessus
NetAnts
NetLyzer
Netvibes
Nibbler
Ninja
Nutch
OpenLinkProfiler
Openvas
OrangeBot
OrangeSpider
OutclicksBot
PECL::HTTP
PageGrabber
PageScorer
Panscient
Pavuk
Pi-Monster
Pimonster
Pockey
ProPowerBot
Pu_iN
Pump
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot
RankurBot
RealDownload
Recorder
Ripper
Rogerbot
SEOkicks-Robot
SISTRIX
ScanAlert
Scanbot
Scrapy
Screaming
SeoSiteCheckup
Site Sucker
SiteExplorer
SiteSnagger
SiteSucker
Sitebeam
SmartDownload
Snoopy
Sociscraper
Sogou web spider
Sottopop
Sqlmap
Stripper
SuperBot
Surfbot
Swiftbot
T0PHackTeam
T8Abot
Telesoft
The Intraformant
TightTwatBot
Tracemyfile
Trendictionbot
TurnitinBot
Twice
UnisterBot
Upflow
V-BOT
VCI
Vacuum
Vagabondo
VeriCiteCrawler
VoidEYE
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
WeSEE
Web Enhancer
Web Pix
WebCollage
WebFetch
WebImageCollector
WebPix
WebSauger
WebStripper
WebSucker
WebsiteExtractor
WebsiteQuester
Webster
Whack
Whacker
Whatweb
Who.is Bot
Wonderbot
Wotbox
Xaldon WebSpider
Xenu
YoudaoBot
Zade
Zeus
Zitebot
ZumBot
ZyBorg
autoemailspider
backlink-check
coccocbot-web
crawler.feedback
crawler4j
demandbase-bot
domainsproject.org
eCatch
facebookscraper
gopher
instabid
ips-agent
lwp-trivial
page scorer
pcBrowser
polaris version
satoristudio.net
sexsearcher
sitechecker.pro
spyfu
sysscan
trendiction.com
x09Mozilla
x22Mozilla