360Spider
Aboundexbot
AhrefsBot
Alexibot
Alligator
AlphaBot
BackDoorBot
Backlink-Ceck
BackStreet
BackWeb
BatchFTP
BBBike
BDFetch
BetaBot
Bitacle
Blackboard
BlackWidow
BlowFish
Boardreader
BotALot
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
Bullseye
CCBot
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Cloud mapping
coccocbot-web
Cogentbot
cognitiveseo
Collector
crawler4j
crawl.sogou.com
Crescent
CSHttp
Curious
Custo
DatabaseDriverMysqli
DataCha0s
Demon
Devil
Digincore
Disco
Discoverybot
DittoSpyder
DomainSigmaCrawler
Dragonfly
DSearch
ECCP/1.0
Ecxi
EirGrabber
EMail Wolf
evc-batch
Express WebPictures
Extractor
ExtractorPro
FDM
FemtosearchBot
Fimap
FlashGet
Flunky
Freeuploader
Genieo
GermCrawler
GetWeb
Gigablast
GoZilla
Go!Zilla
Grabber
GrabNet
Grafula
GrapeshotCrawler
HaosouSpider
Harvest
Heritrix
HTTP::Lite
Humanlinks
HybridBot
Iblog
IDBot
Id-search
IlseBot
InfoTekies
Intelliseek
InterGET
Internet Ninja
IRLbot
Jbrofuzz
JennyBot
JetCar
Jetty
Joomla
Jorgee
Keyword Density
Kozmosbot
Lanshanbot
LeechFTP
Lightspeedsystems
Likse
LinkextractorPro
LinkpadBot
Lipperhey Spider
Litemage_walker
LNSpiderguy
lwp-trivial
Magnet
magpie-crawler
Mail.RU_Bot
Majestic-SEO
MarkMonitor
MauiBot
meanpathbot
Meanpathbot
Mediatoolkitbot
Microsoft URL Control
MIIxpc
MSFrontPage
MS Web Services Client Protocol
Musobot
Name Intelligence
Nameprotect
Needle
Netcraft
NetLyzer
NetMechanic
NetSpider
Netvibes
NextGenSearchBot
Nikto
NimbleCrawler
Ninja
Nmap
NPbot
Nutch
oBot
Octopus
Offline Explorer
Offline Navigator
Openfind
OpenVAS
OutclicksBot
Page Analyzer
page scorer
PageScorer
Pandalytics
Pavuk
pcBrowser
PeoplePal
Pixray
PleaseCrawl
POE-Component-Client-HTTP
ProPowerBot
Pump
PxBroker
QueryN Metasearch
RankActive
RankActiveLinkBot
Rankivabot
Reaper
RedesScrapy
ReGet
Ripper
s1z.ru
SalesIntelligent
ScanAlert
Scanbot
Screaming
Searchestate
SemrushBot
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
Sitebeam
SiteLockSpider
SiteSnagger
SlySearch
SmartDownload
SMTBot
Snake
Snapbot
Snoopy
Sogou web spider
Sosospider
Sottopop
SpankBot
Spanner
Stripper
SuperBot
SuperHTTP
Teleport
TeleportPro
Telesoft
Telesphoreo
Telesphorep
TheNomad
Titan
Toata
Tracemyfile
Trendiction
trendiction.de
True_Robot
Turnitin
TurnitinBot
Twice
UnisterBot
URLy Warning
Vagabondo
VB Project
VCI
VidibleScraper
Virusdie
VoidEYE
Voltron
Wallpapers/3.0
WallpapersHD
Web Auto
WebBandit
Web Collage
WebEnhancer
WebFetch
WebFuck
webmeup-crawler
WebPix
WebSauger
Web Sauger
WebsiteQuester
WebSucker
Web Sucker
WeSEE
Widow
WiseGuys Robot
WISENutbot
Wonderbot
Woobot
WWW::Mechanize
x09Mozilla
x22Mozilla
Xenu
xpymep1.exe
Zade
zgrab
Zitebot
ZmEu
ZumBot
ZyBorg