360Spider
404enemy
Aboundex
Acunetix
ADmantX
AiHitBot
Apexoo
archive.org_bot
ASPSeek
Asterias
Attach
autoemailspider
BackStreet
Badass
Barkrowler
BDCbot
BetaBot
Blackboard
Blow
BotALot
Brandprotect
Buddy
BuiltWith
BunnySlippers
Calculon
CazoodleBot
ChinaClaw
Chlooe
Claritybot
coccocbot-web
cognitiveseo
Copier
CopyRightCheck
Craftbot
crawler4j
crawl.sogou.com
Crescent
CSHttp
DataCha0s
DBLBot
demandbase-bot
Deusu
Digincore
DigitalPebble
Discoverybot
DomainStatsBot
Dotbot
DSearch
DTS Agent
Ebingbong
EirGrabber
EMail Siphon
Express WebPictures
ExtractorPro
EyeNetIE
Ezooms
facebookscraper
FDM
Firefox/7.0
Flunky
Freeuploader
FyberSpider
GalaxyBot
GermCrawler
GetWeb
GoZilla
Go!Zilla
Grafula
GrapeFX
GrapeshotCrawler
GridBot
GT::WWW
HaosouSpider
Harvest
Havij
Hloader
HMView
HybridBot
IDBot
Id-search
Image Fetch
IndeedBot
InfoNaviRobot
Intelliseek
ips-agent
JOC Web Spider
Kozmosbot
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
Libwhisker
Linkdexbot
LinkextractorPro
LinkpadBot
LinkScan
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
LNSpiderguy
lwp-request
LWP::Simple
Majestic12
Majestic SEO
MarkMonitor
MarkWatch
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MFC_Tear_Sample
Microsoft URL Control
MIDown tool
MJ12bot
MSFrontPage
Musobot
Name Intelligence
Navroad
NearSite
Nettrack
Net Vampire
NetZIP
Nibbler
NICErsPRO
Niki-bot
Nimbostratus
Nutch
Octopus
Offline Explorer
Offline Navigator
Openfind
Openvas
OrangeBot
OrangeSpider
Page Analyzer
PageGrabber
page scorer
PageScorer
Pandalytics
Pavuk
pcBrowser
PeoplePal
PHPCrawl
Picscout
Pimonster
Pi-Monster
Pixray
PleaseCrawl
plumanalytics
Psbot
PxBroker
PyCurl
RankActive
RankFlex
RankingBot2
RankurBot
RedesScrapy
RocketCrawler
Rogerbot
s1z.ru
SBIder
Scanbot
Screaming
ScreenerBot
SEOkicks-Robot
seoscanners
SeoSiteCheckup
sexsearcher
Shodan
Siphon
SISTRIX
Sitebeam
SiteLockSpider
SiteSnagger
SiteSucker
Site Sucker
SMTBot
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
Sosospider
Sqlmap
Sqworm
Sucuri
Surfbot
SurveyBot
Szukacz
T0PHackTeam
T8Abot
tAkeOut
Telesoft
Telesphoreo
Telesphorep
Titan
Toata
Tracemyfile
Trendiction
Trendictionbot
trendiction.com
trendiction.de
True_Robot
Turnitin
TurnitinBot
TwengaBot
Typhoeus
UnisterBot
URLy.Warning
VCI
Voil
Voltron
WallpapersHD
WBSearchBot
WebAuto
Web Auto
WebCollage
WebCopier
WEBDAV
Web Enhancer
WebFuck
WebGo IS
WebImageCollector
WebPix
Web Pix
WebSauger
Webshag
WebsiteQuester
Webster
Web Sucker
WebZIP
WeSEE
Whack
Wonderbot
Wprecon
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Xaldon_WebSpider
Xenu
xpymep1.exe
Zauba
zgrab
ZmEu
ZumBot
ZyBorg