360Spider
404checker
404enemy
80legs
Abonti
Aboundex
AhrefsBot
AiHitBot
Aipbot
AlphaBot
Anarchie
archive.org_bot
Asterias
Backlink-Ceck
backlink-check
BackStreet
Badass
Bandit
Barkrowler
BatchFTP
BDCbot
Blackboard
BLEXBot
BlowFish
Boardreader
Bolt
BuiltWith
Bullseye
BunnySlippers
Chlooe
Cloud mapping
coccocbot-web
Cogentbot
Collector
Copier
CopyRightCheck
Cosmos
crawler4j
crawler.feedback
CrunchBot
DatabaseDriverMysqli
DBLBot
DigitalPebble
DIIbot
Discobot
Discoverybot
Dispatch
DittoSpyder
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Drip
DSearch
ECCP/1.0
EirGrabber
EMail Siphon
evc-batch
Exabot
facebookscraper
Fimap
Firefox/7.0
FlashGet
Freeuploader
FrontPage
FyberSpider
Fyrebot
Getintent
Gigabot
Go-Ahead-Got-It
Go!Zilla
GrabNet
Grafula
GrapeshotCrawler
HaosouSpider
Harvest
HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
Iblog
Id-search
Image Fetch
InfoNaviRobot
InfoTekies
InterGET
Internet Ninja
Iria
IRLbot
IstellaBot
JamesBOT
JennyBot
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Keyword Density
Lanshanbot
Larbin
LeechGet
Libwhisker
Lightspeedsystems
LinkWalker
Lipperhey
Litemage_walker
LNSpiderguy
LWP::Simple
lwp-trivial
Magnet
Mail.RU_Bot
MarkMonitor
MarkWatch
Mass Downloader
meanpathbot
Mediatoolkitbot
MFC_Tear_Sample
Mojeek
MSFrontPage
MSIECrawler
MS Web Services Client Protocol
Nameprotect
NetAnts
Netcraft
netEstate NE Crawler
NetMechanic
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
Nikto
NimbleCrawler
Ninja
NPbot
Nutch
oBot
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeBot
OrangeSpider
Page Analyzer
page scorer
PageScorer
Pandalytics
Panscient
Papa Foto
pcBrowser
plumanalytics
ProWebWalker
Psbot
PxBroker
PyCurl
QueryN Metasearch
RankActive
RankingBot2
Rankivabot
RealDownload
Recorder
RedesScrapy
RepoMonkey
Ripper
Rogerbot
SBIder
Scanbot
ScoutJet
Scrapy
Searchestate
Semrush
SEOkicks
SEOlyticsCrawler
Seomoz
SeoSiteCheckup
Siphon
SISTRIX
Siteimprove
SiteLockSpider
SiteSucker
Site Sucker
Snake
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
Spammen
Spanner
sp_auditbot
SputnikBot
Sqlmap
Steeler
Sucuri
SuperHTTP
Surfbot
SurveyBot
Szukacz
T8Abot
tAkeOut
Telesphoreo
Telesphorep
Thumbor
TightTwatBot
Titan
Toata
Trendictionbot
trendiction.com
Turnitin
TwengaBot
Typhoeus
UnisterBot
URLy.Warning
Vacuum
VeriCiteCrawler
VidibleScraper
Wallpapers/3.0
WBSearchBot
Web Auto
WebBandit
WebCollage
Web Collage
WebCopier
WEBDAV
Web Enhancer
WebFetch
WebGo IS
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
Web Pix
Web Sauger
WebSucker
WebZIP
Whack
WinHTTrack
Wonderbot
Woobot
WPScan
WWW-Collector-E
x09Mozilla
Xaldon WebSpider
Xenu
xpymep1.exe
YoudaoBot
ZmEu
ZumBot
ZyBorg