360Spider
80legs
Abonti
Acunetix
AiHitBot
Alexibot
AllSubmitter
Anarchie
archive.org_bot
Attach
autoemailspider
Backlink-Ceck
backlink-check
BackStreet
Badass
Bandit
BatchFTP
BBBike
BDFetch
Bigfoot
Bitacle
BlackWidow
BLEXBot
BlowFish
Boardreader
Brandwatch
Buddy
BuiltWith
Bullseye
BuzzSumo
Calculon
CATExplorador
Cegbfeieh
CheTeam
ChinaClaw
Claritybot
Cogentbot
cognitiveseo
com.plumanalytics
Copier
CopyRightCheck
crawl.sogou.com
CrazyWebCrawler
CSHttp
DatabaseDriverMysqli
DataCha0s
DBLBot
Devil
DigitalPebble
DIIbot
Dirbuster
Disco
Discobot
DomainAppender
DomainSigmaCrawler
Dotbot
EirGrabber
evc-batch
Evil
ExtractorPro
Ezooms
facebookscraper
Fimap
Firefox/7.0
FlashGet
Freeuploader
FrontPage
Fyrebot
GetRight
G-i-g-a-b-o-t
Grabber
GridBot
Harvest
Havij
Heritrix
HTTP::Lite
HTTrack
Humanlinks
HybridBot
Iblog
IDBot
Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot
Indy Library
instabid
InternetSeer
IstellaBot
JamesBOT
JennyBot
JetCar
JOC Web Spider
Jorgee
JustView
Kenjin Spider
Larbin
LeechGet
Libwhisker
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
LNSpiderguy
lwp-request
LWP::Simple
lwp-trivial
Majestic-SEO
MarkMonitor
MarkWatch
Masscan
Meanpathbot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MFC_Tear_Sample
Microsoft Data Access
MIDown tool
MIIxpc
MJ12bot
Mojeek
Morfeus Fucking Scanner
muhstik-scan
Musobot
Name Intelligence
Navroad
NearSite
Needle
Nessus
Netcraft
NetLyzer
Net Vampire
Netvibes
NetZIP
Nibbler
NICErsPRO
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Nmap
NPbot
Nutch
Octopus
Offline Explorer
Openfind
OpenLinkProfiler
OrangeSpider
OutclicksBot
PageGrabber
page scorer
Papa Foto
Picscout
PictureFinder
Pi-Monster
plumanalytics
Pockey
ProPowerBot
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
ReGet
Ripper
RocketCrawler
Rogerbot
s1z.ru
SalesIntelligent
Scanbot
scan.lol
Scrapy
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
SEOkicks
SEOprofiler
serpstatbot
SISTRIX
SiteSnagger
SmartDownload
Snake
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
Sogou web spider
Sosospider
Sottopop
Spanner
sp_auditbot
Spbot
Steeler
Stripper
Sucker
Sucuri
Swiftbot
sysscan
Szukacz
T0PHackTeam
tAkeOut
TeleportPro
Telesphorep
The Intraformant
TheNomad
Thumbor
Toata
Tracemyfile
trendiction.com
Turnitin
TurnitinBot
Typhoeus
Vagabondo
Voil
WASALive-Bot
WBSearchBot
Webalta
Web Auto
WebCopier
WEBDAV
Web Enhancer
WebFetch
Web Fuck
WebGo IS
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
WebSauger
Web Sauger
WebsiteExtractor
WebSucker
WebZIP
WeSEE
Whack
Wprecon
WPScan
WWW-Collector-E
x09Mozilla
Xaldon_WebSpider
YoudaoBot
Zade
zgrab
ZmEu
ZumBot