360Spider
80legs
ADmantX
AIBOT
Acunetix
AiHitBot
AlphaBot
Anarchy
Ankit
Asterias
BDFetch
BLEXBot
BackDoorBot
Backlink-Ceck
Barkrowler
Bigfoot
BlackWidow
BlowFish
Bolt
Brandwatch
Buck
Bullseye
Calculon
Cegbfeieh
CensysInspect
CheTeam
Collector
Copier
Cosmos
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
Curious
DIIbot
Deusu
Devil
DomCopBot
DomainAppender
DomainCrawler
Download Wonder
Drip
ECCP/1.0
EMail Wolf
Ebingbong
EirGrabber
Evil
Exabot
Express WebPictures
ExtLinksBot
EyeNetIE
Firefox/7.0
FlashGet
Foobot
Freeuploader
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetRight
Getintent
Gigabot
Go!Zilla
Go-Ahead-Got-It
GridBot
HTTrack
Harvest
Heritrix
Humanlinks
IRLbot
Id-search
Image Sucker
Indy Library
InfoNaviRobot
Internet Ninja
JetCar
JustView
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LNSpiderguy
LWP::Simple
Larbin
Leap
LeechFTP
LexiBot
Lftp
LibWeb
LieBaoFast
Likse
LinkWalker
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MJ12bot
MSFrontPage
MSIECrawler
MTRobot
Magnet
Majestic-SEO
Majestic12
MarkWatch
Mata Hari
MauiBot
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Mojeek
Mojolicious
Morfeus Fucking Scanner
NPbot
Needle
Nessus
Net Vampire
NetAnts
NetLyzer
NetMechanic
NetSpider
Nettrack
NextGenSearchBot
Nibbler
Niki-bot
Nimbostratus
Nmap
Nuclei
OpenLinkProfiler
Openfind
OrangeBot
OutfoxBot
PECL::HTTP
PHPCrawl
PageScorer
PageThing.com
Pandalytics
Panscient
Papa Foto
PleaseCrawl
Pockey
ProPowerBot
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankFlex
RankurBot
Re-re
Reaper
Recorder
RepoMonkey
SalesIntelligent
ScanAlert
Scanbot
Searchestate
SeoSiteCheckup
SeobilityBot
Siphon
SiteLockSpider
SiteSucker
Siteimprove
SmartDownload
Spbot
SputnikBot
Sqlworm
Sqworm
Stripper
Sucker
SuperBot
SurveyBot
T8Abot
Teleport
TeleportPro
Telesoft
The Intraformant
TheNomad
Thumbor
TightTwatBot
Trendiction
True_Robot
Turnitin
Typhoeus
URLy Warning
V-BOT
Vagabondo
Virusdie
Voltron
WASALive-Bot
WEBDAV
WPScan
WWW-Collector-E
WWW-Mechanize
Wallpapers/3.0
WallpapersHD
Web Collage
Web Fetch
Web Fuck
Web Sucker
WebAuto
WebCollage
WebEnhancer
WebFetch
WebFuck
WebImageCollector
Website Quester
WebsiteExtractor
WebsiteQuester
Whacker
Who.is Bot
WiseGuys Robot
Wonderbot
Wprecon
Zauba
adscanner
autoemailspider
check1.exe
clark-crawler
com.plumanalytics
crawler4j
dataforseo.com
domainsproject.org
eCatch
instabid
internetVista monitor
lwp-request
lwp-trivial
meanpathbot
mediawords
netEstate NE Crawler
pcBrowser
scalaj-http
seobility
serpstatbot
sogouspider
sysscan
voyagerx.com
webgains-bot
webpros.com
webprosbot
x22Mozilla
zauba.io
zgrab