80legs
ADmantX
ALittle Client
ASPSeek
Aboundex
Aboundexbot
AhrefsBot
Alexibot
AllSubmitter
Anarchy99
Asterias
AwarioRssBot
AwarioSmartBot
BDFetch
BLEXBot
Bandit
BatchFTP
BetaBot
Bigfoot
BlackWidow
Blow
Bolt
Brandwatch
Buck
Bullseye
CCBot
CODE87
CSHttp
CheTeam
CheeseBot
Cliqzbot
Cloud mapping
Cogentbot
Collector
Copier
Copyscape
Crawling at Home Project
Crescent
Custo
DBLBot
DSearch
DTS Agent
Digincore
DigitalPebble
Dirbuster
Discobot
DomCopBot
DomainStatsBot
Domains Project
Dotbot
Download Wonder
Dragonfly
Drip
EMail Siphon
EasyDL
Ecxi
EirGrabber
EroCrawler
Evil
Extractor
ExtractorPro
Extreme Picture Finder
FDM
FHscan
Freeuploader
Fuzz
G-i-g-a-b-o-t
Genieo
GetWeb
Go-Ahead-Got-It
GoZilla
Gotit
Grabber
Grafula
GrapeFX
GrapeshotCrawler
HTTrack
Haansoft
HaosouSpider
Humanlinks
IDBTE4M
Id-search
Image Sucker
IndeedBot
InfoNaviRobot
InterGET
IstellaBot
JOC Web Spider
JamesBOT
JennyBot
Jetty
Jorgee
Jyxobot
Larbin
Leap
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lmspider
Ltx71
MJ12bot
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
MeanPath Bot
Mediatoolkitbot
Microsoft Data Access
Microsoft URL Control
Minefield
MolokaiBot
Msrabot
Nameprotect
NearSite
Needle
Net Vampire
NetAnts
NetLyzer
NetSpider
NetZIP
Nettrack
Nikto
Ninja
Nmap
Nutch
Offline Explorer
OnCrawl
OpenLinkProfiler
Openfind
Openvas
OrangeSpider
PHPCrawl
PageGrabber
PageScorer
PageThing.com
Panscient
Papa Foto
Picsearch
PictureFinder
Pixray
Pockey
ProPowerBot
ProWebWalker
Pu_iN
PxBroker
PyCurl
Quick-Crawler
RSSingBot
RankActive
RankFlex
RankingBot2
Rankivabot
ReGet
Reaper
RedesScrapy
RepoMonkey
Rogerbot
SEOlyticsCrawler
SEOprofiler
SalesIntelligent
ScrepyBot
Searchestate
SearchmetricsBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
Sitebeam
Siteimprove
Sitevigil
Snake
Sociscraper
Sosospider
SpaceBison
Spanner
Spbot
Stripper
Sucker
Swiftbot
Szukacz
T8Abot
Telesphorep
TheNomad
TightTwatBot
Titan
Toata
Trendiction
Trendictionbot
Turingos
TurnitinBot
URLy Warning
URLy.Warning
VCI
Vacuum
Vagabondo
Virusdie
WBSearchBot
Web Collage
Web Fetch
Web Fuck
WebCopier
WebEnhancer
WebLeacher
WebPix
WebSauger
WebWhacker
WebZIP
Website Quester
WebsiteExtractor
Widow
WinHTTrack
WiseGuys Robot
Xaldon_WebSpider
Zermelo
Zitebot
ZoominfoBot
ZumBot
adscanner
archive.org_bot
arquivo.pt
autoemailspider
check1.exe
eCatch
gopher
heritrix
instabid
ips-agent
linkdexbot
lwp-request
magpie-crawler
meanpathbot
mediawords
oBot
page scorer
plumanalytics
polaris version
ripz
seobility
seocompany.store
seostar
spyfu
sysscan
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
xpymep1.exe
zauba.io
zgrab