80legs
AIBOT
Abonti
Aboundexbot
AiHitBot
Aipbot
AlphaBot
Anarchy
Ankit
Aspiegel
Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BackDoorBot
BackStreet
BackWeb
Badass
Bandit
Battleztar Bazinga
Blackboard
Boardreader
Bolt
Brandwatch
Buck
BuiltBotTough
Bullseye
CODE87
CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
Cogentbot
Copier
Copyscape
Craftbot
DSearch
DataCha0s
Disco
Dispatch
DnBCrawler-Analytics
Download Wonder
Dragonfly
EMail Siphon
EirGrabber
Exabot
Extractor
ExtractorPro
EyeNetIE
FemtosearchBot
Fimap
Flunky
Freeuploader
G-i-g-a-b-o-t
GT::WWW
GetWeb
GrabNet
Grabber
Grafula
Haansoft
Heritrix
Hloader
Humanlinks
IDBTE4M
IRLbot
Id-search
IlseBot
Image Fetch
Image Sucker
Intelliseek
JOC Web Spider
JamesBOT
JennyBot
JikeSpider
Joomla
Keybot Translation-Search-Machine
Kinza
LWP::Simple
Larbin
Lftp
Libwhisker
Lightspeedsystems
Linkbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIDown tool
MSIECrawler
Mag-Net
Mail.RU_Bot
Majestic SEO
Mass Downloader
MeanPath Bot
MicroMessenger
Microsoft Data Access
Moblie Safari
Mojolicious
MolokaiBot
Musobot
Name Intelligence
Navroad
Nessus
Net Vampire
NetAnts
NetSpider
NextGenSearchBot
Nibbler
Niki-bot
Nimbostratus
Ninja
Not
Nuclei
OnCrawl
OpenLinkProfiler
Openfind
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageThing.com
Pandalytics
Panscient
Pavuk
Petalbot
Pimonster
Pockey
ProWebWalker
Pump
QueryN Metasearch
RankActiveLinkBot
RankingBot
RankingBot2
RedesScrapy
RepoMonkey
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
SearchmetricsBot
SemanticJuice
SeobilityBot
Siphon
SiteSnagger
SiteSucker
Sitebeam
Sitevigil
SlySearch
SmartDownload
Snake
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
SpaceBison
SpankBot
Spanner
Spbot
Stripper
SuperBot
Surfbot
Swiftbot
Szukacz
Teleport
TeleportPro
Telesoft
Telesphoreo
TheNomad
Titan
Tracemyfile
Trendiction
Trendictionbot
TurnitinBot
URLy.Warning
Upflow
VCI
Vacuum
Vagabondo
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WBSearchBot
WEBDAV
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
WallpapersHD
Web Collage
Web Fuck
WebFuck
WebPix
WebReaper
WebStripper
WebZIP
Website Quester
Whack
WinHTTrack
WiseGuys Robot
Xaldon_WebSpider
YoudaoBot
ZoominfoBot
ZyBorg
archive.org_bot
arquivo-web-crawler
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j
domainsproject.org
eCatch
evc-batch
gopher
instabid
internetVista monitor
isitwp.com
linkdexbot
magpie-crawler
mediawords
netEstate NE Crawler
pcBrowser
plumanalytics
ripz
satoristudio.net
scan.lol
seostar
siteripz
sogouspider
spyfu
ubermetrics-technologies.com
webgains-bot
webpros.com
webprosbot
x09Mozilla