360Spider
404checker
80legs
ASPSeek
Aboundex
Acunetix
AfD-Verbotsverfahren
AiHitBot
Aipbot
AllSubmitter
Alligator
Ankit
AwarioRssBot
AwarioSmartBot
BDCbot
BackDoorBot
BackStreet
Backlink-Ceck
Badass
Bandit
Barkrowler
Black Hole
Bolt
Buddy
BunnySlippers
CCBot
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Claritybot
Cloud mapping
Cogentbot
Collector
Cosmos
Crawling at Home Project
CrunchBot
CyotekWebCopy
DSearch
DTS Agent
Digincore
Dirbuster
Discobot
Discoverybot
Dispatch
DnyzBot
DomainStatsBot
Drip
ECCP/1.0
EMail Siphon
EasyDL
FDM
FHscan
Fimap
Firefox/7.0
Flunky
FrontPage
Fuzz
GermCrawler
GetRight
GetWeb
Getintent
Go!Zilla
GrabNet
GrapeshotCrawler
GridBot
HTMLparser
Haansoft
Heritrix
Humanlinks
HybridBot
IRLbot
IlseBot
Image Sucker
IndeedBot
Indy Library
InterGET
IstellaBot
JOC Web Spider
JennyBot
JetCar
Joomla
Kozmosbot
LNSpiderguy
LeechGet
Lftp
Libwhisker
LinkScan
LinkWalker
Linkdexbot
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
Lmspider
MFC_Tear_Sample
MQQBrowser
Mail.RU_Bot
Majestic-SEO
MarkWatch
Mass Downloader
Mb2345Browser
Meanpathbot
MegaIndex.ru
Metauri
Microsoft URL Control
Moblie Safari
Mojolicious
Mozlila
Msrabot
Nameprotect
Navroad
NearSite
Net Vampire
NetAnts
NetLyzer
NetMechanic
NetSpider
Nettrack
Netvibes
Niki-bot
Nimbostratus
Nmap
Nuclei
Nutch
Offline Navigator
OrangeBot
OrangeSpider
OutclicksBot
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageThing.com
Panscient
Petalbot
PictureFinder
PleaseCrawl
ProPowerBot
ProWebWalker
Pump
PxBroker
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
RankFlex
Rankivabot
RankurBot
Re-re
RealDownload
RebelMouse
Recorder
RedesScrapy
RocketCrawler
Rogerbot
SEOkicks
SEOkicks-Robot
SEOstats
SISTRIX
Scrapy
Screaming
ScrepyBot
Searchestate
SearchmetricsBot
Semrush
SeobilityBot
Shodan
Siphon
SiteSnagger
Sitebeam
Siteimprove
SlySearch
Snapbot
SocialRankIOBot
Sogou web spider
Spanner
SputnikBot
Sqworm
Stripper
Sucker
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Teleport
TeleportPro
The Intraformant
TheNomad
Titan
Tracemyfile
Trendiction
Turingos
Turnitin
URLy.Warning
UnisterBot
VCI
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
Voltron
WBSearchBot
WISENutbot
WPScan
WWW::Mechanize
Wallpapers
WallpapersHD
Web Auto
Web Fetch
WebBandit
WebCopier
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebWhacker
WebsiteExtractor
WebsiteQuester
WiseGuys Robot
Woobot
Xaldon_WebSpider
YoudaoBot
Zade
Zitebot
ZmEu
ZumBot
autoemailspider
com.plumanalytics
crawl.sogou.com
crawler4j
eCatch
evc-batch
facebookscraper
gopher
internetVista monitor
ips-agent
mediawords
oBot
plumanalytics
ripz
satoristudio.net
seostar
sexsearcher
spyfu
voyagerx.com
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla