360Spider
404enemy
Abonti
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
Anarchie
Apexoo
archive.org_bot
Attach
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BackWeb
Badass
Battleztar Bazinga
BBBike
BDCbot
BDFetch
Bigfoot
Blackboard
Black Hole
Boardreader
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
Calculon
CCBot
CheeseBot
CheTeam
ChinaClaw
Cloud mapping
Cogentbot
cognitiveseo
Copier
Copyscape
Cosmos
Craftbot
crawler4j
crawler.feedback
crawl.sogou.com
Crescent
Curious
Deusu
Devil
Digincore
Discoverybot
Dispatch
DittoSpyder
Drip
Ebingbong
eCatch
ECCP/1.0
Ecxi
EroCrawler
evc-batch
Ezooms
Firefox/7.0
Flunky
FyberSpider
Genieo
Getintent
Gigablast
G-i-g-a-b-o-t
Go-Ahead-Got-It
Grafula
GrapeshotCrawler
GridBot
Havij
Heritrix
Hloader
HMView
HTMLparser
HTTP::Lite
HTTrack
Iblog
IndeedBot
InfoTekies
instabid
Intelliseek
InternetSeer
internetVista monitor
Iskanie
IstellaBot
JennyBot
JetCar
Jetty
Jorgee
Kenjin Spider
Kozmosbot
Lanshanbot
LeechFTP
LexiBot
Lftp
Lightspeedsystems
Likse
Linkdexbot
LinkScan
LinksManager
LinkWalker
Lipperhey
Lipperhey Spider
Ltx71
lwp-trivial
Magnet
magpie-crawler
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
meanpathbot
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Microsoft URL Control
MIIxpc
Mojeek
Mr.4x3
MSFrontPage
MSIECrawler
Msrabot
muhstik-scan
Musobot
Nameprotect
Navroad
NetAnts
Netcraft
NetLyzer
NetMechanic
NetSpider
Net Vampire
NetZIP
NextGenSearchBot
Niki-bot
Nimbostratus
Ninja
Nmap
Nutch
Octopus
Offline Navigator
OnCrawl
Openfind
OpenVAS
OutfoxBot
Page Analyzer
PageScorer
Papa Foto
Picsearch
PictureFinder
Pimonster
Pi-Monster
Pixray
plumanalytics
Pockey
Psbot
PxBroker
RankActiveLinkBot
RankFlex
Rankivabot
RankurBot
RealDownload
ReGet
RepoMonkey
Rogerbot
RSSingBot
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
Screaming
ScreenerBot
Searchestate
Semrush
SemrushBot
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
SeoSiteCheckup
SISTRIX
Siteimprove
SiteSucker
Sitevigil
SocialRankIOBot
sogouspider
Sosospider
sp_auditbot
SputnikBot
Stripper
Surfbot
Swiftbot
sysscan
T0PHackTeam
T8Abot
tAkeOut
Telesphoreo
The Intraformant
TheNomad
Thumbor
Titan
Tracemyfile
Trendiction
trendiction.com
True_Robot
Turnitin
TurnitinBot
UnisterBot
Vacuum
VCI
VidibleScraper
Virusdie
Voltron
WBSearchBot
Webalta
WebBandit
WebCopier
Web Enhancer
Web Fetch
WebGo IS
WebImageCollector
WebLeacher
webmeup-crawler
WebPix
Web Pix
WebReaper
WebSauger
Webshag
WebsiteExtractor
Website Quester
WebSucker
Web Sucker
WebZIP
Whack
WiseGuys Robot
WISENutbot
Woobot
x09Mozilla
x22Mozilla
Xenu
YoudaoBot
Zitebot
ZmEu