vrr/ruvector
2
0
Fork 0
mirror of https://github.com/ruvnet/RuVector.git synced 2026-05-22 11:26:34 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 15
2558 commits 174 branches 48 tags 990 MiB
Commit graph

4 commits

Author SHA1 Message Date
rUv
668c873efb fix: migrate attention/dag/tiny-dancer to workspace versioning and fix all dep version specs 
- ruvector-attention: 0.1.32 → version.workspace = true (2.0.4)
- ruvector-attention-wasm: 0.1.32 → workspace, dep 0.1.31 → 2.0
- ruvector-attention-node: 0.1.0 → workspace, dep already 2.0
- ruvector-dag: 0.1.0 → workspace, add version spec on ruvector-core dep
- ruvector-gnn-wasm: fix malformed Cargo.toml (metadata before version), add version spec
- ruvector-attention-unified-wasm: add version specs, fix category slug
- Update all consumers: ruvector-crv, ruvllm, ruvector-postgres, prime-radiant, rvdna, OSpipe

Published to crates.io:
  ruvector-attention@2.0.4, ruvector-dag@2.0.4, ruvector-tiny-dancer-core@2.0.4,
  ruvector-attention-wasm@2.0.4, ruvector-attention-node@2.0.4,
  ruvector-gnn-wasm@2.0.4, ruvector-gnn-node@2.0.4,
  ruvector-tiny-dancer-wasm@2.0.4, ruvector-tiny-dancer-node@2.0.4,
  ruvector-router-wasm@2.0.4, ruvector-router-ffi@2.0.4, ruvector-router-cli@2.0.4,
  ruvector-attention-unified-wasm@0.1.0

Co-Authored-By: claude-flow <ruv@ruv.net>
 2026-02-23 13:29:46 +00:00
rUv
161f890ddb fix: apply cargo fmt across workspace and fix CI issues 
- Run cargo fmt --all to fix formatting in 362 files across the entire workspace
- Add PGDG repository for PostgreSQL 17 in CI test-all-features and benchmark jobs
- Add missing rvf dependency crates to standalone Dockerfile for domain-expansion
- Add sona-learning and domain-expansion features to standalone Dockerfile build
- Create npu.rs stub for ruvector-sparse-inference (fixes rustfmt resolution error)

Co-Authored-By: claude-flow <ruv@ruv.net>
 2026-02-21 20:56:38 +00:00
rUv
f8870b3c71 feat(rvf): RuVector Format — Universal Cognitive Container SDK (#166) 
* feat(rvf): add RuVector Format universal substrate specification

Research and design for RVF — a streaming, progressive, adaptive, quantum-secure
binary format for vector intelligence. Covers append-only segment model, two-level
tail manifests, temperature tiering, progressive HNSW indexing, epoch-based overlay
system, SIMD-optimized query paths, WASM microkernel for Cognitum tiles, domain
profiles (RVDNA, RVText, RVGraph, RVVision), and post-quantum cryptography.

https://claude.ai/code/session_01DDqjGE51JpsRE3DgUjFyjW

* feat(rvf): add deletion, filtered search, concurrency, and operations specs

Fill four specification gaps in the RVF format design:
- spec/07: Vector deletion lifecycle, JOURNAL_SEG wire format, deletion bitmaps
- spec/08: Filtered search with META_SEG, METAIDX_SEG, filter expression language
- spec/09: Writer locking, reader-writer coordination, versioning, space reclamation
- spec/10: Batch operations API, error codes, network streaming protocol

Also fixes the segment header field conflict between spec/01 and wire/binary-layout.md
(checksum_algo/compression now u8, adds uncompressed_len at 0x38).

https://claude.ai/code/session_01DDqjGE51JpsRE3DgUjFyjW

* feat(rvf): add RuVector Format SDK, 40 examples, MCP server, and documentation

Complete RVF implementation including:
- 12 Rust crates (rvf-types, rvf-wire, rvf-manifest, rvf-index, rvf-quant,
  rvf-crypto, rvf-runtime, rvf-import, rvf-wasm, rvf-node, rvf-server,
  plus integration tests)
- 40 runnable examples covering core storage, agentic AI, production
  patterns, vertical domains, exotic capabilities, runtime targets,
  network/security, POSIX/systems, and network operations
- TypeScript SDK (npm/packages/rvf) with RvfDatabase class
- MCP server (npm/packages/rvf-mcp-server) with stdio and SSE transports
- Node.js N-API bindings (npm/packages/rvf-node)
- WASM package (npm/packages/rvf-wasm)
- ADR-029 (canonical format), ADR-030 (computational container),
  ADR-031 (example repository)
- DNA-style lineage provenance, computational containers (KERNEL_SEG,
  EBPF_SEG), witness chains, TEE attestation, domain profiles
- Superseded ADR annotations for ADR-001, ADR-005, ADR-006, ADR-018-021

Co-Authored-By: claude-flow <ruv@ruv.net>

* feat(rvf): add CLI, WASM store, generate_all, and 46 output .rvf files

- Add rvf-cli crate (665 lines, 9 subcommands: create/ingest/query/delete/status/inspect/compact/derive/serve)
- Add WASM control plane store (alloc_setup, segment, store modules) for ~46 KB binary
- Add generate_all.rs example producing 46 persistent .rvf files in output/
- Add Node.js N-API bindings for lineage, kernel/eBPF, and inspection
- Add npm TypeScript backend/database/types for RVF integration
- Update READMEs with CLI sections, MCP server docs, and crate map (13 crates)
- All 40 examples verified passing

Co-Authored-By: claude-flow <ruv@ruv.net>

* feat(rvf): add Claude Code appliance, improve Quick Start, fix API docs

- Add claude_code_appliance.rs: self-booting RVF with SSH + Claude Code
  install (curl -fsSL https://claude.ai/install.sh | bash), 3 SSH users,
  eBPF filter, 20-package manifest, witness chain, lineage snapshot
- Improve Quick Start: Install section (crate/CLI/npm/WASM/MCP), WASM
  browser example, generate_all reference, expanded Rust crate deps
- Fix embed_kernel/embed_ebpf API docs to match actual signatures
  (u8 params with `as u8` cast, 6-param kernel, Option<&[u8]> btf)
- Update generate_all.rs: add claude_code_appliance generator (47 files)
- Regenerate all 47 output .rvf files

Co-Authored-By: claude-flow <ruv@ruv.net>

* feat(rvf): add RVCOW branching, real kernel/eBPF/launcher, 795 tests

Vector-native copy-on-write branching (ADR-031) with four new segment
types (COW_MAP 0x20, REFCOUNT 0x21, MEMBERSHIP 0x22, DELTA 0x23),
real Linux microkernel builder, QEMU microVM launcher, real eBPF
programs, and 128-byte KernelBinding for tamper-evident kernel-manifest
linkage.

New crates:
- rvf-kernel: Docker-based kernel build, real cpio/newc initramfs builder,
  SHA3-256 verification, prebuilt kernel support (37 tests)
- rvf-launch: QEMU microVM launcher with QMP shutdown, KVM/TCG detection,
  virtio-blk/net port forwarding, kernel extraction (8 tests)
- rvf-ebpf: 3 real BPF C programs (xdp_distance, socket_filter,
  tc_query_route) with clang compilation support (17 tests)

RVCOW runtime:
- CowEngine with read/write paths, write coalescing, snapshot-freeze
- CowMap (flat-array), MembershipFilter (bitmap), CowCompactor
- 3x read performance via pread optimization (1.3us/vector)
- Branch creation: 2.6ms for 10K vectors, child = 162 bytes

Security: 20-finding audit, 7 fixes applied including division-by-zero
guards, integer overflow checks, and KernelBinding::from_bytes_validated().

CLI: 8 new commands (launch, embed-kernel, embed-ebpf, filter, freeze,
verify-witness, verify-attestation, rebuild-refcounts), serve wired to
real rvf-server.

Co-Authored-By: claude-flow <ruv@ruv.net>

* feat(rvf): update README, add crate/npm READMEs, publish to crates.io and npm

- Rewrite README with cognitive container terminology, grouped features,
  4 comparison tables (vs Docker, Vector DBs, Git LFS, SQLite), updated
  benchmarks, architecture diagram, and 45 examples
- Add READMEs for rvf-kernel, rvf-launch, rvf-ebpf, rvf-import crates
- Add READMEs for @ruvector/rvf, rvf-node, rvf-wasm, rvf-mcp-server npm packages
- Fix Cargo.toml metadata (homepage, readme, categories, keywords) and
  add version specs to all path dependencies for crates.io publishing
- Fix clippy warnings in rvf-kernel/initramfs.rs and rvf-launch/lib.rs
- Published to crates.io: rvf-types, rvf-wire, rvf-manifest, rvf-quant,
  rvf-index, rvf-crypto (remaining crates pending rate limit)
- Published to npm: @ruvector/rvf, @ruvector/rvf-node, @ruvector/rvf-wasm,
  @ruvector/rvf-mcp-server

Co-Authored-By: claude-flow <ruv@ruv.net>

* chore: add rvf-kernel, rvf-ebpf, rvf-launch, rvf-server, rvf-import, rvf-cli to workspace

Include all 15 RVF crates plus integration tests and benchmarks in the
root workspace members list so cargo publish can resolve them by name.

Co-Authored-By: claude-flow <ruv@ruv.net>

* feat(rvf): add published packages, cognitive container branding, grouped capabilities

- Add Published Packages section with 13 crates.io + 4 npm tables
- Add Platform Support table (Linux, macOS, Windows, WASM, no_std)
- Expand capability table from 9 to 15 rows in 4 groups
- Rewrite all "How" descriptions in plain language
- Update .rvf diagram to show all 20 segment types
- Rename ADRs: computational container -> cognitive container
- Add emojis to all section headers

Co-Authored-By: claude-flow <ruv@ruv.net>

* feat: update root README with RVF cognitive containers, expanded capabilities

- Update intro: "gets smarter + ships as cognitive container"
- Add self-booting microservice row to Pinecone comparison table
- Expand capabilities from 34 to 42 features with dedicated RVF section
- Update "Think of it as" to include Docker comparison and RVF explanation
- Add RVF collapsed group to Ecosystem (13 crates, 4 npm, install commands)
- Add RVF to Platform & Edge section with install commands
- Add RVF npm packages (4) and Rust crates (13) to package reference
- Add RVF rows to feature comparison table (6 new rows)
- Add ADR-030/031 to ADR list
- Add RVF to Installation table, Project Structure
- Update attention mechanisms count from 39 to 40+
- Update npm count to 49+, Rust crates to 83
- Update footer with crates.io and RVF links

Co-Authored-By: claude-flow <ruv@ruv.net>

* feat: expand comparison table with emojis, cost, audit, branching, single-file

Co-Authored-By: claude-flow <ruv@ruv.net>

* docs: rewrite comparison table in plain language

Co-Authored-By: claude-flow <ruv@ruv.net>

* chore: clean up empty code change sections in the changes log

---------

Co-authored-by: Claude <noreply@anthropic.com>
 2026-02-14 13:14:49 -05:00
rUv
f172643f06 feat(ospipe): RuVector-enhanced personal AI memory for Screenpipe (#163) 
* feat(ospipe): implement OSpipe screenpipe integration with WASM + TypeScript SDK

Adds the OSpipe crate providing a quantum-enhanced screenpipe integration layer:
- Rust core library (7 modules): capture, storage, search, pipeline, safety, config, wasm
- WASM bindings via wasm-bindgen for browser deployment
- TypeScript SDK (@ruvector/ospipe) with SSE streaming and hybrid search
- Frame deduplication, PII safety gate, query routing, cosine similarity search
- 56 tests passing (24 unit + 32 integration), builds for native + wasm32
- Comprehensive ADR with Windows/macOS/Linux/WASM integration plans
- CI stub for cross-platform matrix builds (Linux, Windows, macOS, WASM)

Co-Authored-By: claude-flow <ruv@ruv.net>

* chore(ospipe): add README, fix clippy warnings, optimize dedup and pipeline

- Add comprehensive README.md with features, comparison tables, quick
  start guides, collapsed configuration reference, and API docs
- Fix all default clippy warnings (auto-fix + manual)
- Replace Vec with VecDeque in FrameDeduplicator for O(1) eviction
- Remove redundant frame.clone() in ingestion pipeline (move instead)
- Add is_empty() to WASM OsPipeWasm type
- Fix broken intra-doc link for cfg-gated bindings module
- Remove unused imports in integration tests (FrameContent, SearchConfig)

Co-Authored-By: claude-flow <ruv@ruv.net>

* feat(ospipe): integrate graph, attention, GNN, and quantum crates (Phase 2-4)

Add four new OSpipe modules integrating RuVector crates:

- graph: KnowledgeGraph wrapping ruvector-graph with heuristic entity
  extraction (URLs, emails, @mentions, capitalized phrases), entity/
  relationship CRUD, and frame entity ingestion
- search/reranker: AttentionReranker using ruvector-attention scaled
  dot-product attention for result re-ranking (0.6*attention + 0.4*cosine)
- learning: SearchLearner with EWC (ruvector-gnn) for continual learning
  without catastrophic forgetting, ReplayBuffer for feedback, and
  EmbeddingQuantizer for age-based vector compression
- quantum: QuantumSearch using ruqu-algorithms QAOA for diversity selection,
  Grover-inspired amplitude boosting, and optimal iteration estimation

All modules use cfg-gated dual implementations (native + WASM stub).
60 tests passing (59 integration + 1 doc-test), native + WASM builds clean.

Co-Authored-By: claude-flow <ruv@ruv.net>

* feat(ospipe): complete all 15 gap items — HNSW, persistence, REST API, MMR, safety fixes

Implements all remaining OSpipe features from the gap analysis:

High — Core functionality:
- HNSW indexing via ruvector-core with O(log n) ANN search (HnswVectorStore)
- EmbeddingModel trait + RuvectorEmbeddingModel for pluggable embedding backends
- JSON-file persistence layer (PersistenceLayer) for frames and config
- Axum REST API server matching TypeScript SDK endpoints (/search, /graph, /health, /stats, /route)
- Enhanced search pipeline wired into ingestion (router -> rerank -> quantum diversity)

Medium — Correctness:
- WASM/native routing consistency (aligned keyword sets and priority order)
- WASM/native safety consistency (email detection, deny keywords, CC/SSN patterns)
- MMR (Maximal Marginal Relevance) reranker for diversity vs relevance tradeoff
- Delete and update_metadata APIs on VectorStore and HnswVectorStore
- Email redaction preserves surrounding whitespace (tabs, newlines, multi-space)

Lower — Polish:
- TypeScript SDK: fetchWithRetry with exponential backoff, timeout, AbortSignal
- console_error_panic_hook init in WASM module
- WASM test scaffold (tests/wasm.rs)
- Quantization tiers in config (None -> Scalar -> Product -> Binary by age)
- All clippy warnings resolved (0 warnings)

82 tests passing, 1 doc-test passing, 0 clippy warnings.

Co-Authored-By: claude-flow <ruv@ruv.net>

* chore: update Cargo.lock after OSpipe dependency changes

Co-Authored-By: claude-flow <ruv@ruv.net>

* feat(ospipe): add server binary, WASM build, version-pin deps for publishing

- Add ospipe-server binary with CLI args (--port, --data-dir, --help, --version)
- Add tracing-subscriber for structured logging
- Version-pin all 9 path dependencies for crates.io readiness
- Fix ref -> ref mut for KnowledgeGraph mutable borrow in pipeline
- Fix redundant rustdoc link in embedding.rs
- Update ospipe-wasm package.json to match wasm-pack output filenames
- WASM build produces 145KB binary with full browser API

Build artifacts (not committed, in dist/):
- ospipe-server-linux-x86_64 (1.8MB)
- ospipe-server-linux-arm64 (1.6MB)
- ospipe-server-windows-x86_64.exe (3.9MB)
- ospipe_bg.wasm (145KB)
- @ruvector/ospipe npm tarball (13.9KB)

Co-Authored-By: claude-flow <ruv@ruv.net>

* docs: add OSpipe to root README, publish ospipe + deps to crates.io

Add OSpipe personal AI memory section to root README with features,
comparison table, install commands, and Rust quickstart.

Published to registries:
- ospipe v0.1.0 (crates.io)
- ruvector-delta-core v0.1.0 (crates.io)
- ruvector-cluster v2.0.2 (crates.io)
- ruvector-router-core v2.0.2 (crates.io)
- @ruvector/ospipe v0.1.0 (npm)
- @ruvector/ospipe-wasm v0.1.0 (npm)

Co-Authored-By: claude-flow <ruv@ruv.net>

* fix: add uuid dev-dep for tests, bump rvlite to 0.2.1

- Add uuid to OSpipe dev-dependencies to fix version mismatch in
  integration tests
- Bump rvlite npm package to 0.2.1 (0.2.0 blocked by npm)

Co-Authored-By: claude-flow <ruv@ruv.net>
 2026-02-12 22:45:25 -05:00