vrr/ruvector
2
0
Fork 0
mirror of https://github.com/ruvnet/RuVector.git synced 2026-05-23 12:55:26 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 19
ruvector/docs
History
rUv 29377e5229 feat(consciousness): SOTA IIT Φ, causal emergence, quantum collapse crate (ADR-131) 
* feat: add ruvector-consciousness crate — SOTA IIT Φ, causal emergence, quantum-collapse

Implements ultra-optimized consciousness metrics as two new Rust crates:

- ruvector-consciousness: Core library with 5 algorithms:
  - Exact Φ (O(2^n·n²)) for n≤20
  - Spectral Φ via Fiedler vector (O(n²·log n))
  - Stochastic Φ via random sampling (O(k·n²))
  - Causal emergence / effective information (O(n³))
  - Quantum-inspired partition collapse (O(√N·n²))
- ruvector-consciousness-wasm: Full WASM bindings for browser/Node.js

Performance optimizations:
- AVX2 SIMD-accelerated dense matvec, KL-divergence, entropy
- Zero-alloc bump arena for hot partition evaluation loops
- Sublinear spectral and quantum-collapse approximations
- Branch-free KL divergence with epsilon clamping

21 tests + 1 doc-test passing.

https://claude.ai/code/session_01BHwVSfCHmPWiZYcWiogrS1

* docs(adr): add ADR-129 for ruvector-consciousness crate

Documents architecture decisions, SOTA research basis, algorithm
selection strategy, performance characteristics, integration points,
and future enhancement roadmap for the consciousness metrics crate.

https://claude.ai/code/session_01BHwVSfCHmPWiZYcWiogrS1

* feat(consciousness): add P1/P2 enhancements — GeoMIP, RSVD emergence, parallel search

- GeoMIP engine: Gray code iteration, automorphism pruning, balance-first
  BFS for 100-300x speedup over exhaustive search (n ≤ 25)
- IIT 4.0 EMD-based information loss (Wasserstein replaces KL-divergence)
- Randomized SVD causal emergence (Halko-Martinsson-Tropp): O(n²·k) vs O(n³),
  computes singular value spectrum, effective rank, spectral entropy
- Parallel partition search via rayon: ParallelPhiEngine + ParallelStochasticPhiEngine
  with thread-local arenas for zero-contention allocation
- WASM bindings: added computePhiGeoMip() and computeRsvdEmergence() methods
- 38 unit tests + 1 doc-test, all passing

https://claude.ai/code/session_01BHwVSfCHmPWiZYcWiogrS1

* feat(consciousness): complete all phases — GreedyBisection, Hierarchical, 5-tier auto-select, integration tests

All PhiAlgorithm enum variants now have real engine implementations:
- GreedyBisectionPhiEngine: spectral seed + greedy element swap, O(n³)
- HierarchicalPhiEngine: recursive spectral decomposition, O(n² log n)
- GeoMIP/Collapse variants added to PhiAlgorithm enum

5-tier auto_compute_phi selection:
  n ≤ 16 → Exact | n ≤ 25 → GeoMIP | n ≤ 100 → GreedyBisection
  n ≤ 1000 → Spectral | n > 1000 → Hierarchical

Testing: 63 tests (43 unit + 19 integration + 1 doc-test), all passing
Benchmarks: 12 criterion benchmarks covering all engines + emergence

Updated ADR-129 with final architecture, implementation status, and test matrix.

https://claude.ai/code/session_01BHwVSfCHmPWiZYcWiogrS1

* feat(consciousness): integrate 5 sibling crates for optimized Φ computation

Add feature-gated cross-crate integrations that accelerate consciousness
computation by leveraging existing RuVector infrastructure:

- sparse_accel: CSR sparse matrices from ruvector-solver for O(nnz·k) spectral Φ
- mincut_phi: MinCut-guided partition search via ruvector-mincut builder API
- chebyshev_phi: Chebyshev polynomial spectral filter from ruvector-math (no eigendecomp)
- coherence_phi: Spectral gap bounds on Φ via ruvector-coherence Fiedler analysis
- witness_phi: Tamper-evident witness chains from ruvector-cognitive-container

All 76 tests passing (56 lib + 19 integration + 1 doc).
Features: solver-accel, mincut-accel, math-accel, coherence-accel, witness.

https://claude.ai/code/session_01BHwVSfCHmPWiZYcWiogrS1

* perf(consciousness): optimize hot paths and deduplicate MI computation

Key optimizations:
- Deduplicate pairwise_mi: 4 identical copies → 1 shared `simd::pairwise_mi`
  with unsafe unchecked indexing in inner loop
- Zero-alloc partition extraction: replace `set_a()`/`set_b()` Vec heap allocs
  with stack-fixed `[usize; 64]` arrays in the hot `partition_information_loss`
- Branchless bit extraction: `(state >> idx) & 1` instead of `if state & (1 << idx)`
- Eliminate per-iteration allocation in sparse Fiedler: remove `.collect::<Vec<_>>()`
  in power iteration loop (was allocating every iteration)
- Convergence-based early exit: Rayleigh quotient monitoring in both dense and
  sparse Fiedler iterations — typically converges 3-5x faster
- Fused Chebyshev recurrence: merge next[i] computation + result accumulation,
  buffer rotation via `mem::swap` instead of allocation per step
- Shared MI builders: `build_mi_matrix()` and `build_mi_edges()` consolidate
  MI graph construction across all 6 spectral engines
- Cache-friendly matvec: extract row slice `&laplacian[i*n..(i+1)*n]` for
  sequential access pattern in dense power iteration

All 75 tests passing, zero warnings.

https://claude.ai/code/session_01BHwVSfCHmPWiZYcWiogrS1

* feat(consciousness): add IIT 4.0 SOTA modules — iit4, CES, ΦID, PID, streaming, bounds

Implement Tier 1 (IIT 4.0 framework) and Tier 2 (algorithm/performance) modules:
- iit4.rs: Intrinsic information (EMD), cause/effect repertoires, mechanism-level φ
- ces.rs: Cause-Effect Structure with distinction/relation computation and big Φ
- phi_id.rs: Integrated Information Decomposition (redundancy/synergy via MMI)
- pid.rs: Partial Information Decomposition (Williams-Beer I_min)
- streaming.rs: Online Φ with EWMA, Welford variance, CUSUM change-point detection
- bounds.rs: PAC-style bounds (spectral-Cheeger, Hoeffding, empirical Bernstein)

All 100 tests pass (80 unit + 19 integration + 1 doc).

https://claude.ai/code/session_01BHwVSfCHmPWiZYcWiogrS1

* feat(brain): integrate IIT 4.0 consciousness compute into pi.ruv.io

Brain server (mcp-brain-server):
- Add POST /v1/consciousness/compute — runs IIT 4.0 algorithms (iit4_phi,
  ces, phi_id, pid, bounds) on user-supplied TPM
- Add GET /v1/consciousness/status — lists capabilities and algorithms
- Add Consciousness + InformationDecomposition brain categories
- Add consciousness_algorithms + consciousness_max_elements to /v1/status
- Add brain_consciousness_compute + brain_consciousness_status MCP tools

pi-brain npm (@ruvector/pi-brain):
- Add consciousnessCompute() and consciousnessStatus() client methods
- Add ConsciousnessComputeOptions/Result TypeScript types
- Add MCP tool definitions for consciousness compute/status

Consciousness crate optimizations:
- cause_repertoire: single-pass O(n) accumulation replaces O(n × purview) nested loop
- intrinsic_difference/selectivity: inline hints for hot-path EMD
- CES: rayon parallel mechanism enumeration for n ≥ 5 elements

https://claude.ai/code/session_01BHwVSfCHmPWiZYcWiogrS1

* perf(consciousness): optimize critical paths — mirror partitions, caching, convergence

- iit4: mirror partition skip (2x speedup), stack buffers for purview ≤64,
  allocation-free selectivity via inline EMD
- pid: pre-compute source marginals once in williams_beer_imin (3-5x speedup)
- streaming: lazy TPM normalization with cache invalidation, O(1) ring buffer
  replacing O(n) Vec::remove(0), reset clears all cached state
- bounds: convergence early-exit in Fiedler estimation via Rayleigh quotient
  delta check, extracted reusable rayleigh_quotient helper
- docs: comprehensive consciousness API documentation

All 100 tests pass.

https://claude.ai/code/session_01BHwVSfCHmPWiZYcWiogrS1

* docs(adr-129): update with IIT 4.0 modules, brain integration, and optimizations

ADR-129 now reflects the complete implementation:
- 6 new SOTA modules: iit4, CES, ΦID, PID, streaming, bounds
- pi.ruv.io REST/MCP integration and NPM client
- 9 performance optimizations (mirror partitions, caching, early-exit)
- Correct test count: 100 tests (was 63)
- Resolved IIT 4.0 migration risk (EMD fully implemented)

https://claude.ai/code/session_01BHwVSfCHmPWiZYcWiogrS1

* feat(brain): enable 4 dormant capabilities — consciousness deploy, sparsifier, SONA, seeds

1. Consciousness compute deployment: add ruvector-consciousness to Docker
   workspace and Dockerfile COPY, strip optional deps for minimal build
2. Background sparsifier: spawn async task 15s after startup to build
   spectral sparsifier for large graphs (>100K edges) without blocking
   health probe
3. SONA trajectory reporting: fix status endpoint to show total recorded
   trajectories instead of currently-buffered (always 0 after drain)
4. Consciousness knowledge seeds: add seed_consciousness optimize action
   with 8 curated IIT 4.0 SOTA entries (Albantakis, Mediano, Williams-Beer,
   Hoel, GeoMIP, streaming, bounds)
5. Crawl category mapping: add Sota, Discovery, Consciousness,
   InformationDecomposition to Common Crawl category handler

All 143 brain server tests pass (3 pre-existing failures in crawl/symbolic).
All 100 consciousness tests pass.

https://claude.ai/code/session_01BHwVSfCHmPWiZYcWiogrS1

* fix(adr): rename consciousness ADR from 129 to 131 (avoid conflict with training pipeline)

ADR-129 is already taken by the RuvLTRA training pipeline.
ADR-130 is the MCP SSE decoupling architecture.

Co-Authored-By: claude-flow <ruv@ruv.net>

* fix(consciousness): resolve clippy warnings for CI

Add crate-level allows for clippy lints in ruvector-consciousness.

Co-Authored-By: claude-flow <ruv@ruv.net>

---------

Co-authored-by: Claude <noreply@anthropic.com>
2026-03-31 16:36:25 -04:00
..
adr feat(consciousness): SOTA IIT Φ, causal emergence, quantum collapse crate (ADR-131) 2026-03-31 16:36:25 -04:00
analysis fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
api fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
architecture fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
benchmarks fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
cloud-architecture fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
cnn feat(demo): add Self-Learning tab with 6 interactive training demos 2026-03-11 19:31:23 -04:00
code-reviews docs: reorganize into subfolders 2026-01-21 23:43:50 -05:00
dag docs(dag): add comprehensive Neural DAG Learning implementation plan 2025-12-29 22:15:55 +00:00
development feat(micro-hnsw-wasm): Add Neuromorphic HNSW v2.3 with SNN Integration (#40) 2025-12-01 22:30:15 -05:00
examples feat(nervous-system): Complete bio-inspired neural architecture implementation 2025-12-28 04:05:08 +00:00
gnn fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
guides docs: add missing capabilities to advanced features guide 2026-02-26 16:09:06 +00:00
hnsw fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
hooks feat(cli): Implement full hooks system in Rust CLI 2025-12-27 01:08:36 +00:00
implementation fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
integration fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
nervous-system docs: reorganize into subfolders 2026-01-21 23:43:50 -05:00
optimization fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
plans/subpolynomial-time-mincut chore(docs): Clean up and reorganize documentation structure 2025-12-25 19:39:44 +00:00
postgres fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
project-phases Clean up repository structure and organize documentation 2025-11-20 19:50:03 +00:00
publishing fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
research Add SOTA gap implementations: hybrid search, MLA, KV-cache, SSM, Graph RAG (#304) 2026-03-27 10:12:48 -04:00
reviews perf(ruvllm): optimize MoE routing with buffer reuse and optional metrics 2026-03-12 23:27:00 -04:00
ruvllm docs: reorganize into subfolders 2026-01-21 23:43:50 -05:00
rvagent feat(rvAgent): Complete DeepAgents Rust Conversion (ADR-093 → ADR-103) (#262) 2026-03-16 09:52:32 -04:00
security feat(rvAgent): Complete DeepAgents Rust Conversion (ADR-093 → ADR-103) (#262) 2026-03-16 09:52:32 -04:00
sparse-inference feat: Add PowerInfer-style sparse inference engine with precision lanes (#106) 2026-01-04 23:40:31 -05:00
sql feat(postgres): Add ruvector-postgres extension with SIMD optimizations (#42) 2025-12-02 09:55:07 -05:00
testing Clean up repository structure and organize documentation 2025-11-20 19:50:03 +00:00
training fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
.gitkeep Clean up repository structure and organize documentation 2025-11-20 19:50:03 +00:00
.nojekyll fix: add .nojekyll to disable Jekyll processing 2026-03-11 17:53:19 -04:00
agi-container.md feat(rvAgent): Complete DeepAgents Rust Conversion (ADR-093 → ADR-103) (#262) 2026-03-16 09:52:32 -04:00
C2-shell-execution-hardening.md feat(rvAgent): Complete DeepAgents Rust Conversion (ADR-093 → ADR-103) (#262) 2026-03-16 09:52:32 -04:00
C8_RESULT_VALIDATION_IMPLEMENTATION.md feat(rvAgent): Complete DeepAgents Rust Conversion (ADR-093 → ADR-103) (#262) 2026-03-16 09:52:32 -04:00
consciousness-api.md feat(consciousness): SOTA IIT Φ, causal emergence, quantum collapse crate (ADR-131) 2026-03-31 16:36:25 -04:00
IMPLEMENTATION-C5.md feat(rvAgent): Complete DeepAgents Rust Conversion (ADR-093 → ADR-103) (#262) 2026-03-16 09:52:32 -04:00
index.html refactor: move CNN demo to docs/cnn/ for shorter URL 2026-03-11 17:52:13 -04:00
INDEX.md fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
moe-routing-optimization-analysis.md perf(ruvllm): optimize MoE routing with buffer reuse and optional metrics 2026-03-12 23:27:00 -04:00
README.md fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
REPO_STRUCTURE.md fix(brain): defer sparsifier build on startup for large graphs 2026-03-24 12:29:52 +00:00
research-openfang.md Add OpenFang project research document 2026-02-26 14:14:58 +00:00

README.md

RuVector Documentation

Complete documentation for RuVector, the high-performance Rust vector database with global scale capabilities.

📚 Documentation Structure

docs/
├── adr/                    # Architecture Decision Records
├── analysis/               # Research & analysis docs
├── api/                    # API references (Rust, Node.js, Cypher)
├── architecture/           # System design docs
├── benchmarks/             # Performance benchmarks & results
├── cloud-architecture/     # Cloud deployment guides
├── code-reviews/           # Code review documentation
├── dag/                    # DAG implementation
├── development/            # Developer guides
├── examples/               # SQL examples
├── gnn/                    # GNN/Graph implementation
├── guides/                 # User guides & tutorials
├── hnsw/                   # HNSW index documentation
├── hooks/                  # Hooks system documentation
├── implementation/         # Implementation details & summaries
├── integration/            # Integration guides
├── nervous-system/         # Nervous system architecture
├── optimization/           # Performance optimization guides
├── plans/                  # Implementation plans
├── postgres/               # PostgreSQL extension docs
├── project-phases/         # Development phases
├── publishing/             # NPM publishing guides
├── research/               # Research documentation
├── ruvllm/                 # RuVLLM documentation
├── security/               # Security audits & reports
├── sparse-inference/       # Sparse inference docs
├── sql/                    # SQL examples
├── testing/                # Testing documentation
└── training/               # Training & LoRA docs

Getting Started

Architecture & Design

API Reference

Performance & Benchmarks

Security

Implementation

Specialized Topics

Development

Research

  • research/ - Research documentation
    • cognitive-frontier/ - Cognitive frontier research
    • gnn-v2/ - GNN v2 research
    • latent-space/ - HNSW & attention research
    • mincut/ - MinCut algorithm research

🚀 Quick Links

For New Users

  1. Start with Getting Started Guide
  2. Try the Basic Tutorial
  3. Review API Documentation

For Cloud Deployment

  1. Read Architecture Overview
  2. Follow Deployment Guide
  3. Apply Performance Optimizations

For Contributors

  1. Read Contributing Guidelines
  2. Review Architecture Decisions
  3. Check Migration Guide

For Performance Tuning

  1. Review Optimization Guide
  2. Run Benchmarks
  3. Check Analysis

📊 Documentation Status

Category Directory Status
Getting Started guides/ ✅ Complete
Architecture architecture/, adr/ ✅ Complete
API Reference api/ ✅ Complete
Performance benchmarks/, optimization/, analysis/ ✅ Complete
Security security/ ✅ Complete
Implementation implementation/, integration/ ✅ Complete
Development development/, testing/ ✅ Complete
Research research/ 📚 Ongoing

Total Documentation: 460+ documents across 60+ directories

🔗 External Resources

Last Updated: 2026-02-26 | Version: 2.0.4 (core) / 0.1.100 (npm) | Status: Production Ready