mirror of
https://github.com/ruvnet/RuVector.git
synced 2026-06-01 14:39:33 +00:00
944541677b
Implement state-of-the-art transformer optimizations integrated with mincut coherence: ## Core Features - **λ-based Mixture-of-Depths routing** (mod_routing.rs) Uses mincut λ-delta instead of learned routers for 50% FLOPs reduction Based on Raposo et al. (2024) - **Coherence-driven early exit** (early_exit.rs) λ stability determines self-speculative decoding for 30-50% latency reduction Based on Elhoushi et al. (2024) - **Mincut sparse attention** (sparse_attention.rs) Partition boundaries define sparse masks for 90% attention FLOPs reduction Based on Jiang et al. (2024) - **Energy-based gate policy** (energy_gate.rs) Coherence as energy function with gradient-based refinement Based on Gladstone et al. (2025) - **Spike-driven attention** (attention/spike_driven.rs) Event-driven compute with 87× energy reduction potential Based on Yao et al. (2023, 2024) - **Spectral position encoding** (spectral.rs) Graph Laplacian eigenvectors from mincut structure Based on Kreuzer et al. (2021) ## WASM Bindings - New ruvector-mincut-gated-transformer-wasm crate - Complete JavaScript API for web deployment - Example scorer implementation ## Documentation - docs/THEORY.md: Theoretical foundations and analysis - docs/BENCHMARKS.md: Performance projections - docs/CITATIONS.bib: Complete academic references - README.md: Enhanced with introduction and citations ## Tests - 120+ tests covering all features - Feature-gated test modules - Integration tests for combined features All features are feature-gated for modular compilation. |
||
|---|---|---|
| .. | ||
| micro-hnsw-wasm | ||
| profiling | ||
| ruvector-attention | ||
| ruvector-attention-cli | ||
| ruvector-attention-node | ||
| ruvector-attention-wasm | ||
| ruvector-bench | ||
| ruvector-cli | ||
| ruvector-cluster | ||
| ruvector-collections | ||
| ruvector-core | ||
| ruvector-filter | ||
| ruvector-gnn | ||
| ruvector-gnn-node | ||
| ruvector-gnn-wasm | ||
| ruvector-graph | ||
| ruvector-graph-node | ||
| ruvector-graph-wasm | ||
| ruvector-metrics | ||
| ruvector-mincut | ||
| ruvector-mincut-gated-transformer | ||
| ruvector-mincut-gated-transformer-wasm | ||
| ruvector-mincut-node | ||
| ruvector-mincut-wasm | ||
| ruvector-node | ||
| ruvector-postgres | ||
| ruvector-raft | ||
| ruvector-replication | ||
| ruvector-router-cli | ||
| ruvector-router-core | ||
| ruvector-router-ffi | ||
| ruvector-router-wasm | ||
| ruvector-server | ||
| ruvector-snapshot | ||
| ruvector-tiny-dancer-core | ||
| ruvector-tiny-dancer-node | ||
| ruvector-tiny-dancer-wasm | ||
| ruvector-wasm | ||
| rvlite | ||
| sona | ||