mirror of
https://github.com/ruvnet/RuVector.git
synced 2026-07-09 17:28:42 +00:00
* fix(security): RUSTSEC advisories + clippy hardening in RuVector - Replace all bare `partial_cmp().unwrap()` calls on f32/f64 with `.unwrap_or(Ordering::Equal)` to prevent panics on NaN values in sorting/max-by operations across ruvllm, ruvector-dag, prime-radiant, and rvagent-wasm (12 sites in production code). - Add input validation guards to the HTTP search endpoint: reject k=0, k > 10_000, empty vectors, and vectors exceeding 65_536 dimensions, preventing memory exhaustion via unbounded allocations. - Harden LocalFsBackend::execute in rvagent-cli with env_clear() + safe-env allowlist (SEC-005), deadline-based timeout enforcement, and 1 MB output truncation, matching the security posture of LocalShellBackend. - Remove 129 occurrences of the deprecated `unused_unit = "allow"` lint and 3 occurrences of the removed `clippy::match_on_vec_items` lint from Cargo.toml files workspace-wide; both are no-ops in current Rust/Clippy. - All 653+ tests across ruvector-core, ruvector-server, ruvector-dag, rvagent-cli, and prime-radiant pass with zero failures. Note: `bytes` is already at 1.11.1 (>= 1.10.0); `paste` 1.0.15 is a transitive dependency with no semver fix available upstream; `cargo audit` returns clean. Co-Authored-By: claude-flow <ruv@ruv.net> * fix(ci): cargo fmt + restore workspace unused_unit lint allow - Run cargo fmt --all across all 9 files that drifted from rustfmt style (prime-radiant/energy.rs, ruvector-dag/bottleneck.rs+reasoning_bank.rs, ruvector-server/points.rs, ruvllm/pretrain_pipeline.rs+report.rs+registry.rs, rvagent-cli/app.rs, rvagent-wasm/gallery.rs) - Add [workspace.lints.clippy] unused_unit = "allow" to root Cargo.toml; the per-crate entries removed in the security commit were still needed — moving to workspace-level is cleaner and restores -D warnings CI pass Co-Authored-By: claude-flow <ruv@ruv.net> * fix(ci): remove unneeded unit return type in ruvix bench Removes `-> ()` from the Fn bound in run_benchmark_with_kernel (crates/ruvix/benches/src/ruvix.rs:50) — triggers clippy::unused_unit under -D warnings. Clippy prefers `Fn(&mut Kernel)` without explicit unit return. Co-Authored-By: claude-flow <ruv@ruv.net> * fix(ci): resolve rustfmt and clippy unused_unit failures - Run cargo fmt --all to fix long closure formatting in 9 files (energy.rs, bottleneck.rs, reasoning_bank.rs, points.rs, pretrain_pipeline.rs, report.rs, registry.rs, app.rs, gallery.rs) - Add unused_unit = "allow" to [lints.clippy] in ruvix-bench and ruvector-mincut Cargo.toml files to suppress the unused_unit lint that was previously suppressed globally and now fires on two Fn(&mut T) -> () and FnMut() -> () function bounds Co-Authored-By: claude-flow <ruv@ruv.net> |
||
|---|---|---|
| .. | ||
| fuzz | ||
| src | ||
| tests | ||
| Cargo.toml | ||
| README.md | ||
Ruvector Raft
Raft consensus implementation for Ruvector distributed metadata coordination.
ruvector-raft provides a production-ready Raft consensus implementation for coordinating distributed Ruvector deployments. Ensures strong consistency for cluster metadata, configuration, and leader election. Part of the Ruvector ecosystem.
Why Ruvector Raft?
- Strong Consistency: Linearizable reads and writes
- Leader Election: Automatic failover on leader failure
- Log Replication: Durable, replicated transaction log
- Membership Changes: Dynamic cluster reconfiguration
- Snapshot Support: Log compaction via snapshots
Features
Core Capabilities
- Raft Consensus: Full Raft protocol implementation
- Leader Election: Randomized timeouts, pre-vote protocol
- Log Replication: Pipelined append entries
- Commit Management: Majority-based commit tracking
- State Machine: Generic state machine interface
Advanced Features
- Pre-Vote Protocol: Prevents disruption during network partitions
- Leadership Transfer: Graceful leader handoff
- Read Index: Linearizable reads without log entry
- Learner Nodes: Non-voting members for scaling reads
- Batch Commits: Coalesce multiple entries per commit
Installation
Add ruvector-raft to your Cargo.toml:
[dependencies]
ruvector-raft = "0.1.1"
Quick Start
Create Raft Node
use ruvector_raft::{RaftNode, RaftConfig, StateMachine};
#[tokio::main]
async fn main() -> Result<(), Box<dyn std::error::Error>> {
// Configure Raft node
let config = RaftConfig {
node_id: 1,
peers: vec![2, 3], // Other node IDs
election_timeout_min: Duration::from_millis(150),
election_timeout_max: Duration::from_millis(300),
heartbeat_interval: Duration::from_millis(50),
..Default::default()
};
// Create state machine
let state_machine = MyStateMachine::new();
// Create and start Raft node
let node = RaftNode::new(config, state_machine).await?;
node.start().await?;
// Wait for leader election
node.wait_for_leader().await?;
Ok(())
}
Implement State Machine
use ruvector_raft::{StateMachine, Entry, Snapshot};
struct MyStateMachine {
data: HashMap<String, String>,
}
impl StateMachine for MyStateMachine {
type Command = MyCommand;
type Response = MyResponse;
fn apply(&mut self, entry: &Entry<Self::Command>) -> Self::Response {
match &entry.command {
MyCommand::Set { key, value } => {
self.data.insert(key.clone(), value.clone());
MyResponse::Ok
}
MyCommand::Get { key } => {
MyResponse::Value(self.data.get(key).cloned())
}
MyCommand::Delete { key } => {
self.data.remove(key);
MyResponse::Ok
}
}
}
fn snapshot(&self) -> Snapshot {
Snapshot {
data: bincode::serialize(&self.data).unwrap(),
last_index: self.last_applied,
last_term: self.last_term,
}
}
fn restore(&mut self, snapshot: &Snapshot) {
self.data = bincode::deserialize(&snapshot.data).unwrap();
}
}
Propose Commands
// Propose a command (only succeeds on leader)
let response = node.propose(MyCommand::Set {
key: "foo".to_string(),
value: "bar".to_string(),
}).await?;
// Read with linearizable consistency
let response = node.read_index(MyCommand::Get {
key: "foo".to_string(),
}).await?;
// Check leadership
if node.is_leader().await {
println!("This node is the leader");
}
API Overview
Core Types
// Raft configuration
pub struct RaftConfig {
pub node_id: NodeId,
pub peers: Vec<NodeId>,
pub election_timeout_min: Duration,
pub election_timeout_max: Duration,
pub heartbeat_interval: Duration,
pub max_entries_per_append: usize,
pub snapshot_threshold: u64,
}
// Log entry
pub struct Entry<C> {
pub index: u64,
pub term: u64,
pub command: C,
}
// Snapshot
pub struct Snapshot {
pub data: Vec<u8>,
pub last_index: u64,
pub last_term: u64,
}
// Node state
pub enum NodeState {
Follower,
Candidate,
Leader,
Learner,
}
Node Operations
impl<S: StateMachine> RaftNode<S> {
pub async fn new(config: RaftConfig, state_machine: S) -> Result<Self>;
pub async fn start(&self) -> Result<()>;
pub async fn stop(&self) -> Result<()>;
// Leadership
pub async fn is_leader(&self) -> bool;
pub async fn leader_id(&self) -> Option<NodeId>;
pub async fn wait_for_leader(&self) -> Result<NodeId>;
// Commands
pub async fn propose(&self, command: S::Command) -> Result<S::Response>;
pub async fn read_index(&self, command: S::Command) -> Result<S::Response>;
// Cluster management
pub async fn add_node(&self, node_id: NodeId) -> Result<()>;
pub async fn remove_node(&self, node_id: NodeId) -> Result<()>;
pub async fn transfer_leadership(&self, target: NodeId) -> Result<()>;
}
Architecture
┌────────────────────────────────────────────────────────┐
│ Raft Cluster │
│ │
│ ┌──────────┐ ┌──────────┐ ┌──────────┐ │
│ │ Node 1 │ │ Node 2 │ │ Node 3 │ │
│ │ (Leader) │───▶│(Follower)│ │(Follower)│ │
│ │ │ │ │ │ │ │
│ │ Log: │ │ Log: │ │ Log: │ │
│ │ [1,2,3] │───▶│ [1,2,3] │ │ [1,2,3] │ │
│ └──────────┘ └──────────┘ └──────────┘ │
│ │ ▲ │
│ └───────────────────────────────┘ │
│ AppendEntries RPC │
└────────────────────────────────────────────────────────┘
Related Crates
- ruvector-core - Core vector database engine
- ruvector-cluster - Clustering and sharding
- ruvector-replication - Data replication
Documentation
- Main README - Complete project overview
- API Documentation - Full API reference
- GitHub Repository - Source code
License
MIT License - see LICENSE for details.