mirror of
https://github.com/ruvnet/RuVector.git
synced 2026-05-22 19:56:25 +00:00
transformer.rs (416 lines): complete forward pass in std Rust - Multi-head self-attention with padding mask - GELU activation, layer norm, softmax - Loads weights from simple binary format (2.6MB) - Zero external deps — just f32 math neural.rs: Backend enum (Transformer/ONNX/Stub) - .bin → pure Rust (always available, no feature flag) - .onnx → ort (behind neural feature flag) - .gguf/.rvf → stub for future RuvLLM integration export-weights-bin.py: PyTorch → binary weight dump - 42 tensors, 673,152 parameters, 2.6MB output 56 tests passing, zero warnings. Co-Authored-By: claude-flow <ruv@ruv.net>
2.6 MiB
2.6 MiB