ruvector/examples/onnx-embeddings/docs
rUv 78aea004f6 feat(examples): Add ONNX-Rust embeddings example for RuVector
Reimagined embedding generation using ONNX Runtime in pure Rust:

- Native ONNX inference via ort crate with GPU support (CUDA, TensorRT, CoreML)
- HuggingFace tokenizer integration for 8+ pretrained models
- Multiple pooling strategies (Mean, CLS, Max, etc.)
- SIMD-optimized distance calculations
- Batch processing with parallel execution
- Direct RuVector HNSW index integration
- RAG pipeline support
- WebGPU/CUDA-WASM GPU acceleration with 11 WGSL compute shaders

46 tests pass with GPU feature, comprehensive benchmarks included.
2025-11-29 18:11:26 -05:00
..
GPU_ACCELERATION.md feat(examples): Add ONNX-Rust embeddings example for RuVector 2025-11-29 18:11:26 -05:00