rUv
|
78aea004f6
|
feat(examples): Add ONNX-Rust embeddings example for RuVector
Reimagined embedding generation using ONNX Runtime in pure Rust:
- Native ONNX inference via ort crate with GPU support (CUDA, TensorRT, CoreML)
- HuggingFace tokenizer integration for 8+ pretrained models
- Multiple pooling strategies (Mean, CLS, Max, etc.)
- SIMD-optimized distance calculations
- Batch processing with parallel execution
- Direct RuVector HNSW index integration
- RAG pipeline support
- WebGPU/CUDA-WASM GPU acceleration with 11 WGSL compute shaders
46 tests pass with GPU feature, comprehensive benchmarks included.
|
2025-11-29 18:11:26 -05:00 |
|