mirror of
https://github.com/ruvnet/RuVector.git
synced 2026-05-27 00:25:10 +00:00
59655d064a
- Add Core ML backend with objc2-core-ml bindings for .mlmodel/.mlmodelc/.mlpackage - Implement ANE optimization kernels with dimension-based crossover thresholds - ANE_OPTIMAL_DIM=512, GPU_CROSSOVER=1536, GPU_DOMINANCE=2048 - Automatic hardware selection based on tensor dimensions - Add hybrid pipeline for intelligent CPU/GPU/ANE workload distribution - Implement LlmBackend trait with generate(), generate_stream(), get_embeddings() - Add streaming token generation with both iterator and channel-based approaches - Enhance autodetect with Core ML model path discovery and capability detection - Add comprehensive ANE benchmarks and integration tests - Fix test failures in autodetect_integration (memory calculation) and serving_integration (KV cache FIFO slot allocation, churn test cleanup) - Add GitHub Actions workflow for ruvllm benchmarks - Create comprehensive v2 release documentation (GITHUB_ISSUE_V2.md) Performance targets: - ANE: 38 TOPS on M4 Pro for matrix operations - Hybrid pipeline: Automatic workload balancing across compute units - Memory: Efficient tensor allocation with platform-specific alignment Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| agentic-synth-ci.yml | ||
| benchmarks.yml | ||
| build-attention.yml | ||
| build-gnn.yml | ||
| build-graph-node.yml | ||
| build-native.yml | ||
| build-router.yml | ||
| build-tiny-dancer.yml | ||
| docker-publish.yml | ||
| edge-net-models.yml | ||
| hooks-ci.yml | ||
| postgres-extension-ci.yml | ||
| publish-all.yml | ||
| RELEASE-FLOW.md | ||
| RELEASE.md | ||
| release.yml | ||
| ruvector-postgres-ci.yml | ||
| ruvllm-benchmarks.yml | ||
| ruvllm-build.yml | ||
| ruvllm-native.yml | ||
| sona-napi.yml | ||
| validate-lockfile.yml | ||