mirror of
https://github.com/LostRuins/koboldcpp.git
synced 2026-10-03 11:35:46 +00:00
2e2d99cfd2
* ci: Add support for CUDA 13.4 ARM64 builds for Windows Added an architecture-specific CUDA 13.4 Windows build entry targeting ARM64. Added a CMake configuration to enable ARM64 CUDA cross-compilation from an x64 Windows environment using the x64-hosted CUDA and MSVC toolchain while linking against the ARM64 CUDA import libraries to produce ggml-cuda.dll. Validated the self-hosted Windows x64 workflow, including toolkit acquisition, CMake configuration, ARM64 CUDA cross-compilation, and packaging. Runtime validation was performed separately on a native ARM64 RTX Spark system using TinyLlama 1.1B Q4_K_M to verify the generated binaries. The ARM64 CUDA job builds only the ggml-cuda.dll backend (LLAMA_BUILD_SERVER=OFF). The release consists of two packages: the main ARM64 release package, which combines the existing ARM64 CPU outputs with ggml-cuda.dll, and a separate runtime package containing the required CUDA runtime libraries (cudart64_13.dll, cublas64_13.dll, and cublasLt64_13.dll). The CUDA 13.4 setup uses NVIDIA Developer Preview component archives instead of the GA component downloads used by the existing CUDA setups and will require updates once CUDA 13.4 reaches GA. * ci: cleans up to align with x64 CUDA setup - Moves CUDA-specific CMake options into matrix defines. - Keeps the CUB 3DOT2 option only for CUDA 12.4. - Removes runtime argument construction and the unnecessary server option. - Aligns ARM64 CUDA runtime packaging with the existing robocopy approach. - Generalizes the ARM64 release label from CUDA 13.4 to CUDA 13. * ci: Set CUDA job name as version-architecture pair * mark as preview Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> --------- Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@huggingface.co> Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> |
||
|---|---|---|
| .. | ||
| ai-issues.yml | ||
| bench.yml.disabled | ||
| build-3rd-party.yml | ||
| build-and-test-snapdragon.yml | ||
| build-android.yml | ||
| build-apple.yml | ||
| build-cache.yml | ||
| build-cann.yml | ||
| build-cmake-pkg.yml | ||
| build-cpu.yml | ||
| build-cross.yml | ||
| build-cuda-ubuntu.yml | ||
| build-cuda-windows.yml | ||
| build-ibm.yml | ||
| build-msys.yml | ||
| build-opencl.yml | ||
| build-openvino.yml | ||
| build-riscv.yml | ||
| build-rpc.yml | ||
| build-sanitize.yml | ||
| build-self-hosted.yml | ||
| build-sycl.yml | ||
| build-virtgpu.yml | ||
| build-vulkan.yml | ||
| build-wasm.yml | ||
| build-webgpu.yml | ||
| check-vendor.yml | ||
| close-issue.yml | ||
| code-style.yml | ||
| copilot-setup-steps.yml | ||
| docker.yml | ||
| editorconfig.yml | ||
| gguf-publish.yml | ||
| hip-quality-check.yml | ||
| labeler.yml | ||
| pr-draft-label.yml | ||
| pre-tokenizer-hashes.yml | ||
| python-check-requirements.yml | ||
| python-lint.yml | ||
| python-type-check.yml | ||
| release.yml | ||
| server-sanitize.yml | ||
| server-self-hosted.yml | ||
| server.yml | ||
| ui-build-self-hosted.yml | ||
| ui-build.yml | ||
| ui-publish.yml | ||
| ui-self-hosted.yml | ||
| ui.yml | ||
| update-ops-docs.yml | ||
| winget.yml | ||