vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-09 05:54:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge pull request #1436 from kvcache-ai/Atream-patch-4

Browse source 
Update Kimi-K2.md
This commit is contained in:
Atream 2025-07-12 11:58:25 +08:00 • committed by GitHub
commit df19681ec4
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 3 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

3
doc/en/Kimi-K2.md
View file

@ -5,6 +5,9 @@
### Overview ### Overview
We are very pleased to announce that Ktransformers now supports Kimi-K2. We are very pleased to announce that Ktransformers now supports Kimi-K2.
On a single-socket CPU with one consumer-grade GPU, running the Q4_K_M model yields roughly 10 TPS and requires about 600 GB of VRAM.
With a dual-socket CPU and sufficient system memory, enabling NUMA optimizations increases performance to about 14 TPS.
### Model & Resource Links ### Model & Resource Links
- Official Kimi-K2 Release: - Official Kimi-K2 Release: