vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-15 17:49:42 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge pull request #384 from ubergarm/add-tutorial-notes

Browse source 
Add notes to DeepSeek-R1 tutorial documentation
This commit is contained in:
Atream 2025-02-19 13:46:49 +08:00 • committed by GitHub
commit c9eb1f76f6
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 6 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
doc/en/DeepseekR1_V3_tutorial.md
View file

@ -226,6 +226,7 @@ Intel is currently the only CPU vendor that supports AMX-like instructions, whic
### Easier
* Official Docker images to simplify installation
* Fix the server integration for web API access
* Fix the local chat only accepting a single line prompt (currently \n begins generating prompt)
* Support for more quantization types, including the highly requested dynamic quantization from unsloth
Stay tuned for more updates!

5
doc/zh/DeepseekR1_V3_tutorial_zh.md
View file

@ -160,9 +160,14 @@ DeepSeek 的 MLA 操作符计算密集。虽然全部在 CPU 上运行是可行
5. 为什么选择英特尔 CPU？
英特尔目前是唯一支持 AMX 类似指令的 CPU 供应商，与仅支持 AVX 的替代方案相比，性能显著更好。
## 常见问题解答
### R1 不返回思考过程
注意！如果测试 R1 可能会跳过思考。因此，可以添加参数：`--force_think true`。详细信息在 [常见问题解答](./FAQ.md) 部分中。 <br>
## 问题
* 修复服务器集成功能以实现网络API访问支持
* 修复本地聊天功能仅支持单行提示输入的问题（目前输入换行符(\n)即开始生成提示）
### 更多常见问题解答
[详见](./FAQ.md)