vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-08 21:49:39 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
kvcache-ai-ktransformers/ktransformers
History
Chen Hongtao 43fc7f44a6
Merge pull request #99 from chenht2022/main 
Adapt Windows
2024-10-09 19:09:58 +08:00
..
configs [feature] release 0.1.3 2024-08-28 16:11:43 +00:00
ktransformers_ext Adapt Windows 2024-10-09 11:08:32 +00:00
models [feature] release 0.1.3 2024-08-28 16:11:43 +00:00
operators typo fix: KMisrtal -> KMistral 2024-09-12 15:58:01 +00:00
optimize typo fix: KMisrtal -> KMistral 2024-09-12 15:58:01 +00:00
server [feature] release 0.1.3 2024-08-28 16:11:43 +00:00
tests [fix] format classes and files name 2024-08-15 10:44:59 +08:00
util Merge pull request #77 from TKONIY/fix-prefill-and-generate 2024-10-09 19:04:27 +08:00
website Initial commit 2024-07-27 16:06:58 +08:00
__init__.py update yaml example; update version idx; update docker file 2024-08-29 22:39:20 +08:00
local_chat.py Fix cannot offload whole layer in cpu 2024-08-29 19:10:14 +08:00