vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-05 12:09:48 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 2
kvcache-ai-ktransformers/ktransformers
History
chenxl f5f79f5c0e [ADD] support multi-gpu qlen>1 q5_k
2024-08-12 11:41:26 +00:00
..
configs Initial commit 2024-07-27 16:06:58 +08:00
ktransformers_ext [ADD] support multi-gpu qlen>1 q5_k 2024-08-12 11:41:26 +00:00
models [ADD] support multi-gpu qlen>1 q5_k 2024-08-12 11:41:26 +00:00
operators [ADD] support multi-gpu qlen>1 q5_k 2024-08-12 11:41:26 +00:00
optimize [ADD] support multi-gpu qlen>1 q5_k 2024-08-12 11:41:26 +00:00
server Initial commit 2024-07-27 16:06:58 +08:00
tests [ADD] support multi-gpu qlen>1 q5_k 2024-08-12 11:41:26 +00:00
util [ADD] support multi-gpu qlen>1 q5_k 2024-08-12 11:41:26 +00:00
website Initial commit 2024-07-27 16:06:58 +08:00
__init__.py [feature] support python 310 and multi instruction 2024-07-31 13:58:17 +00:00
local_chat.py [ADD] support multi-gpu qlen>1 q5_k 2024-08-12 11:41:26 +00:00