kvcache-ai-ktransformers/ktransformers
2025-03-14 19:49:20 +00:00
..
configs update rope calculation; update modeling.py; update gate for moe 2025-02-01 07:32:21 +00:00
ktransformers_ext fix compilation 2025-03-14 19:49:20 +00:00
models optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
operators Merge pull request #178 from fxzjshm/hip 2025-03-15 02:31:07 +08:00
optimize Merge pull request #178 from fxzjshm/hip 2025-03-15 02:31:07 +08:00
server Merge pull request #842 from BITcyman/fix-openai_chat_completion 2025-03-07 22:56:19 +08:00
tests merge main; Add torch q8 linear 2025-03-14 05:52:07 -04:00
util merge main; Add torch q8 linear 2025-03-14 05:52:07 -04:00
website : refactor local_chat and fix message slice bug in server 2024-11-04 14:02:19 +08:00
__init__.py Update __init__.py 2025-03-07 22:08:48 +08:00
local_chat.py merge main; Add torch q8 linear 2025-03-14 05:52:07 -04:00