kvcache-ai-ktransformers/ktransformers
Azure 3986e2d2cf
Merge pull request #178 from fxzjshm/hip
[Feat] Port to ROCm/HIP
2025-03-15 02:31:07 +08:00
..
configs update rope calculation; update modeling.py; update gate for moe 2025-02-01 07:32:21 +00:00
ktransformers_ext merge main; Add torch q8 linear 2025-03-14 05:52:07 -04:00
models optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
operators Merge pull request #178 from fxzjshm/hip 2025-03-15 02:31:07 +08:00
optimize Merge pull request #178 from fxzjshm/hip 2025-03-15 02:31:07 +08:00
server Merge pull request #842 from BITcyman/fix-openai_chat_completion 2025-03-07 22:56:19 +08:00
tests merge main; Add torch q8 linear 2025-03-14 05:52:07 -04:00
util merge main; Add torch q8 linear 2025-03-14 05:52:07 -04:00
website : refactor local_chat and fix message slice bug in server 2024-11-04 14:02:19 +08:00
__init__.py Update __init__.py 2025-03-07 22:08:48 +08:00
local_chat.py merge main; Add torch q8 linear 2025-03-14 05:52:07 -04:00