TangJingqi 170b7a6001 fix server don't accept yaml path as param; fix server static cache device problem		2024-08-21 14:19:43 +08:00
..
configs	Initial commit	2024-07-27 16:06:58 +08:00
ktransformers_ext	[feature] support q2_k & q3_k dequantize on gpu	2024-08-12 12:53:12 +00:00
models	[ADD] support multi-gpu qlen>1 q5_k	2024-08-12 11:41:26 +00:00
operators	[fix] format classes and files name	2024-08-15 10:44:59 +08:00
optimize	Update readme; add pipeline tutorial; add detailed inject tutorial	2024-08-15 20:42:54 +08:00
server	fix server don't accept yaml path as param; fix server static cache device problem	2024-08-21 14:19:43 +08:00
tests	[fix] format classes and files name	2024-08-15 10:44:59 +08:00
util	[feature] experts can be injected using CPUInfer	2024-08-14 16:10:54 +08:00
website	Initial commit	2024-07-27 16:06:58 +08:00
__init__.py	[feature] add github action for pre compile	2024-08-14 16:54:50 +00:00
local_chat.py	[ADD] support multi-gpu qlen>1 q5_k	2024-08-12 11:41:26 +00:00