12 commits

Author	SHA1	Message	Date
Atream	885a91e7db	Merge pull request #294 from kvcache-ai/feat-fast-MLA ... Feat fast mla	2025-02-14 19:40:36 +08:00
Atream	1084d4e4b4	linux support triton MLA kernel	2025-02-14 11:38:55 +00:00
Atream	bb35dc5b0d	init support for MLA using Attention kernel	2025-02-13 15:01:14 +00:00
Azure	3897f001f5	update FAQ	2025-02-12 08:50:58 +00:00
Azure	907251c743	done support deepseekv3	2025-02-04 15:53:38 +00:00
Azure	f748cd29f0	fix rope; update moegate	2025-02-01 18:05:45 +00:00
Azure	f873558a89	update rope calculation; update modeling.py; update gate for moe	2025-02-01 07:32:21 +00:00
Azure	5a50b34627	fix hard coding caused by rope dim calculation, load from config now	2025-01-31 15:25:50 +00:00
Azure	476b1d8dc6	support deepseekv3; runable but have precition problem	2025-01-31 08:27:24 +00:00
chenxl	4d1d561d28	[feature] release 0.1.3	2024-08-28 16:11:43 +00:00
chenxl	f5f79f5c0e	[ADD] support multi-gpu qlen>1 q5_k	2024-08-12 11:41:26 +00:00
chenxl	18c42e67df	Initial commit	2024-07-27 16:06:58 +08:00