12 commits

Author	SHA1	Message	Date
ceerrep	5ac266085e	fix: use flash_attn for faster prefill	2025-02-17 00:11:24 +08:00
Azure	ff6b265e53	Mock triton mla due to precision issue	2025-02-16 06:03:12 +00:00
Atream	92399283b6	Update attention.py	2025-02-15 15:43:35 +08:00
Atream	1084d4e4b4	linux support triton MLA kernel	2025-02-14 11:38:55 +00:00
Atream	bb35dc5b0d	init support for MLA using Attention kernel	2025-02-13 15:01:14 +00:00
Azure	907251c743	done support deepseekv3	2025-02-04 15:53:38 +00:00
Azure	f873558a89	update rope calculation; update modeling.py; update gate for moe	2025-02-01 07:32:21 +00:00
Azure	476b1d8dc6	support deepseekv3; runable but have precition problem	2025-01-31 08:27:24 +00:00
Azure	c55de02f7b	fix qlen > 1000 mask is none error	2024-09-02 02:58:10 +00:00
chenxl	4d1d561d28	[feature] release 0.1.3	2024-08-28 16:11:43 +00:00
TangJingqi	67043b4b5c	[fix] format classes and files name	2024-08-15 10:44:59 +08:00
chenxl	18c42e67df	Initial commit	2024-07-27 16:06:58 +08:00