4064 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Lizonghang	27c996835d	fix undeclared identifier get_page_size	2025-01-29 19:59:02 +04:00
Lizonghang	4b616baed4	fix macos x86_64 available mem estimation	2025-01-29 19:57:06 +04:00
Lizonghang	849b47ccd0	fix auto schedule logic	2025-01-29 13:13:37 +04:00
Lizonghang	e7c6b830e6	fix auto schedule logic	2025-01-29 11:15:45 +04:00
Lizonghang	631daadd92	test	2025-01-28 16:36:47 +04:00
Zonghang Li	36f353e374	check env path before calling fio to ensure we can find it	2025-01-28 13:06:08 +04:00
Zonghang Li	2d649c808d	add /usr/local/bin on darwin	2025-01-28 13:05:25 +04:00
Lizonghang	2934cf3e8e	reserve 200 mib for internal gpu usage	2025-01-27 22:14:12 +04:00
Lizonghang	1ca9e7974b	device_os returns Linux if in Termux	2025-01-27 11:14:21 +04:00
Lizonghang	1e2b934d69	add bounds n[m]<=0 for devices without GPUs	2025-01-27 11:13:09 +04:00
Lizonghang	ac5d63b09e	add explaination for why the output layer weights should be kept in metal shared memory	2025-01-25 23:51:16 +04:00
Lizonghang	1ca9a43bd1	keep the output layer weights in shared memory by default	2025-01-25 23:31:43 +04:00
Lizonghang	f3dd5776eb	fix kappa and memory bounds, account for look-up table and input/output layer delay	2025-01-25 22:31:40 +04:00
Lizonghang	9e4ba4f06a	fix w init error	2025-01-24 20:26:18 +04:00
Lizonghang	4948b1004c	fix device_name() to get device name from host, not from termux	2025-01-24 16:56:23 +04:00
Lizonghang	1c0087e919	rename arg --keep-inp-out-in-metal to --keep-out-in-metal	2025-01-23 23:17:06 +04:00
Lizonghang	5fcf020cfb	use the recommended working set size as metal mem bound, rather than the total physical mem	2025-01-23 23:04:40 +04:00
Lizonghang	fb05f80f89	remove token_embd from metal mem	2025-01-23 16:58:25 +04:00
Lizonghang	92f00303d5	set reserved mem to 100MiB	2025-01-23 16:58:11 +04:00
Lizonghang	38e4a3eaa0	add device_macos_swappable_memory	2025-01-23 16:09:04 +04:00
Lizonghang	78a544d716	add metal mem limit	2025-01-23 16:08:52 +04:00
Zonghang Li	33429ec4e1	add option --keep-inp-out-in-metal	2025-01-22 11:25:09 +04:00
Lizonghang	facb4ea736	add option --keep-inp-out-in-metal and fix bugs in unmap	2025-01-22 11:15:19 +04:00
Lizonghang	ce2ef9699f	fix mapping unmap_fragment error	2025-01-21 22:43:51 +04:00
Lizonghang	189ed92cba	segment mmap range on Metal shared memory to avoid memory waste	2025-01-21 21:07:02 +04:00
Lizonghang	871a27f66a	use user input setup in standalone mode	2025-01-21 21:06:09 +04:00
Lizonghang	0b748060ad	ignore variable unused warning	2025-01-21 21:04:32 +04:00
Lizonghang	c701340719	set minimal disk speed to 500Mbps	2025-01-19 10:09:27 +04:00
Lizonghang	4f5265a78d	fix beta calculation on devices without GPU	2025-01-18 21:32:18 +04:00
Lizonghang	c19891f7db	fix device os detect	2025-01-18 19:56:43 +04:00
Lizonghang	6761ca5358	show device props	2025-01-18 17:25:27 +04:00
Lizonghang	f9d16fbf71	fix manully set layer window and gpu layers	2025-01-18 16:44:26 +04:00
Lizonghang	70bd9db008	fix kappa	2025-01-18 11:51:18 +04:00
Lizonghang	e7fae2acdb	fix cuda mem limitation	2025-01-16 09:48:08 +04:00
Lizonghang	c634c2fcbe	reformat highs log	2025-01-16 09:38:12 +04:00
Lizonghang	94f01993fa	reformat highs log	2025-01-16 09:27:53 +04:00
Zonghang Li	46e99218b4	add arg --cuda-mem	2025-01-16 09:15:34 +04:00
Lizonghang	dab6b2e1c2	fix option USE_HIGHS	2025-01-15 20:50:36 +04:00
Lizonghang	18c96e8042	add option USE_HIGHS	2025-01-15 20:05:49 +04:00
Zonghang Li	790f702d0c	report k and W	2025-01-15 16:55:21 +04:00
Zonghang Li	9bead4291c	fix path not found	2025-01-15 16:55:07 +04:00
Lizonghang	106ff79f08	include conda path only on Linux (if installing highs on Linux via conda)	2025-01-15 13:02:52 +04:00
Zonghang Li	73ed4dec68	add conda path to find highs	2025-01-15 12:16:38 +04:00
Lizonghang	3d75b8576e	add api llama_model_set_n_gpu_layers	2025-01-15 10:48:19 +04:00
Lizonghang	1e1ba5bb91	add api llama_model_set_n_gpu_layers	2025-01-15 10:47:53 +04:00
Lizonghang	9279a2e3ff	fix error in llama_context_n_gpu_layers	2025-01-15 10:08:41 +04:00
Lizonghang	5d9aadf3d5	use highs to solve the allocation program	2025-01-15 10:04:04 +04:00
Lizonghang	b577c10d25	add noreturn flag for monitor	2025-01-07 20:38:11 +04:00
Zonghang Li	0b9720c222	modify default max nodes back to 8192	2025-01-04 19:18:59 +04:00
Zonghang Li	e543fcd55f	fix buf_compute_meta size	2025-01-04 19:16:38 +04:00