79 commits

Author	SHA1	Message	Date
Lizonghang	fa210d2034	remove duplicate calls	2024-12-29 22:00:17 +04:00
Lizonghang	a7ec685eda	add memcpy speed test	2024-12-29 16:19:08 +04:00
Lizonghang	5b46c4e848	correct GB to GiB	2024-12-28 10:09:43 +04:00
Lizonghang	b2bc836423	reformat	2024-12-28 08:36:24 +04:00
Lizonghang	70811d85b3	remove OOM warning	2024-12-22 11:01:45 +04:00
Lizonghang	b6fd762fa8	fix log	2024-12-21 19:01:00 +04:00
Lizonghang	aa6c352aa2	reverse 128MiB free mem in termux	2024-12-12 21:27:36 +04:00
Lizonghang	1b169f8f37	remove anonpages for repeat count	2024-12-12 20:28:59 +04:00
Zonghang Li	6ea692d974	use small tensors for test on cpu	2024-12-12 15:52:27 +04:00
Lizonghang	b642d70188	fix swappable mem in termux	2024-12-12 15:15:16 +04:00
Lizonghang	fa05a482f8	fix swapout and mmapin delay	2024-12-12 09:58:10 +04:00
Lizonghang	8c491c0fb1	consider swappable mem and swap space in termux	2024-12-11 21:24:37 +04:00
Lizonghang	28ebc6478a	use disk.read_rnd.bw in termux	2024-12-11 14:56:08 +04:00
Lizonghang	dfb37671d3	fix memory count and use sequantial disk read speed on linux	2024-12-11 09:30:02 +04:00
Lizonghang	bef2662d42	fix infinite loop in fio test	2024-12-10 20:58:17 +04:00
Lizonghang	8e9ab45458	fix model bytes counter	2024-12-10 14:57:48 +04:00
Zonghang Li	2d79554694	fix device_physical_memory	2024-12-09 14:42:49 +04:00
Zonghang Li	4104eb5b7a	fix std::max val type	2024-12-09 13:36:53 +04:00
Zonghang Li	a11e0dd0fa	fix device_cgroup_physical_memory in docker container	2024-12-09 13:34:01 +04:00
Lizonghang	d78fa427e7	add memory copy speed test	2024-12-09 10:07:42 +04:00
Lizonghang	cead0f2e5a	device_disk_access_delay: adapt for linux (on termux)	2024-12-08 22:58:08 +04:00
Lizonghang	aad604ec8b	add disk access delay while swapping	2024-12-08 20:07:30 +04:00
Zonghang Li	df813675d0	fix flops count and ram/vram speed test	2024-12-08 10:14:05 +04:00
Lizonghang	26c2ffb5b7	set fio read-job startdelay 1.5s	2024-12-06 17:03:42 +04:00
Lizonghang	a79ab3dde3	device_disk_access_delay: fix delay calculation when physical memory is busy (all mapped tensors will be reloaded)	2024-12-06 16:41:55 +04:00
Lizonghang	f1c1d1b929	add support for Q5_K and fix byte count for Q6_K	2024-12-06 07:59:45 +04:00
Lizonghang	e6f4c009ab	device_disk_access_delay: add delay for loading one row from lookup table	2024-12-05 20:38:28 +04:00
Lizonghang	3c8dbd11fc	device_compute_delay: compatible with the shared memory in Metal	2024-12-05 20:02:13 +04:00
Zonghang Li	5a99c5894d	update test model, enable warm-up and sched	2024-12-05 09:52:16 +04:00
Lizonghang	b9538f048a	add sched in device_flops but disabled by default	2024-12-04 23:54:57 +04:00
Zonghang Li	7521e532c4	device_memory_bw: simulate cache-friendly block access and multi-threading	2024-12-04 15:36:59 +04:00
Zonghang Li	44b4718c8b	recover device_memory_access_delay	2024-12-04 12:29:24 +04:00
Zonghang Li	89aad7880e	fix sysctlbyname on Linux and Win	2024-12-04 12:24:07 +04:00
Lizonghang	585864b05a	add inactive_memory in Mac UMA	2024-12-04 11:56:09 +04:00
Lizonghang	99d48157a0	compatible with Mac ARM64 and x86_64 arch, and ignore memory access delay	2024-12-04 11:33:46 +04:00
Zonghang Li	6d7801de87	fix available_memory calculation	2024-12-04 10:36:43 +04:00
Lizonghang	75a86e4eb1	use internal_mem - purgeable_mem to calculate the available_mem	2024-12-04 10:24:54 +04:00
Lizonghang	bd5e034746	set fio engine to sync if posixaio not loadable	2024-12-04 00:55:50 +04:00
Lizonghang	508c8ae83c	set fio engine to sync if posixaio not loadable	2024-12-04 00:52:01 +04:00
Lizonghang	c3d708862c	use disk read_rnd_bw by default	2024-12-04 00:37:59 +04:00
Lizonghang	7cd4936d58	rename to CPU RAM Read BW	2024-12-04 00:04:22 +04:00
Lizonghang	dc03b6216f	set default page size to 4KB if not available from system	2024-12-03 23:25:47 +04:00
Lizonghang	74dbec5086	set default readahead size to 128KB if permission is needed	2024-12-03 22:55:16 +04:00
Zonghang Li	1a7237636e	add cgroup version detect	2024-11-30 09:48:19 +04:00
Zonghang Li	3074763ed4	fix memory detect in docker container	2024-11-30 09:36:01 +04:00
Zonghang Li	eb25858e87	remove cpus_allowed_policy in fio	2024-11-29 22:16:32 +04:00
Zonghang Li	7e4bb65eab	fix bugs on cpu	2024-11-29 22:06:02 +04:00
Zonghang Li	81fd77033e	add gpu support in device_memory_access_delay	2024-11-29 21:56:01 +04:00
Lizonghang	6f54a12c7d	add gpu support in llama_model_kvcache_size and llama_model_compute_buf_size	2024-11-29 21:06:32 +04:00
Lizonghang	f8e9dc2713	add GPU support in device_compute_delay and device_disk_access_delay	2024-11-29 20:21:22 +04:00