9 commits

Author	SHA1	Message	Date
Concedo	3879d84400	Merge branch 'master' into concedo ... # Conflicts: # .devops/tools.sh # CMakeLists.txt # README.md # flake.nix	2023-03-24 19:28:27 +08:00
Georgi Gerganov	3cd8dde0d1	Revert "Fix memory allocation issues and seg faults" ... This reverts commit 4870e455b3. Will provide the correct fix later	2023-03-24 06:22:28 +02:00
Georgi Gerganov	4870e455b3	Fix memory allocation issues and seg faults	2023-03-24 00:11:53 +02:00
Georgi Gerganov	483bab2e3d	Avoid the transposed X branch in the Z = X * Y matrix multiplication (#439) ... Should make results reproducible for different number of threads and batch sizes	2023-03-23 23:22:01 +02:00
Concedo	4ff58f73e5	Merge branch 'master' into concedo	2023-03-22 22:32:11 +08:00
Concedo	86c7457e24	Merge branch 'master' into concedo ... # Conflicts: # .github/workflows/build.yml # CMakeLists.txt # Makefile # README.md # main.cpp	2023-03-22 22:31:45 +08:00
Yusuf Kağan Hanoğlu	d5850c53ca	Add missing header for memcpy (#386) ... fixed: memcpy is not defined	2023-03-22 10:55:45 +02:00
Georgi Gerganov	928480ef5b	Init llama_context_params properly from CLI (#370)	2023-03-22 07:45:14 +02:00
Georgi Gerganov	f5a77a629b	Introduce C-style API (#370) ... * Major refactoring - introduce C-style API * Clean up * Add <cassert> * Add <iterator> * Add <algorithm> .... * Fix timing reporting and accumulation * Measure eval time only for single-token calls * Change llama_tokenize return meaning	2023-03-22 07:32:36 +02:00