vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-16 20:09:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge branch 'master' into concedo_experimental

Browse source 
# Conflicts:
#	.github/workflows/docker.yml
#	CMakeLists.txt
#	Makefile
#	README.md
#	llama.cpp
#	tests/test-grad0.cpp
This commit is contained in:
Concedo 2023-12-22 14:40:13 +08:00
commit 230a638512
27 changed files with 1075 additions and 1005 deletions
Download patch file Download diff file Expand all files Collapse all files

2
otherarch/gpt2_v3.cpp
View file

@ -564,7 +564,7 @@ bool gpt2_eval(
struct ggml_tensor * KQ_scaled =
ggml_scale_inplace(ctx0,
KQ,
ggml_new_f32(ctx0, 1.0f/sqrt(float(n_embd)/n_head))
1.0f/sqrt(float(n_embd)/n_head)
);
// KQ_masked = mask_past(KQ_scaled)