vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-12 18:09:42 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

fixed rwkv, standardized new ctx usage

Browse source
This commit is contained in:
Concedo 2023-07-10 20:05:53 +08:00
parent 2827920044
commit 523fc3be52
8 changed files with 27 additions and 8 deletions
Download patch file Download diff file Expand all files Collapse all files

2
otherarch/gpt2_v3.cpp
View file

@ -707,7 +707,7 @@ bool gpt2_eval(
// run the computation
ggml_build_forward_expand(&gf, inpL);
ggml_graph_compute_with_ctx(ctx0, &gf, n_threads);
kcpp_graph_compute_helper(&gf, n_threads);
//if (n_past%100 == 0) {
// ggml_graph_print (&gf);