vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-11 01:24:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

arranged files, updated kobold lite, modified makefile for extra link args on linux, started RWKV implementation

Browse source
This commit is contained in:
Concedo 2023-04-17 17:31:45 +08:00
parent 9581171a9f
commit 763ad172c0
21 changed files with 13597 additions and 46 deletions
Download patch file Download diff file Expand all files Collapse all files

2
otherarch/utils.cpp
View file

@ -293,7 +293,7 @@ gpt_vocab::id gptj_sample_top_p_top_k(
}
}
gptj_sample_top_k(logits_id, top_k);
gptj_sample_top_k(logits_id, top_k > 0 ? std::min(top_k, n_logits) : n_logits);
double maxl = -INFINITY;
for (const auto & kv : logits_id) {