vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-16 11:59:42 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fixed rwkv, standardized new ctx usage

Browse source
This commit is contained in:
Concedo 2023-07-10 20:05:53 +08:00
parent 2827920044
commit 523fc3be52
8 changed files with 27 additions and 8 deletions
Download patch file Download diff file Expand all files Collapse all files

4
otherarch/utils.h
View file

@ -54,4 +54,6 @@ std::vector<gpt_vocab::id> gpt_tokenize(const gpt_vocab & vocab, const std::stri
bool should_transpose_layer(std::string name);
bool should_transpose_layer(std::string name);
void kcpp_graph_compute_helper(ggml_cgraph * graph, int n_threads);