vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-11 09:34:37 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge remote-tracking branch 'origin/master' into concedo

Browse source
This commit is contained in:
Concedo 2023-03-18 10:52:54 +08:00
commit a19b5a4adc
17 changed files with 600 additions and 79 deletions
Download patch file Download diff file Expand all files Collapse all files

2
main.cpp
View file

@ -846,6 +846,8 @@ int main(int argc, char ** argv) {
std::vector<float> logits;
// Add a space in front of the first character to match OG llama tokenizer behavior
params.prompt.insert(0, 1, ' ');
// tokenize the prompt
std::vector<gpt_vocab::id> embd_inp = ::llama_tokenize(vocab, params.prompt, true);