vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-10 09:04:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

ollama sync completions mostly working. stupid api.

Browse source
This commit is contained in:
Concedo 2024-11-23 23:31:37 +08:00
parent 2c1a06a07d
commit 62dde8cfb2
2 changed files with 45 additions and 16 deletions
Download patch file Download diff file Expand all files Collapse all files

4
gpttype_adapter.cpp
View file

@ -2533,6 +2533,10 @@ std::string gpttype_detokenize(const std::vector<int> & inputids, bool render_sp
std::string output = "";
for (auto eid : inputids)
{
if(eid<0 || eid>=n_vocab)
{
continue;
}
std::string tokenizedstr = FileFormatTokenizeID(eid, file_format, render_special);
output += tokenizedstr;
}