vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-10 17:14:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

added a token counting endpoint, set mmq as default

Browse source
This commit is contained in:
Concedo 2023-08-24 20:41:49 +08:00
parent 81a0ef342c
commit b95a4ccb22
5 changed files with 72 additions and 28 deletions
Download patch file Download diff file Expand all files Collapse all files

6
expose.cpp
View file

@ -240,4 +240,10 @@ extern "C"
bool abort_generate() {
return gpttype_generate_abort();
}
int token_count(const char * input)
{
std::string inputstr = input;
return gpttype_token_count(inputstr);
}
}