mirror of
https://github.com/LostRuins/koboldcpp.git
synced 2026-07-10 01:18:32 +00:00
other sdcpp files for gemma and fix cmake
This commit is contained in:
parent
541034d72d
commit
0f74dcb11f
3 changed files with 514908 additions and 0 deletions
|
|
@ -512,6 +512,7 @@ add_library(sdtype_adapter
|
|||
otherarch/sdcpp/tokenizers/qwen2_tokenizer.cpp
|
||||
otherarch/sdcpp/tokenizers/t5_unigram_tokenizer.cpp
|
||||
otherarch/sdcpp/tokenizers/gemma_tokenizer.cpp
|
||||
otherarch/sdcpp/tokenizers/gpt_oss_tokenizer.cpp
|
||||
otherarch/sdcpp/tokenizers/tokenizer.cpp
|
||||
otherarch/sdcpp/tokenizers/tokenize_util.cpp
|
||||
otherarch/sdcpp/ggml_extend_backend.cpp)
|
||||
|
|
|
|||
514906
embd_res/gemma2_merges_utf8_c_str.embd
Normal file
514906
embd_res/gemma2_merges_utf8_c_str.embd
Normal file
File diff suppressed because it is too large
Load diff
1
embd_res/gemma2_vocab_json.embd
Normal file
1
embd_res/gemma2_vocab_json.embd
Normal file
File diff suppressed because one or more lines are too long
Loading…
Add table
Add a link
Reference in a new issue