vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-06 23:29:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
koboldcpp/models/ggml-vocab-gpt-neox.gguf
Galunid daab3d7f45
Add more tokenizer tests (#3742) 
* Add more tokenizer tests

* Add starcoder

* Update test vocab files

* Restrict bpe tokenizer tests to unicode planes

* Update comment

* Comment cosmetics

* Remove bloom vocab/test
2023-10-24 09:17:17 +02:00

1.7 MiB
Raw History

View raw