ProxyAI/buildSrc
Aliet Expósito García 9d83107dd5
Add support for some extended parameters of llama.cpp(top_k, top_p, min_p, and repeat_penalty) (#311)
* Add support for some extended parameters of llama.cpp(top_k, top_p, min_p, and repeat_penalty)

Added 'top_k,' 'top_p,' 'min_p,' and 'repeat_penalty' fields to the llama.cpp request configuration. The default values for these fields match the defaults of llama.cpp. If left untouched, they do not affect the model's response to the request.

* Bump llm-client

---------

Co-authored-by: Carl-Robert Linnupuu <carlrobertoh@gmail.com>
2023-12-18 11:53:23 +02:00
..
src/main/kotlin Add support for some extended parameters of llama.cpp(top_k, top_p, min_p, and repeat_penalty) (#311) 2023-12-18 11:53:23 +02:00
build.gradle.kts Support you.com gpt-4 model (#233) 2023-10-12 11:18:37 +03:00