Xuan Son Nguyen 958367bf53 server : refactor slot input data, move tokenizer to HTTP thread (#10023) ... * server : refactor slot input data, move tokenizer to HTTP thread * move prompt_tokens.empty() check * fix incorrect if branch * fix infinite generation loop * bring back infill validation * add infill test * try fixing format_infill * fix test * remove redundant code * rename completion to inference * update docs * use llama_tokens everywhere		2024-10-24 21:51:22 +02:00
..
steps
ctx_shift.feature
embeddings.feature
environment.py
infill.feature
issues.feature	server: tests: passkey challenge / self-extend with context shift demo (#5832)	2024-03-02 22:00:14 +01:00
lora.feature
parallel.feature	server : simplify state machine for slot (#9283)	2024-09-06 23:21:29 +02:00
passkey.feature
rerank.feature
results.feature
security.feature	server : better security control for public deployments (#9776)	2024-10-08 13:27:04 +02:00
server.feature	server : Add option to return token pieces in /tokenize endpoint (#9108)	2024-09-12 22:30:11 +02:00
slotsave.feature
wrong_usages.feature