vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-06 07:09:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
1404 commits 3 branches 196 tags 374 MiB
Commit graph

2 commits

Author SHA1 Message Date
Georgi Gerganov
fcca0a7004
refact : fix convert script + zero out KV cache to avoid nans (#3523) 
* refact : fix convert script + zero out KV cache to avoid nans

* ggml : silu(-inf) should never happen

* metal : assert various kernel requirements
 2023-10-09 14:32:17 +03:00
ds5t5
f8c90cdbaa
llm : add Refact model (#3329) 
* add refact model

* resolve comments

* rebase to the latest

* solve alibi cpu error

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-10-04 16:23:39 +03:00