vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-11 01:24:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

remove script (+8 squashed commit)

Browse source 
Squashed commit:

[bde2e3da] should be working

[1cde82c0] update

[bb6c8676] wip

[66b698d1] wip colab

[9953466a] wip colab

[ae0bedea] json fix

[0aac144f] wip on optimized colab

[ec9f8e96] prepare colab binaries notebook
This commit is contained in:
Concedo 2023-10-22 20:26:18 +08:00
parent fafe999ff9
commit ccf8334651
1 changed files with 6 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

7
colab.ipynb
View file

@ -48,7 +48,12 @@
"%cd /content\r\n",
"!git clone https://github.com/LostRuins/koboldcpp\r\n",
"%cd /content/koboldcpp\r\n",
"!make koboldcpp_cublas LLAMA_CUBLAS=1\r\n",
"kvers = !(cat koboldcpp.py | grep 'KcppVersion = ' | cut -d '\"' -f2)\r\n",
"kvers = kvers[0]\r\n",
"!echo Finding prebuilt binary for {kvers}\r\n",
"!wget -c https://huggingface.co/concedo/koboldcpp/resolve/main/prebuilt_binaries/{kvers}.so\r\n",
"!test -f {kvers}.so && mv {kvers}.so koboldcpp_cublas.so || echo Prebuilt Binary Does Not Exist\r\n",
"!test -f koboldcpp_cublas.so && echo Prebuilt Binary Exists || make koboldcpp_cublas LLAMA_CUBLAS=1\r\n",
"\r\n",
"!wget $Model -O model.ggml\r\n",
"!wget -c https://github.com/cloudflare/cloudflared/releases/latest/download/cloudflared-linux-amd64\r\n",