vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-14 10:59:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

update lite and colab (+1 squashed commits)

Browse source 
Squashed commits:

[06b6ca6d] updated lite and colab
This commit is contained in:
Concedo 2023-10-22 13:55:55 +08:00
parent cff75061fe
commit fafe999ff9
3 changed files with 31 additions and 12 deletions
Download patch file Download diff file Expand all files Collapse all files

19
colab.ipynb
View file

@ -1,5 +1,5 @@
{
"cells": [
"cells": [
{
"cell_type": "markdown",
"metadata": {
@ -10,19 +10,20 @@
"<a href=\"https://colab.research.google.com/github/LostRuins/koboldcpp/blob/concedo/colab.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
]
},
{
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Welcome to the Official KoboldCpp Colab Notebook\r\n",
"It's really easy to get started. Just press the two Play buttons below, and then connect to the cloudflare URL shown at the end. \r\nYou can also change the model URL to use any GGUF model from Huggingface."
"It's really easy to get started. Just press the two **Play** buttons below, and then connect to the **Cloudflare URL** shown at the end. \r\n",
"You can also change the model URL to use any GGUF model from Huggingface."
]
},
{
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"execution_count": null,
"outputs": [],
"outputs": [],
"source": [
"#@title <-- Tap this if you play on Mobile { display-mode: \"form\" }\r\n",
"%%html\r\n",
@ -47,7 +48,7 @@
"%cd /content\r\n",
"!git clone https://github.com/LostRuins/koboldcpp\r\n",
"%cd /content/koboldcpp\r\n",
"!make LLAMA_CUBLAS=1\r\n",
"!make koboldcpp_cublas LLAMA_CUBLAS=1\r\n",
"\r\n",
"!wget $Model -O model.ggml\r\n",
"!wget -c https://github.com/cloudflare/cloudflared/releases/latest/download/cloudflared-linux-amd64\r\n",
@ -55,7 +56,7 @@
"!nohup ./cloudflared-linux-amd64 tunnel --url http://localhost:5001 &\r\n",
"!sleep 8\r\n",
"!cat nohup.out\r\n",
"!python koboldcpp.py model.ggml --usecublas 0 mmq --multiuser --gpulayers $Layers --hordeconfig concedo 1 1 --onready \"cat nohup.out\"\r\n"
"!python koboldcpp.py model.ggml --usecublas 0 mmq --multiuser --gpulayers $Layers --hordeconfig concedo 1 1 --onready \"echo Connect to the link below && cat nohup.out | grep trycloudflare.com\"\r\n"
]
}
],