mirror of
https://github.com/LostRuins/koboldcpp.git
synced 2026-05-14 08:22:43 +00:00
added termux instructions
This commit is contained in:
parent
f3dbe0a192
commit
77fa26b2b1
2 changed files with 12 additions and 3 deletions
13
README.md
13
README.md
|
|
@ -98,8 +98,17 @@ You can then run koboldcpp anywhere from the terminal by running `koboldcpp` to
|
|||
- You can attempt a CuBLAS build with using the provided CMake file with visual studio. If you use the CMake file to build, copy the `koboldcpp_cublas.dll` generated into the same directory as the `koboldcpp.py` file. If you are bundling executables, you may need to include CUDA dynamic libraries (such as `cublasLt64_11.dll` and `cublas64_11.dll`) in order for the executable to work correctly on a different PC.
|
||||
- Make the KoboldCPP project using the instructions above.
|
||||
|
||||
## Android (Termux) Alternative method
|
||||
- See https://github.com/ggerganov/llama.cpp/pull/1828/files
|
||||
## Compiling on Android (Termux Installation)
|
||||
- [Install and run Termux from F-Droid](https://f-droid.org/en/packages/com.termux/)
|
||||
- Enter the command `termux-change-repo` and choose `Mirror by BFSU`
|
||||
- Install dependencies with `pkg install wget git python` (plus any other missing packages)
|
||||
- Install dependencies `apt install openssl` (if needed)
|
||||
- Clone the repo `git clone https://github.com/LostRuins/koboldcpp.git`
|
||||
- Navigate to the koboldcpp folder `cd koboldcpp`
|
||||
- Build the project `make`
|
||||
- Grab a small GGUF model, such as `wget https://huggingface.co/TheBloke/phi-2-GGUF/resolve/main/phi-2.Q2_K.gguf`
|
||||
- Start the python server `python koboldcpp.py --model phi-2.Q2_K.gguf`
|
||||
- Connect to `http://localhost:5001` on your mobile browser
|
||||
|
||||
## AMD
|
||||
- Please check out https://github.com/YellowRoseCx/koboldcpp-rocm
|
||||
|
|
|
|||
|
|
@ -9884,7 +9884,7 @@ Current version: 107
|
|||
{
|
||||
gentxtspeak = gentxt;
|
||||
}
|
||||
tts_speak(gentxt);
|
||||
tts_speak(gentxtspeak);
|
||||
}
|
||||
|
||||
if(gentxt!="")
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue