From 77fa26b2b16700d1e14f6bb6979d5437d81abe41 Mon Sep 17 00:00:00 2001 From: Concedo <39025047+LostRuins@users.noreply.github.com> Date: Wed, 24 Jan 2024 20:12:46 +0800 Subject: [PATCH] added termux instructions --- README.md | 13 +++++++++++-- klite.embd | 2 +- 2 files changed, 12 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index e747ba469..cc2400503 100644 --- a/README.md +++ b/README.md @@ -98,8 +98,17 @@ You can then run koboldcpp anywhere from the terminal by running `koboldcpp` to - You can attempt a CuBLAS build with using the provided CMake file with visual studio. If you use the CMake file to build, copy the `koboldcpp_cublas.dll` generated into the same directory as the `koboldcpp.py` file. If you are bundling executables, you may need to include CUDA dynamic libraries (such as `cublasLt64_11.dll` and `cublas64_11.dll`) in order for the executable to work correctly on a different PC. - Make the KoboldCPP project using the instructions above. -## Android (Termux) Alternative method -- See https://github.com/ggerganov/llama.cpp/pull/1828/files +## Compiling on Android (Termux Installation) +- [Install and run Termux from F-Droid](https://f-droid.org/en/packages/com.termux/) +- Enter the command `termux-change-repo` and choose `Mirror by BFSU` +- Install dependencies with `pkg install wget git python` (plus any other missing packages) +- Install dependencies `apt install openssl` (if needed) +- Clone the repo `git clone https://github.com/LostRuins/koboldcpp.git` +- Navigate to the koboldcpp folder `cd koboldcpp` +- Build the project `make` +- Grab a small GGUF model, such as `wget https://huggingface.co/TheBloke/phi-2-GGUF/resolve/main/phi-2.Q2_K.gguf` +- Start the python server `python koboldcpp.py --model phi-2.Q2_K.gguf` +- Connect to `http://localhost:5001` on your mobile browser ## AMD - Please check out https://github.com/YellowRoseCx/koboldcpp-rocm diff --git a/klite.embd b/klite.embd index df3106120..0a681388b 100644 --- a/klite.embd +++ b/klite.embd @@ -9884,7 +9884,7 @@ Current version: 107 { gentxtspeak = gentxt; } - tts_speak(gentxt); + tts_speak(gentxtspeak); } if(gentxt!="")