vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-11 01:24:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

remove mcpu native (+1 squashed commits)

Browse source 
Squashed commits:

[0617bd8f] disable fp16 VA (+1 squashed commits)

Squashed commits:

[4213851a] disable FP16 VA
This commit is contained in:
Concedo 2024-01-24 22:46:56 +08:00
parent 07c49f8554
commit e2e8da0d1d
2 changed files with 3 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
Makefile
View file

@ -266,8 +266,8 @@ endif # LLAMA_METAL
ifneq ($(filter aarch64%,$(UNAME_M)),) ifneq ($(filter aarch64%,$(UNAME_M)),)
# Apple M1, M2, etc. # Apple M1, M2, etc.
# Raspberry Pi 3, 4, Zero 2 (64-bit) # Raspberry Pi 3, 4, Zero 2 (64-bit)
CFLAGS += -mcpu=native CFLAGS +=
CXXFLAGS += -mcpu=native CXXFLAGS +=
endif endif
ifneq ($(filter armv6%,$(UNAME_M)),) ifneq ($(filter armv6%,$(UNAME_M)),)
# Raspberry Pi 1, Zero # Raspberry Pi 1, Zero

1
README.md
View file

@ -109,6 +109,7 @@ You can then run koboldcpp anywhere from the terminal by running `koboldcpp` to
- Grab a small GGUF model, such as `wget https://huggingface.co/TheBloke/phi-2-GGUF/resolve/main/phi-2.Q2_K.gguf` - Grab a small GGUF model, such as `wget https://huggingface.co/TheBloke/phi-2-GGUF/resolve/main/phi-2.Q2_K.gguf`
- Start the python server `python koboldcpp.py --model phi-2.Q2_K.gguf` - Start the python server `python koboldcpp.py --model phi-2.Q2_K.gguf`
- Connect to `http://localhost:5001` on your mobile browser - Connect to `http://localhost:5001` on your mobile browser
- If you encounter any errors, make sure your packages are up-to-date with `pkg up`
## AMD ## AMD
- Please check out https://github.com/YellowRoseCx/koboldcpp-rocm - Please check out https://github.com/YellowRoseCx/koboldcpp-rocm