vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-07-09 17:08:33 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Commit graph

  • dc8f2b2cd1 updated cmake concedo v1.117 concedo_experimental Concedo 2026-07-08 17:26:47 +08:00
  • e11d3ddef0
         sd: sync with master-767-885f01a (#2310) Wagner Bruna 2026-07-08 06:08:19 -03:00
  • bbebeec4a8
         server-stream: follow-up on SSE Replay Buffer (#23226) (#25047) upstream Pascal 2026-07-08 11:02:50 +02:00
  • 230ea9d214
         llama-batch: add n_keep_tail in split_equal for recurrent models (#25278) Aman Gupta 2026-07-08 15:55:19 +08:00
  • f296fdfbed
         common: auto-create prompts-log-dir at argument parsing, so all tools using the flag benefit (#25322) rankaiyx 2026-07-08 15:45:28 +08:00
  • f1161b15f2
         ui: Context usage gauge and panel (#25340) Aleksander Grygier 2026-07-08 09:22:35 +02:00
  • da46e59cbf
         llama-eval : fix crash when answer is None in HTML dump (#25435) Georgi Gerganov 2026-07-08 10:00:03 +03:00
  • 0512ef1e5a
         metal : add set_rows with src0 f16 (#25434) fairydreaming 2026-07-08 08:49:07 +02:00
  • 4a7ee3126d
         fix: OOB reads in UGM tokenizer (precompiled_charsmap handling) (#18750) hourhl 2026-07-08 13:02:09 +08:00
  • 57b50e1f6b
         ggml : fix A indexing in simd_gemm scalar tail-column path (#25390) tyronecai 2026-07-08 13:00:05 +08:00
  • 68a521b591
         ggml : add support for CPU f16->f16 GGML_OP_SET_ROWS (#25344) fairydreaming 2026-07-08 05:46:28 +02:00
  • 931ca30bef
         opencl: fix potential crash in aos reconstruct (#25383) lhez 2026-07-07 20:34:29 -07:00
  • bec4772f6a
         Add Q2_0 quantization: type definition and CPU backend (#24448) Pasha Khosravi 2026-07-07 12:05:47 -07:00
  • c198af4dc2
         spec : fix naming, spacing (#25410) Georgi Gerganov 2026-07-07 18:52:30 +03:00
  • 3899b39ce2
         CUDA: Fuse MMVQ post-scale for NVFP4 (#24481) Oliver Simons 2026-07-07 17:12:19 +02:00
  • f5525f7e7a
         server : fix draft model fit vs load inconsistency (#25056) Alex 2026-07-07 10:20:42 -04:00
  • 5eca4e3cab
         server : add timings and progress to /responses API stream (#25348) Thomas LECONTE 2026-07-07 16:13:03 +02:00
  • 6c487e2f79
         server: enforce prompt cache RAM limit (#25070) Thiago Padilha 2026-07-07 10:24:35 -03:00
  • c1a411fb1b
         common : add missing <fstream> include in common.h (#25220) zhangrunda 2026-07-07 21:23:53 +08:00
  • dad4ff5737 Merge branch 'upstream' into concedo_experimental Concedo 2026-07-07 21:00:37 +08:00
  • 0c56ceb613 Merge commit 'bfdf581b8b' into concedo_experimental Concedo 2026-07-07 20:53:03 +08:00
  • 33ca0dcb9d
         ggml-hip : add -fno-finite-math-only alongside -ffast-math (#25373) asf0 2026-07-07 05:27:50 -06:00
  • 024c46ae4e
         llama: fix quantized kv-cache for dsv4 (#25202) Aman Gupta 2026-07-07 17:46:57 +08:00
  • 108f186d17
         [SYCL] fix unsupported UT cases of CONT & CPY (#25231) Neo Zhang 2026-07-07 17:20:52 +08:00
  • 47e1de77aa
         [SYCL] support op col2im_1d (#25264) Neo Zhang 2026-07-07 16:07:46 +08:00
  • 55edb2de44
         [SYCL] support OP cross_entropy_loss, cross_entropy_loss_back (#25236) Neo Zhang 2026-07-07 15:48:50 +08:00
  • d209086157
         sycl : set K_QUANTS_PER_ITERATION to 1 on DMMV path (#25063) Todd Malsbary 2026-07-07 00:43:41 -07:00
  • 95e5254c0a
         [SYCL] fix unsupport ACC UT cases for noncontiguous (#25124) Neo Zhang 2026-07-07 15:40:38 +08:00
  • 9e5ef0dbb1
         sycl : enhance argsort to support all UT cases (#25125) Neo Zhang 2026-07-07 15:39:29 +08:00
  • 3d4cbdf18a
         sycl : use sycl func to fix AOT double type issue (#25081) Neo Zhang 2026-07-07 15:38:33 +08:00
  • 26145b3db7
         sycl : rename the env vars from "disable" to "enable" (#25042) Neo Zhang 2026-07-07 15:33:51 +08:00
  • 1a7c25bfdb
         ggml : make ggml_time_init idempotent (#24422) An Long 2026-07-07 16:29:17 +09:00
  • defa95c306
         speculative : fix out-of-bounds read in ngram-map on prompt shrink (#23936) o7si 2026-07-07 15:25:04 +08:00
  • a8cfdbb9e4
         vulkan : check src0 type in GGML_OP_SET_ROWS to avoid failures due to unimplemented f16 support (#25351) fairydreaming 2026-07-07 06:56:02 +02:00
  • 6f8895feec
         opencl: general flash attention decode performance optimizations (#25366) Hongqiang Wang 2026-07-06 19:57:52 -07:00
  • ee445f93d8
         common: Set optimal default thread count for ppc ( linux as well as AIX) (#25237) shalinib-ibm 2026-07-07 03:05:20 +05:30
  • f36e5c348b
         metal: add col2im_1d op (f32/f16/bf16) (#25176) Pascal 2026-07-06 20:47:36 +02:00
  • 74976e1aef
         CUDA: remove -sm row, refactor cuBLAS (#24216) Johannes Gäßler 2026-07-06 20:04:53 +02:00
  • 9abce7473a
         server: fix deadlock in load_models() when erasing a finished download (#25358) Pascal 2026-07-06 19:26:06 +02:00
  • 838f14d652 updated sdui Concedo 2026-07-07 00:25:00 +08:00
  • adb2e96e3c allow viewing last generated image with the correct genkey Concedo 2026-07-06 23:33:33 +08:00
  • cb295bf596
         CUDA: extend K-type validation to V-types for flash attention (#24403) Alexey Kopytko 2026-07-06 23:26:50 +09:00
  • bfdf581b8b
         server: temporary skip model downloading API test (#25355) Xuan-Son Nguyen 2026-07-06 16:10:04 +02:00
  • 6c3f7018a7 increase max defaultgenamount limit Concedo 2026-07-06 20:12:11 +08:00
  • 20a04b2206
         ggml-cpu: use UE4M3 LUT in ARM NVFP4 dot product (#25331) ragz4125 2026-07-06 16:36:40 +05:30
  • 0f40d5c5d3 updated lite Concedo 2026-07-06 18:36:15 +08:00
  • 3b4fca11ac
         ggml-cpu: Enable tiled matmul on AIX (#25199) shalinib-ibm 2026-07-06 15:48:17 +05:30
  • 86961efd56
         vulkan: fix 32-bit integer overflow in CEIL_DIV (#25245) hokanosekai 2026-07-06 10:35:57 +02:00
  • d80e878501
         ui: restore Ctrl+B sidebar toggle shortcut (#25307) Pascal 2026-07-06 10:30:07 +02:00
  • 48719618e8
         scripts : use HF_TOKEN when downloading UI assets (#25280) Adrien Gallouët 2026-07-06 09:53:35 +02:00
  • d06ddd3589
         ggml-hip: enable -ffast-math for HIP builds (#23862) a-huk 2026-07-06 09:02:26 +02:00
  • 898b08854d
         ui: fake 200 for proxy DELETE req (#25298) Xuan-Son Nguyen 2026-07-06 08:41:39 +02:00
  • 72874f559c
         ggml-cuda: optimize conv_transpose_1d indexing (#25310) adavyas 2026-07-05 20:49:06 -07:00
  • 2da6686176
         Fix stale tensor-split params for draft models (#24814) Al G 2026-07-05 19:39:36 +01:00
  • 3e5036fbfb
         abort if we see a multi buffer (#25276) Eve 2026-07-05 18:38:47 +00:00
  • 4b2a0cdee1
         ggml : fix tensor-parallel + -ncmoe crash on MoE models (#25028) liminfei-amd 2026-07-06 01:56:11 +08:00
  • 7a63fdede1
         ggml: Update VMM Pool allocation ggml-cuda.cu - Turing P2P access fix (fixes #24489) (#24491) Vexxie 2026-07-05 18:10:09 +01:00
  • 78d2f52468
         cuda : concat implementation for quantized types (#25303) fairydreaming 2026-07-05 17:26:24 +02:00
  • e944cca86f Merge branch 'upstream' into concedo_experimental Concedo 2026-07-05 11:30:12 +08:00
  • 6eb556a5b3 fix build Concedo 2026-07-05 11:02:46 +08:00
  • a4107133a6
         llama : add guard for K/V rotation input when buffer is unallocated (#25215) liminfei-amd 2026-07-05 04:37:38 +08:00
  • 665892536d
         ui: add sync blocks so display/behavior settings can be set via --ui-config-file (#25132) Pascal 2026-07-04 16:12:27 +02:00
  • ef2d770117
         ggml : fix broken CPU concat implementation for quantized types (#25247) fairydreaming 2026-07-04 13:37:37 +02:00
  • 2d973636e2
         chat: trim messages sent to StepFun parser (fixes long reasoning loops) (#25238) Piotr Wilkin (ilintar) 2026-07-03 23:12:11 +02:00
  • d4cff114c0
         ui: Improve performance when streaming (#25225) Nick Towle 2026-07-03 10:03:51 -07:00
  • f113e02d5a
         ui: strip path and weight extension from model id in single model mode (#25137) Pascal 2026-07-03 17:32:48 +02:00
  • 152d337fad
         spec: support spec-draft-p-min in DFlash (#25246) Ruixiang Wang 2026-07-03 15:40:06 +02:00
  • 75a48a9055
         cuda: enable topk-moe fusion for 288 experts (#25267) Piotr Wilkin (ilintar) 2026-07-03 15:36:55 +02:00
  • 067de93718
         ui: align persisted config with strict server schema and enable thinking by default (#25242) Pascal 2026-07-03 13:14:52 +02:00
  • b5315e16e0
         server + ui: ping silent SSE streams every 1s and kick only after 3s so slow prefill never drops healthy connections (#25241) Pascal 2026-07-03 12:47:04 +02:00
  • 94875285e4
         ui: Add MCP Servers Opt-In for first time visitors (#25239) Aleksander Grygier 2026-07-03 12:16:29 +02:00
  • fd38fec594 save lora info when generating image Concedo 2026-07-03 17:32:48 +08:00
  • 5a460dea9f
         Remove redundant CUDA copies after gated_delta_net. (#23940) Gaurav Garg 2026-07-03 14:36:29 +05:30
  • c8ae9a750c
         vendor : update cpp-httplib to 0.49.0 (#25218) Alessandro de Oliveira Faria (A.K.A.CABELO) 2026-07-03 05:26:54 -03:00
  • 6482a596e1
         sd: sync with master-746-2574f59 (#2291) Wagner Bruna 2026-07-03 04:28:51 -03:00
  • 2ad093af75 Revert "CUDA: consistent use of __restrict__ + PDL for FA (#25185)" Concedo 2026-07-03 15:27:30 +08:00
  • fdb1db877c
         llama : add llama_model_ftype_name() (#25134) Adrien Gallouët 2026-07-02 17:26:47 +02:00
  • a4aa063153 vision fix Concedo 2026-07-02 22:30:21 +08:00
  • 56d11ad4e8 Merge branch 'upstream' into concedo_experimental Concedo 2026-07-02 21:42:36 +08:00
  • 4fc4ec5541
         opencl: allow loading precompiled binary kernels from library (#23042) lhez 2026-07-01 10:29:22 -07:00
  • a6647b1a32
         common : use hf primary split as model path (#25194) Adrien Gallouët 2026-07-01 18:33:00 +02:00
  • 44c966a764 ollama show model name to return Concedo 2026-07-01 22:31:04 +08:00
  • 0bc2936f06 ollama tool calling Concedo 2026-07-01 22:19:28 +08:00
  • 13e673863b
         hexagon: flash attention rework (optimizations, accuracy improvements, etc) (#25085) Max Krasnyansky 2026-07-01 06:59:19 -07:00
  • f76b5a9e31 ollama streaming Concedo 2026-07-01 21:37:51 +08:00
  • e2de771b2a fixed a missing header Concedo 2026-07-01 20:30:25 +08:00
  • 4790b912c7 ollama embeddings endpoint Concedo 2026-07-01 19:42:38 +08:00
  • 849ec89bad restructure some compilation units Concedo 2026-07-01 18:51:25 +08:00
  • b820cc8e6f
         CUDA: consistent use of __restrict__ + PDL for FA (#25185) Johannes Gäßler 2026-07-01 10:55:14 +02:00
  • 983dec9a54 prevent MTP drafting with batching Concedo 2026-07-01 16:17:13 +08:00
  • 6dbc1174b8
         ggml-cpu: add AVX2 optimization for nvfp4 dot product and use UE4M3 LUT (#23961) ragz4125 2026-07-01 13:01:20 +05:30
  • 9d88e7cedd
         ui Prevent tool messages from incorrectly appending to other conversations (#25177) Aleksander Grygier 2026-07-01 09:25:18 +02:00
  • 7af4279f45
         ui: Remove PWA navigate fallback to prevent caching API endpoint requests (#25174) Aleksander Grygier 2026-07-01 07:32:55 +02:00
  • fd1a05791d
         opencl: initial q1_0 support (#25160) lhez 2026-06-30 21:43:20 -07:00
  • 0eca4d490e
         cuda : prevent integer truncation and overflow errors when using KQ mask strides in flash_attn_mask_to_KV_max kernel (#24945) fairydreaming 2026-06-30 20:47:05 +02:00
  • 4f31eedb0c
         model : register t_layer_inp for qwen3next (#25141) Jürgen Schmied 2026-06-30 17:57:14 +02:00
  • 0626395511 default 40k ctx colab Concedo 2026-06-30 23:14:47 +08:00
  • 8d29a18bd2 default 32k ctx Concedo 2026-06-30 22:57:41 +08:00
  • cb36463e4a Merge branch 'upstream' into concedo_experimental Concedo 2026-06-30 22:40:37 +08:00
  • ca3a77a87b testing max nodes per submit Concedo 2026-06-30 22:26:02 +08:00