mirror of
https://github.com/LostRuins/koboldcpp.git
synced 2026-10-03 19:45:41 +00:00
58367713a6
* hex-gdn: start putting together HMX support for GDN * hex-gdn: working hmx but not-pipelined and slow for now * hex-gdn: re-write vtcm layout handling and prep for pipelining * hex-gdn: starting to pipeline hmx and dmas * hex-gdn: add hvx threading for most pipeline stages * hex-gdb: add detailed trace events * hex-gdn: vectorize expfs and use aligned hvx reads/writes * hex-gnd: vectorize the rest of expf * hex-gdn: optimize tail processing (pad partial chunks) * hex-gdb: avoid float up/down casts in hot loops * hex-fa: remove float up/down casts from inner loops * hex-gdn: do exp() in f16 to improve HVX utilization * hex-gdn: optimize tiler * hex-hmx: bump hmx-queue to 128 and dispatch all GDN gemms at once * hex-gdn: further pipeline improvements * hex-gdn: optimize gdn prep stage * hex-gdn: yet more tweaks to optimize GND_SOLVE task and pipeline * hex-gdn: improve accuracy and optmize gdn-prep further * hex-gdn: fix rebase conflict * hex-bufs: revert max_bufsize enforcement, it is enough to just enforce max_vmem * hex-scripts: improved inspect script to avoid false alarms in reg spill detector * hex-fa: improve inline softmax with in-reg VKQ32 accum * hex-fa: minor improvement for dma pipeline in hvx kernel * hex-fa: reduce ddr reads by 20-30% during token gen * hex-gdn: proper alignment for hvx vtcm spads |
||
|---|---|---|
| .. | ||
| apple | ||
| hip | ||
| jinja | ||
| snapdragon | ||
| bench-models.sh | ||
| build-info.sh | ||
| build-profile.ps1 | ||
| build-profile.sh | ||
| ccache-clear.sh | ||
| check-apiabi-compat.sh | ||
| check-release-apiabi.sh | ||
| check-requirements.sh | ||
| compare-commits.sh | ||
| compare-llama-bench.py | ||
| compare-logprobs.py | ||
| create_ops_docs.py | ||
| debug-test.sh | ||
| gen-authors.sh | ||
| gen-unicode-data.py | ||
| get-flags.mk | ||
| get-hellaswag.sh | ||
| get-pg.sh | ||
| get-wikitext-2.sh | ||
| get-winogrande.sh | ||
| get_chat_template.py | ||
| git-bisect-run.sh | ||
| git-bisect.sh | ||
| hf.sh | ||
| install-oneapi.bat | ||
| make-release-checks.sh | ||
| make-release-desc.sh | ||
| make-release-summary.txt | ||
| pr2wt.sh | ||
| release.sh | ||
| serve-static.js | ||
| server-bench.py | ||
| server-test-function-call.py | ||
| server-test-model.py | ||
| server-test-parallel-tc.py | ||
| server-test-structured.py | ||
| sync-ggml-am.sh | ||
| sync-ggml.last | ||
| sync-ggml.sh | ||
| sync_vendor.py | ||
| tool_bench.py | ||
| tool_bench.sh | ||
| ui-assets.cmake | ||
| verify-checksum-models.py | ||
| wc2wt.sh | ||