Commit graph

22 commits

Author SHA1 Message Date
Carl-Robert Linnupuu
4e149c54de feat: support DeepSeek R1 and V3 models 2025-01-27 21:51:12 +00:00
Carl-Robert Linnupuu
4e5b28048b feat: add latest qwen 2.5 coder models and adjust stop tokens 2024-12-01 00:01:26 +00:00
Carl-Robert Linnupuu
f410588175 feat: enable Edit Code feature for all providers (closes #700, #698, #696) 2024-09-22 13:56:25 +03:00
Carl-Robert Linnupuu
eb36e11c5f feat: add Qwen 2.5 Coder model 2024-09-22 01:59:23 +03:00
Nick P.
f910576f89
fix: Codestral Infill templates for code completion in llama.cpp (#667)
* fix: Codestral template variables and [MIDDLE] token

* fix: Codestral references CODESTRAL fixed template
2024-08-20 12:03:19 +03:00
Rene Leonhardt
ea6b1c8538
feat: Support Codestral 22B 32K (#587) 2024-06-03 11:22:39 +03:00
Rene Leonhardt
73ec3b5d56
feat: Support Phi-3 Medium 128K (#577) 2024-05-23 01:10:02 +03:00
Rene Leonhardt
586cff421e
feat: Support Stable Code Instruct 3B (#552)
* feat: Support Stable Code Instruct 3B

* feat: Sort LLaMA models in settings
2024-05-16 22:28:54 +03:00
Rene Leonhardt
8e5ba8158d
feat: Show server name in start/stop notifications (#546)
* feat: Show server name in start/stop notifications

* feat: Show opposite action in notification

* feat: Pre-select biggest downloaded parameter size on model change

* chore: Update to latest llama.cpp fixes (2024-05-14)
2024-05-14 21:26:22 +03:00
Rene Leonhardt
9bd7e6e83a
feat: Visualize downloaded models (#543)
* feat: Visualize downloaded models

* Simplify GeneralSettings access
2024-05-13 10:48:55 +03:00
Rene Leonhardt
59acb59843
chore: Update to CodeGemma 1.1 7b Instruct (#534) 2024-05-09 13:08:55 +03:00
Rene Leonhardt
ee16bfee10
feat: Support CodeQwen1.5-Chat model (#527)
* feat: Support CodeQwen1.5-Chat model

* Declare model directories explicitly
2024-05-08 16:05:51 +03:00
Phil
2dfb1b0800
fix: Storing HuggingFaceModel by modelName instead of quantization only (#529) 2024-05-07 18:14:19 +03:00
Phil
2c0a28a912
feat: add CodeGemma InfillPromptTemplate (#530) 2024-05-07 17:51:04 +03:00
Rene Leonhardt
a2a8747aca
feat: Support CodeGemma 7b Instruct model (#524) (#525) 2024-05-07 10:43:14 +03:00
Rene Leonhardt
6d6e0a3ccb
feat: Support Phi-3 Mini model (#516) 2024-04-27 23:50:03 +03:00
Rene Leonhardt
6e6a499105
feat: Support Llama 3 model (#479)
* feat: Support Llama 3 model (#478)

* Use new InfillPrompt

* Switch to lmstudio-community

* Use new Prompt

* llama.cpp removed the BOS token
https://github.com/ggerganov/llama.cpp/pull/6751/commits/a55d8a9348fc9e9215229bf03f96ecff4dcc7c91

* Add tests

* I would prefer a stream based solution

* Add 70B models

* Add tests for skipping blank system prompt

* Remove InfillPrompt for now
2024-04-21 01:12:13 +03:00
Rene Leonhardt
7d89650062
chore: Improve code (#442)
* chore: Improve code

* Convert classes to records
2024-04-10 14:47:38 +03:00
Phil
cceba88c35
Allow using existing Llama Server instead of running locally (#345)
* Add setting to use existing Llama server

* minor UI improvements

* support infill template configuration

---------

Co-authored-by: Carl-Robert Linnupuu <carlrobertoh@gmail.com>
2024-02-02 12:24:41 +02:00
Carl-Robert Linnupuu
3797126de4 Add deepseek coder instruct models (1-33B) 2023-11-23 17:22:48 +02:00
Carl-Robert
c4115e257b
Add checkstyle rules (#274) 2023-11-16 17:15:11 +02:00
Carl-Robert
45908e69df
#178 - Add support for running local LLMs via LLaMA C/C++ port (#249)
* Initial implementation of integrating llama.cpp to run LLaMA models locally

* Move submodule

* Copy llama submodule to bundle

* Support for downloading models from IDE

* Code cleanup

* Store port field

* Replace service selection radio group with dropdown

* Add quantization support + other fixes

* Add option to override host

* Fix override host handler

* Disable port field when override host enabled

* Design updates

* Fix llama settings configuration, design changes, clean up code

* Improve You.com coupon design

* Add new Phind model and help tooltip

* Fetch you.com subscription

* Add CodeBooga model, fix downloadable model selection

* Chat history support

* Code refactoring, minor bug fixes

* UI updates, several bug fixes, removed code llama python model

* Code cleanup, enable llama port only on macOS

* Change downloaded gguf models path

* Move some of the labels to codegpt bundle

* Minor fixes

* Remove ToRA model, add help texts

* Fix test

* Modify description
2023-11-03 12:00:24 +02:00