ProxyAI/DESCRIPTION.md at 45908e69dfd16b707cda80a87738bbbc410e5d65

mirror of https://github.com/carlrobertoh/ProxyAI.git synced 2026-04-28 03:30:48 +00:00

#178 - Add support for running local LLMs via LLaMA C/C++ port (#249 )

* Initial implementation of integrating llama.cpp to run LLaMA models locally

* Move submodule

* Copy llama submodule to bundle

* Support for downloading models from IDE

* Code cleanup

* Store port field

* Replace service selection radio group with dropdown

* Add quantization support + other fixes

* Add option to override host

* Fix override host handler

* Disable port field when override host enabled

* Design updates

* Fix llama settings configuration, design changes, clean up code

* Improve You.com coupon design

* Add new Phind model and help tooltip

* Fetch you.com subscription

* Add CodeBooga model, fix downloadable model selection

* Chat history support

* Code refactoring, minor bug fixes

* UI updates, several bug fixes, removed code llama python model

* Code cleanup, enable llama port only on macOS

* Change downloaded gguf models path

* Move some of the labels to codegpt bundle

* Minor fixes

* Remove ToRA model, add help texts

* Fix test

* Modify description

2023-11-03 12:00:24 +02:00

4.4 KiB

Raw Blame History

Introducing CodeGPT: Your Free, Open-Source AI Copilot for Coding

CodeGPT is your go-to AI assistant, designed to enhance your coding skills and optimize your programming time. Access state-of-the-art LLMs like GPT-4, Code LLama and more, all for free.

Quick Start Guide

Download the Plugin: Get started by downloading the plugin from the JetBrains Marketplace.
Choose Your Preferred Service:

a) OpenAI - Requires authentication via OpenAI API key.

b) Azure - Requires authentication via Active Directory or API key.

c) You.com - A free, web-connected service with an optional upgrade to You⚡Pro for enhanced features..

d) LLaMA C/C++ Port - Run Code Llama, WizardCoder, and other state-of-the-art models locally for free.
Start Using the Features: You're all set! Start exploring the features of our plugin.

OpenAI

After successful installation, configure your API key. Navigate to the plugin's settings via File | Settings/Preferences | Tools | CodeGPT. Paste your OpenAI API key into the field and click Apply/OK.

Azure

For Azure OpenAI services, you'll need to input three additional fields:

Resource name: The name of your Azure OpenAI Cognitive Services.
Deployment ID: The name of your Deployment.
API version: The most recent non-preview version.

Also, input one of the two provided API keys.

You.com (Free)

You.com is a search engine that summarizes the best parts of the internet for you, with private ads and with privacy options.

You⚡Pro

Use the CodeGPT coupon for a free month of unlimited GPT-4 usage.

Check out the full feature list for more details.

LLaMA C/C++ Port (Free, Local)

Note

: This feature is currently supported only on Linux and MacOS.

The main goal of llama.cpp is to run the LLaMA model using 4-bit integer quantization on a MacBook.

Getting Started

Select the Model: Depending on your hardware capabilities, choose the appropriate model from the provided list. Once selected, click on the Download Model link. A progress bar will appear, indicating the download process.
Start the Server: After successfully downloading the model, initiate the server by clicking on the Start Server button. A status message will be displayed, indicating that the server is starting up.
Apply Settings: With the server running, you can now apply the settings to start using the features. Click on the Apply/OK button to save your settings and start using the application.

Note

: If you're already running a server and wish to configure the plugin against that, then simply select the port and click Apply/OK.

Features

The plugin provides several key features, such as:

Ask Anything

Ask anything you'd like.

Select and Ask

Ask anything related to your selected code.

Replace Generated Code

Instantly replace a selected code block in the editor with suggested code generated by AI.

Regenerate Response

Expected a different answer? Re-generate any response of your choosing.

Other features

Conversation History - View recent conversation history and restore previous sessions, making it easy to pick up where you left off
Concurrent conversations - Chat with the AI in multiple tabs simultaneously
Seamless conversations - Chat with the AI regardless of the maximum token limitations
Predefined Actions - Create your own editor actions or override the existing ones, saving time rewriting the same prompt repeatedly

4.4 KiB Raw Blame History