CodeGPT: Using Local LLM as Copilot in VSCode

Lynn Mikami
5 min readNov 6, 2023

Read more here:

CodeGPT: Using Local LLM as Copilot in VSCode

Understood, let’s delve into a more detailed exploration of CodeGPT with practical examples and step-by-step guidance that provides a richer, more technical insight.

Introduction to CodeGPT: Your Coding Sidekick

Imagine a tool that could provide you with instant coding suggestions, help debug your script, and even offer tips for optimization. That’s exactly what CodeGPT does within Visual Studio Code (VSCode). It’s a smart extension, leveraging the power of AI to enhance the coding process, making it faster, more accurate, and, dare we say, enjoyable.

With CodeGPT, writing code feels less like a solitary task and more like a collaborative effort with a knowledgeable partner. It’s not just about getting the job done; it’s about learning and improving as you go. CodeGPT brings a dimension of continuous learning to your coding practice, constantly adapting to your style and offering suggestions to elevate your work.

Enhancing Your Code with CodeGPT in VSCode

What is CodeGPT?

CodeGPT integrates with VSCode to provide an interactive coding experience. It’s a feature-rich assistant that understands the nuances of your project and delivers contextually relevant code suggestions. It’s particularly useful for:

  • Streamlining Code Creation: CodeGPT predicts not just words but entire lines of code, offering accurate autocompletion suggestions.
  • Error Detection and Resolution: It highlights mistakes in real-time and suggests corrections, reducing debugging time.
  • Optimizing Code Efficiency: CodeGPT reviews your code and proposes refactoring for improved performance and maintainability.

You can Download the CodeGPT Extension for VSCode here.

How to Use CodeGPT to Supercharge Your Coding Sessions

Let’s walk through an example of setting up and using CodeGPT for a Python project in VSCode:

  1. Installation: Navigate to the Extensions view in VSCode (Ctrl+Shift+X), search for "CodeGPT," and click Install.
  2. Configuration: Access the settings through Ctrl+,, search for CodeGPT, and adjust the settings, like setting the number of suggestions you prefer to see.
  3. Usage: Start coding in your Python file. For example, if you’re setting up a function to calculate the Fibonacci sequence, as you type def fib(, CodeGPT might suggest a complete function signature like def fibonacci(sequence_length):.
# CodeGPT might help autocomplete something like this:
def fibonacci(sequence_length):
sequence = [0, 1]
for i in range(2, sequence_length):
next_value = sequence[-1] + sequence[-2]
return sequence
  1. Error Detection: Suppose you accidentally typed sequence.apend(next_value) (note the misspelling). CodeGPT would underline apend and, upon hovering over it, suggest the correct method: append.
  2. Code Optimization: Imagine your original Fibonacci function isn’t optimized for large inputs. CodeGPT could suggest an improved version using a generator, thus enhancing performance:
# Optimized code with CodeGPT's guidance:
def fibonacci_generator(sequence_length):
a, b = 0, 1
for _ in range(sequence_length):
yield a
a, b = b, a + b

With CodeGPT, the coding experience becomes interactive and instructive, pushing you towards better coding practices.

Detailed Guide to CodeGPT with Ollama Integration

Beyond the built-in capabilities, CodeGPT’s true potential is unleashed when paired with advanced AI models through Ollama. Let’s integrate Mistral 7B with CodeGPT:

  1. Acquire Ollama: Download and install Ollama from its official website.
  2. Activate Model: Use the command line to run ollama pull mistral to access the Mistral 7B model.
  3. Configure Provider in VSCode: Within CodeGPT’s settings, select Ollama as the model provider.
  4. Model Selection: Choose mistral as your active model in CodeGPT settings.

For a hands-on example, say you’re working with a complex algorithm in Python. After selecting the mistral model, you start to define a sorting function. As you type def sort_items(, the integrated Mistral model could suggest a complete and efficient sorting algorithm, potentially using advanced Python features like list comprehensions or lambda functions.

# Mistral's advanced suggestion could look like this:
def sort_items(items):
return sorted(items, key=lambda x: x[1])

In this example, Mistral understood that you intended to sort a list of tuples based on the second element, demonstrating a deep understanding of both Python and your coding intent.

As you embrace the combined power of CodeGPT and Ollama’s advanced models, your coding becomes not just faster but smarter. You’re not only given suggestions but taught improved coding techniques in the process. CodeGPT with Ollama is less of a tool and more of a mentor, one that’s invested in your growth as a developer.


Embracing CodeGPT within your development workflow in VSCode is like inviting a collaborative partner into your coding process. It stands out not just for the convenience it brings but also for the learning opportunities it presents. With its integration into VSCode, CodeGPT becomes more than a tool; it’s a part of your coding journey, adapting to your style and guiding you towards better practices. When combined with the Ollama models, this guidance elevates to a new level of insight and expertise, giving you access to a broader range of capabilities that can tackle complex coding challenges with finesse.

The future of coding is intelligent, adaptive, and incredibly intuitive, thanks to the innovative strides made by technologies like CodeGPT. Whether you’re a seasoned developer or just starting out, incorporating CodeGPT into your projects promises a seamless, more productive, and enlightening coding experience.


Can I use CodeGPT for free?

Yes, CodeGPT is available for free. You can download and install the CodeGPT extension from the Visual Studio Code marketplace without any cost. However, access to certain models or additional features might require a subscription or payment.

What is GPT in code?

GPT in code refers to the use of Generative Pretrained Transformer models that have been trained on a diverse range of internet text and coding datasets. These models can generate human-like text based on the input they’re given, which in the context of coding, means they can predict and suggest code snippets, help debug, and optimize your code.

How do you use CodeGPT?

To use CodeGPT, you first need to install the CodeGPT extension in Visual Studio Code. Once installed, it automatically starts providing suggestions as you type in your code. You can accept suggestions with a simple keyboard shortcut and configure the settings to customize the behavior as per your preferences.

How do I install CodeGPT?

To install CodeGPT, follow these steps:

  1. Open Visual Studio Code.
  2. Go to the Extensions view by clicking on the square icon on the sidebar or by pressing Ctrl+Shift+X.
  3. In the search bar, type “CodeGPT” and look for the extension.
  4. Click on the ‘Install’ button to add the extension to your VSCode editor.
  5. Once installed, it’s ready to use, and you can configure the settings according to your needs.

Want to learn the latest LLM News? Check out the latest LLM leaderboard!

import AdComponent from ‘../../components/AdComponent’;