Configuring GPT4All to use Neo LLM (Mistral Instruct)
Updated April 2, 2024

Please Note: Screenshot and file location examples in this tutorial were created using GPT4All version 2.7.3 for Windows. Updated versions and GPT4All for Mac and Linux might appear slightly different.

Step 1: Download GPT4All

To download GPT4All, visit https://gpt4all.io and select the download file for your computer's operating system. If you've already installed GPT4All, you can skip to Step 2.

The install file will be downloaded to a location on your computer. Once downloaded, run the installer to complete the installation process.

Step 2: Download the Neo LLM file

First you'll need to create a folder on your computer where you will keep the Neo LLM file (something like C:\Models).

From the download page on Brighteon.ai, download and save the Neo LLM file in the folder you created. If the file automatically downloaded to a different location on your computer, you can cut/copy and paste the file to the correct location.

Once downloaded, the final file location will look something like C:\Models\Neo-Mistral-TTAC-4bit.gguf

Note: Neo LLM files are very large in size. If you have limited space on your computer's internal hard drive, you may want to place it on a secondary drive or external hard drive (example: D:\Models).

Step 3: Launch GPT4All

When GPT4All loads for the first time, it will open a popup with release notes and anonymous usage analytics questions. You can decide if you wish to help GTP4All with analytics or not. For this tutorial, we will choose "No" for both.

GPT4All will now show another popup with a bunch of model download options. We've already downloaded the Neo LLM file so we can close this popup (click the "X" button to close).

Step 4: Update Settings

Click on the Settings menu button near the top-right corner of the user interface (gear icon). This will open the Settings popup.

On the left side of the Settings popup, click on the "Application" tab and then click the "Browse" button next to the "Download path" option and chose the folder you created in Step 2.

Now if not already selected, click on the "Default model" drop-down menu and select "Neo-Mistral-TTAC-4bit.gguf".

Next click on the "Models" Tab and scroll down until you see a setting for "Context Length". Change this setting to "32768" and press enter.

You can now close the Settings popup (click the "X" button to close).

Back on the main screen, click the "Choose a model..." drop-down menu . You should see "Neo-Mistral-TTAC-4bit.gguf" listed there. Click on it to select it as your model.

Congratulations! You've successfully configured GPT4All to use Neo LLM and are ready to start chatting with Neo.