Please Note: Screenshot and file location examples in this tutorial were created using LM Studio version 0.2.17 for Windows. Updated versions or LM Studio for Mac and Linux might appear slightly different.
To download LM Studio, visit https://LMStudio.ai and select the download file for your computer's operating system. If you've already installed LM Studio, you can skip to Step 2.
The install file will be downloaded to a location on your computer. Once downloaded, run the installer to complete the installation process.
After launching LM Studio, click on the "My Models" icon (yellow folder) in the left side menu.
On the "My Models" page, click the "Show in File Explorer" button near the top. This will open a folder (something like c:\users\user\.cache\lm-studio\models).
Note: If you are using a Mac, the folder will be something like /Users/username/.cache/lm-studio/models .
While within the "models" folder, you'll need to create a new subfolder called "Neo" and enter it. Then while in the "Neo" folder, create another subfolder called "Neo-Dolphin-Mistral-TTAC-1".
This is the location where the downloaded Neo LLM file will be placed in the next step.
Note: Neo LLM files are very large in size. If you have limited space on your computer's internal hard drive, you may want to place it on a secondary drive or external hard drive. If you do this, you'll need to click the "Change" button and select a new location (example: d:\models) and create the "Neo" and "Neo-Dolphin-Mistral-TTAC-1" subfolders there.
From the download page on Brighteon.ai, download and save the Neo LLM file in the "Neo-Dolphin-Mistral-TTAC-1" subfolder created in the previous step. If the file automatically downloaded to a different location on your computer, you can cut/copy and paste the file to the correct subfolder.
The final file location will look something like c:\users\username\.cache\lm-studio\models\Neo\Neo-Dolphin-Mistral-TTAC-1\Neo-Mistral-TTAC-4bit.gguf
Note: This is a very large file so it may take a while depending on your internet speed.
Once the Neo LLM file has downloaded and is placed into the correct subfolder, click on the "AI Chat" icon (white chat bubble) within the left side menu. On the "AI Chat " page, click the "Select a model to load" drop-down menu (top of page) and click on "Neo Mistral TTAC it".
LM Studio will now load Neo LLM (might take a few seconds). Once loading has completed, you should see "Neo Mistral TTAC it" as the selected model.
On the right side of LM Studio, you'll see an area called "Settings". Where is says "Preset", click the drop-down menu and select "Mistral Instruct".
Now while still under the settings area, scroll down until you see an group called "Advanced Configuration". Under this group, look for a subgroup called "Hardware Settings".
If your computer has a dedicated graphics card (GPU), you can enable "GPU Offload" to improve performance. This will allow LM Studio to utilize your GPU instead of relying on only your CPU. If your computer does not have a graphics card, you can leave GPU Offload disabled.
Next you'll need to scroll further down to the "Model Initialization" subgroup and find the setting for "Context Length" Change this setting to "32768" and press enter.
Finally, click the "Reload model to apply configuration" button to reload the Neo LLM model with these updated settings.
Congratulations! You've successfully configured LM Studio to use Neo LLM and are ready to start chatting with Neo.