Operating a succesful 27B mannequin as a neighborhood AI coding agent used to imply organising inference servers, configuring endpoints, and connecting every little thing manually. With Qwen3.8-27B, Ollama, and OpenCode, the method is now remarkably easy.
Qwen3.8-27B is among the native fashions I’ve been most excited to attempt. It’s robust at coding, reasoning, instrument use, and long-horizon agentic duties, making it a terrific match for working with advanced initiatives and enormous native codebases.
On this information, we are going to flip Qwen3.8-27B into a neighborhood AI coding agent utilizing solely three command strains within the terminal. We are going to set up Ollama, obtain the mannequin, launch it straight in OpenCode, and shortly confirm that it’s working on the GPU.
Earlier than You Begin: Checking Your {Hardware}
Qwen3.8-27B is a big mannequin, so first ensure that your machine has sufficient sources.
On Linux or Home windows with NVIDIA drivers put in, run:
nvidia-smi
For this information, we’re utilizing an RTX 3090 with 24 GB of VRAM. Ollama’s Qwen3.8-27B mannequin is round 18 GB, so it could possibly match totally on the GPU whereas leaving some VRAM for the context and runtime overhead.
As a basic rule, 24 GB of VRAM is an efficient goal if you wish to preserve most or all the mannequin on the GPU. Rising the context window would require extra reminiscence.
In case your GPU doesn’t have sufficient VRAM, Ollama can break up the mannequin between GPU VRAM and system RAM. It is going to nonetheless work, however technology will likely be slower.
I’d suggest a minimum of 32 GB of system RAM, particularly if a part of the mannequin must be offloaded from the GPU.
Operating Qwen3.8-27B in Simply 3 Instructions
Now that the {hardware} is prepared, we will set up Ollama, obtain Qwen3.8-27B, and launch it inside OpenCode utilizing simply three terminal instructions.
1. Putting in Ollama
First, set up Ollama, which can deal with downloading and serving the mannequin regionally.
curl -fsSL https://ollama.com/set up.sh | sh
2. Beginning Ollama and Downloading Qwen3.8-27B
Subsequent, begin the Ollama server within the background and obtain the Qwen3.8-27B mannequin.
ollama serve & ollama pull qwen3.8:27b
This begins the native Ollama server after which downloads the mannequin information. Hold this terminal open so you can too see the server logs when the mannequin begins working.
3. Launching Qwen3.8-27B in OpenCode
Open a new terminal and launch OpenCode with Qwen3.8-27B already chosen because the mannequin.
ollama launch opencode --model qwen3.8:27b
If OpenCode just isn’t put in but, Ollama will immediate you to put in it first.
As soon as the set up is full, the OpenCode TUI will open with Qwen3.8-27B chosen. From right here, you possibly can merely give it a coding job.
For my check, I requested it to construct a easy Python utility. On the primary request, the mannequin takes a bit longer as a result of Ollama has to load it into reminiscence. You’ll be able to watch this occur within the first terminal.
As soon as loaded, technology pace is spectacular.
In my check, it constructed the appliance, examined it, and returned an in depth undertaking abstract in beneath two minutes.
That is it. Ollama handles the native mannequin, whereas OpenCode gives the agentic coding surroundings.
Remaining Ideas
I do know some individuals will choose llama.cpp as a result of it offers you a lot deeper management over inference, efficiency tuning, quantization, and superior options. However that isn’t actually the purpose of this information.
This setup is for novices and non-technical customers who merely wish to expertise a robust native coding mannequin with out constructing llama.cpp from supply, configuring servers, or determining lengthy command-line arguments.
With simply three instructions, you put in Ollama, obtain and run Qwen3.8-27B, and launch it straight inside OpenCode.
That’s it. You’ll be able to go from nothing to a completely native AI coding agent in only a few minutes.
Â
Â
Abid Ali Awan (@1abidaliawan) is an authorized information scientist skilled who loves constructing machine studying fashions. At present, he’s specializing in content material creation and writing technical blogs on machine studying and information science applied sciences. Abid holds a Grasp’s diploma in expertise administration and a bachelor’s diploma in telecommunication engineering. His imaginative and prescient is to construct an AI product utilizing a graph neural community for college students fighting psychological sickness.
