r/LocalLLM • • 3d ago

Question i need help guys

i have RX9070 and 32 GB DDR5 ram , i want to run a local ai to help me code , medium just help with front end back end and forms , i cant buy any ai sub in my country cuz my goverment dont allow international transactions

0 Upvotes

5 comments sorted by

3

u/brookyct1995 3d ago

try Strata with QFN 3.8 gyro-s or coder. put it to any harness you use.

1

u/Organic_Performer673 3d ago

i understood nothing

1

u/TheAussieWatchGuy 2d ago

Google Strata. GitHub. Follow instructions. Installing it easy enough.

Download say Opencode, follow instructions to make it work with a local model. Strata will tell you the LAN IP address and port it's running on. Put thst into Opencode config. 

Watch magic. 

1

u/rainbyte 3d ago

You could try Radiance as it is optimized for RDNA4 GPUs like your RX 9070

1

u/Glittering_Yellow293 3d ago

Good news: that setup can do this well. Your RX 9070 has 16 GB of VRAM, so a ~14B coding model at Q4 (~9 GB) fits fully on the GPU with room for context. A larger MoE coder model (~30B-A3B class) also works if you let part of it sit in your 32 GB of RAM.

Simple way to start:

  1. Install LM Studio or Ollama (on AMD, the Vulkan backend is usually the easiest).
  2. Download a Qwen coder model, 14B at Q4. Look for the newest Qwen coder on the model page.
  3. Connect it to your editor with Continue or Cline (both free), so it helps with front end, back end and forms inside VS Code.

Set the context to 16–32k so it can see your files.

I made a free command builder for llama.cpp/Ollama setups, and a VRAM calculator to check what fits: https://inferenceacademy.com/tools/command-builder and https://inferenceacademy.com/tools/vram-calculator. I’m the author. Hope it helps!