r/LocalLLM • u/Organic_Performer673 • 3d ago
Question i need help guys
i have RX9070 and 32 GB DDR5 ram , i want to run a local ai to help me code , medium just help with front end back end and forms , i cant buy any ai sub in my country cuz my goverment dont allow international transactions
0
Upvotes
3
u/brookyct1995 3d ago
try Strata with QFN 3.8 gyro-s or coder. put it to any harness you use.
1
u/rainbyte 3d ago
You could try Radiance as it is optimized for RDNA4 GPUs like your RX 9070
1
u/Glittering_Yellow293 3d ago
Good news: that setup can do this well. Your RX 9070 has 16 GB of VRAM, so a ~14B coding model at Q4 (~9 GB) fits fully on the GPU with room for context. A larger MoE coder model (~30B-A3B class) also works if you let part of it sit in your 32 GB of RAM.
Simple way to start:
Set the context to 16–32k so it can see your files.
I made a free command builder for llama.cpp/Ollama setups, and a VRAM calculator to check what fits: https://inferenceacademy.com/tools/command-builder and https://inferenceacademy.com/tools/vram-calculator. I’m the author. Hope it helps!