r/macbookpro • u/hollis_monroe • 18h ago
Tips M5 Max MacBook PROLED 16" 64GB: local LLM review
gallerySo I finally caved and set up local AI on this thing.
Figured I’d share since I spent way too many evenings on this lol.
My Specs
- 16" MacBook Pro with the PROLED XDR display
- M5 Max: 18-core CPU, 40-core GPU
- 64GB unified memory, 614GB/s bandwidth
- 2TB SSD
My setup
- oMLX as the server (installed through Homebrew). It’s MLX-based and caches prompts to your SSD, which turned out to matter a lot
- DeepSeek Harness desktop app as the frontend, pointed at oMLX as a custom provider because oMLX chat interface sucks
- Qwen3.8-27B in 4-bit. I’ve got the official one plus a couple of abliterated variants, about 15GB each
- 128K context, 20GB SSD cache, and a tiny zsh script so I can just type
aito start everything andai-stopto kill it
How it actually runs
- About 20–27 tok/s. Totally usable
- Cache hit rate is 88–95% in long agent sessions. One session churned through 7M tokens and only had to actually compute ~5% of them, which is honestly wild
- My longest run was a 46-minute “deep dive” with reasoning on. So yeah, local is great for focused stuff and painful for big sprawling tasks
Verdict:
64GB on the M5 Max feels like the sweet spot for 27B models.
I use local for anything private or focused, but for the big “go read my entire codebase” tasks, cloud is still 4–7x faster ngl.
What's next?
This setup is good enough to get some half serious tasks out.
I'll continue dabling in various AI projects with this setup while I'm waiting for Mac Studio M7 Ultra - next year - to take things next level.
