can i run · seo
Yes — Qwen2.5-Coder 32B runs on Mac Studio 128GB
Qwen2.5-Coder 32B (32B) needs 64GB VRAM at FP16 vs your 128GB unified. Estimated ~7–9 tok/s.
Still one of the best local coding models. Q4 ~20 GB.
best fit on this rig · weights + KV + headroom
FP16 · 64GB weights+1GB KV @ 8kfits GPU~7–9 tok/s
| quant | weights | + KV 8k | fits 128GB? |
|---|---|---|---|
| Q3 | 16GB | ~17GB | ✓ yes |
| Q4 | 20GB | ~21GB | ✓ yes |
| Q5 | 24GB | ~25GB | ✓ yes |
| Q8 | 35GB | ~36GB | ✓ yes |
| FP16 | 64GB | ~65GB | ✓ yes |
File size ≠ runtime. KV grows with context — halve to 4k/2k if long chats OOM. Leave 1–2GB free.
ollama run qwen2.5-coder:32b
Run it: 1) install Ollama · 2) copy command · 3) verify with ollama ps (want 100% GPU).
faq · straight answers
Can Qwen2.5-Coder 32B run on Mac Studio 128GB?
Qwen2.5-Coder 32B (32B) needs 64GB VRAM at FP16 vs your 128GB unified. Estimated ~7–9 tok/s. Model context 32k. Compare with all models or re-check with your exact specs on the bench.
What if it OOMs?
Unload with ollama stop, cap layers --num-gpu 28, cut context to 2k. See the OOM fixer on the homepage.
Q4 or Q8 on this rig?
Start FP16. Bigger model at Q4 beats smaller at Q8. Only go Q8 if 2GB+ headroom remains.
How fast will it be?
About ~7–9 tok/s when 100% on GPU. Any CPU offload drops speed 5–20× — check ollama ps.
Is Apache-2.0 commercial-safe?
Yes — Apache-2.0 allows commercial use.
also fits Mac Studio 128GB
Qwen2.5-Coder 32B on other rigs