can i run · seo
No — Nemotron 3 Nano 30B-A3B won't fit RTX 3060 12GB at Q4
Nemotron 3 Nano 30B-A3B needs 18GB+ and exceeds RTX 3060 12GB. Try a smaller quant or model.
3B active MoE. Fast on consumer GPUs, official GGUF from ggml-org.
Alternatives that do fit RTX 3060 12GB:
faq · straight answers
Can Nemotron 3 Nano 30B-A3B run on RTX 3060 12GB?
Nemotron 3 Nano 30B-A3B needs 18GB+ and exceeds RTX 3060 12GB. Try a smaller quant or model. Model context 128k. Compare with all models or re-check with your exact specs on the bench.
What if it OOMs?
Unload with ollama stop, cap layers --num-gpu 28, cut context to 2k. See the OOM fixer on the homepage.
Q4 or Q8 on this rig?
Start Q4. Bigger model at Q4 beats smaller at Q8. Only go Q8 if 2GB+ headroom remains.
How fast will it be?
Slower than GPU — this combo needs offload. Pick a smaller model for interactive chat.
Is NVIDIA commercial-safe?
NVIDIA — check terms before commercial use. Filter commercial-safe on the bench.
also fits RTX 3060 12GB
Nemotron 3 Nano 30B-A3B on other rigs