can i run · seo
No — SmolLM3 3B won't fit RTX 5090 32GB at Q4
SmolLM3 3B needs 2GB+ and exceeds RTX 5090 32GB. Try a smaller quant or model.
On-device 3B from HF. Dual-mode thinking, tiny footprint.
Alternatives that do fit RTX 5090 32GB:
faq · straight answers
Can SmolLM3 3B run on RTX 5090 32GB?
SmolLM3 3B needs 2GB+ and exceeds RTX 5090 32GB. Try a smaller quant or model. Model context 64k. Compare with all models or re-check with your exact specs on the bench.
What if it OOMs?
Unload with ollama stop, cap layers --num-gpu 28, cut context to 2k. See the OOM fixer on the homepage.
Q4 or Q8 on this rig?
Start Q4. Bigger model at Q4 beats smaller at Q8. Only go Q8 if 2GB+ headroom remains.
How fast will it be?
Slower than GPU — this combo needs offload. Pick a smaller model for interactive chat.
Is Apache-2.0 commercial-safe?
Yes — Apache-2.0 allows commercial use.
also fits RTX 5090 32GB
SmolLM3 3B on other rigs