can i run · seo
No — Nomic Embed Text v1.5 won't fit 2x RTX 3090 (48GB) at Q4
Nomic Embed Text v1.5 needs 0.3GB+ and exceeds 2x RTX 3090 (48GB). Try a smaller quant or model.
Local RAG embeddings. CPU is enough. Matryoshka dims.
Alternatives that do fit 2x RTX 3090 (48GB):
faq · straight answers
Can Nomic Embed Text v1.5 run on 2x RTX 3090 (48GB)?
Nomic Embed Text v1.5 needs 0.3GB+ and exceeds 2x RTX 3090 (48GB). Try a smaller quant or model. Model context 8k. Compare with all models or re-check with your exact specs on the bench.
What if it OOMs?
Unload with ollama stop, cap layers --num-gpu 28, cut context to 2k. See the OOM fixer on the homepage.
Q4 or Q8 on this rig?
Start Q4. Bigger model at Q4 beats smaller at Q8. Only go Q8 if 2GB+ headroom remains.
How fast will it be?
Slower than GPU — this combo needs offload. Pick a smaller model for interactive chat.
Is Apache-2.0 commercial-safe?
Yes — Apache-2.0 allows commercial use.
also fits 2x RTX 3090 (48GB)
Nomic Embed Text v1.5 on other rigs