No — FLUX.1 dev won't fit 2x RTX 3090 (48GB) at Q4
FLUX.1 dev needs 10GB+ and exceeds 2x RTX 3090 (48GB). Try a smaller quant or model.
Higher-fidelity FLUX. Wants 16–24 GB. Non-commercial weights.
Can FLUX.1 dev run on 2x RTX 3090 (48GB)?
FLUX.1 dev needs 10GB+ and exceeds 2x RTX 3090 (48GB). Try a smaller quant or model. Model context 0k. Compare with all models or re-check with your exact specs on the bench.
Unload with ollama stop, cap layers --num-gpu 28, cut context to 2k. See the OOM fixer on the homepage.
Start Q4. Bigger model at Q4 beats smaller at Q8. Only go Q8 if 2GB+ headroom remains.
Slower than GPU — this combo needs offload. Pick a smaller model for interactive chat.
Non-commercial — check terms before commercial use. Filter commercial-safe on the bench.