What if Qwen3.8-Flash-Next runs out of memory on Mac Studio 128GB?

Unload idle models, cap GPU layers with --num-gpu, and cut context to 2048. KV cache grows with context and is the usual OOM cause.

Should I use Q4 or Q8 for Qwen3.8-Flash-Next?

Start Q4_K_M. Bigger model at Q4 beats smaller at Q8. Use Q8 only with 2GB+ headroom.

can i run · seo

Yes — Qwen3.8-Flash-Next runs on Mac Studio 128GB

Qwen3.8-Flash-Next (MoE 180B · 6B active) needs 64GB VRAM at Q3 vs your 128GB unified. Estimated ~160+ tok/s (blazing).

180B hybrid (6B active + n-gram memory), 256k multimodal with thinking + tools. UD-Q4 ≈ 100 GB — 128 GB unified or 2×24 GB + RAM.

best fit on this rig · weights + KV + headroom

Q3 · 64GB weights+0.4GB KV @ 8kfits GPU~160+ tok/s (blazing)

quant	weights	+ KV 8k	fits 128GB?
IQ2	48GB	~48.4GB	✓ yes
Q3	64GB	~64.4GB	✓ yes
Q4	100GB	~100.4GB	✓ yes
Q8	185GB	~185.4GB	× tight/no

File size ≠ runtime. KV grows with context — halve to 4k/2k if long chats OOM. Leave 1–2GB free.

llama-cli -hf unsloth/Qwen3.8-Flash-Next-GGUF:UD-Q4_K_XL

Run it: 1) install Ollama · 2) copy command · 3) verify with ollama ps (want 100% GPU).

huggingface GGUF

faq · straight answers

Can Qwen3.8-Flash-Next run on Mac Studio 128GB?

Qwen3.8-Flash-Next (MoE 180B · 6B active) needs 64GB VRAM at Q3 vs your 128GB unified. Estimated ~160+ tok/s (blazing). Model context 256k. Compare with all models or re-check with your exact specs on the bench.

What if it OOMs?

Unload with ollama stop, cap layers --num-gpu 28, cut context to 2k. See the OOM fixer on the homepage.

Q4 or Q8 on this rig?

Start Q3. Bigger model at Q4 beats smaller at Q8. Only go Q8 if 2GB+ headroom remains.

How fast will it be?

About ~160+ tok/s (blazing) when 100% on GPU. Any CPU offload drops speed 5–20× — check ollama ps.

Is Qwen-Community commercial-safe?

Qwen-Community — check terms before commercial use. Filter commercial-safe on the bench.

also fits Mac Studio 128GB

Qwen3.8 27B · FP16 DeepSeek-V4 Flash · IQ2 Mistral Small 3.2 · FP16 Llama 4 Scout · Q5

Qwen3.8-Flash-Next on other rigs

8 GB laptop RTX 3060 12GB RTX 4070 12GB RTX 4090 24GB 2x RTX 3090 (48GB)RTX 5090 32GB

Check your own rig in 15 seconds →

real-time global visitors

Coarse location inferred from browser timezone without fingerprinting or tracking cookies. Every blinking node represents an active hardware builder browsing the open-weight registry.

growingearly builders · be earlylive0 active

recent pings · timezone-derived0 nodes

listening for hardware builders…

┌────────────────────────────────────────────────────────────────┐ │· -180° · · · · -90° · · · · · · 0° · · · · · · +90° · · +180° ·│ │ __..---..__ .---. _..----.._ _.._ │ │ .' · NA · '. / · \ .' · EU · '. .'·AP │ │ / *US/CA* · \| GL |· / *UK/DE/FR* \ / *JP/CN│ │| [W-COAST] · || · · · | · | [CENTRAL] · | | *IN/KR│ │ \ [E-COAST]· / \ · / · \ [MEDIT] · / \ *SG/AU│ │ '. · · · .' '---' '. · · · .' '. · │ │ '-·_____·-' · · '-·____·-' '--· │ │ · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · │ │ _.._ _.._ · · · _.._ │ │ .' · '. .' · '. .' · '. │ │ / LATAM \ / AFRICA \ / ANZ \ │ │ | *BR/MX/AR|· | *ZA/KE/NG| | *AU/NZ* | │ │ \ · · / \ · · / | · · | │ │ '. · .' '. · .' \ · · / │ │ '..' '..' '.____.' │ │[LAT -60°] · · · · · · · · · · · · · · · · · · · · · ·[LAT +60°]│ │ >> ACTIVE NODE RADAR · TELEMETRY MESH // SYNCED VIA TIMEZONE << │ └────────────────────────────────────────────────────────────────┘