Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s
- Mac: 16 events in the last 90 days
- Previous: earlier the same day · The downsides of switching from Windows to Mac
What happened
Run Qwen3.8-Flash-Next (125B MoE, 104 GB at 4-bit) on Macs with a fraction of that RAM by streaming experts from SSD. MLX + Swift, Ollama-compatible API. - carloslfu/slotstream
Summary assembled by rule from the sources below