What hardware runs Mixtral 8x7B?

The cheapest cataloged machine that runs Mixtral 8x7B on the GPU is a NVIDIA GeForce RTX 5090 · 32GB VRAM. Here are the most affordable rigs that fit it, smallest memory first.

machinebest fitverdictspeed
NVIDIA GeForce RTX 5090 · 32GB VRAM 8x7B (MoE) Q4_K_M ✅ Runs (tight) 85–140 tok/s
AMD Radeon Pro W7900 · 48GB VRAM 8x7B (MoE) Q5_K_M ✅ Runs comfortably 35–60 tok/s
Apple M3 Max · 48GB 8x7B (MoE) Q4_K_M ✅ Runs (tight) 20–35 tok/s
Apple M4 Max · 48GB 8x7B (MoE) Q4_K_M ✅ Runs (tight) 25–40 tok/s
Apple M4 Pro · 48GB 8x7B (MoE) Q4_K_M ✅ Runs (tight) 16–25 tok/s
Apple M1 Max · 64GB 8x7B (MoE) Q5_K_M ✅ Runs comfortably 18–30 tok/s
Apple M1 Ultra · 64GB 8x7B (MoE) Q5_K_M ✅ Runs comfortably 25–40 tok/s
Apple M2 Max · 64GB 8x7B (MoE) Q5_K_M ✅ Runs comfortably 18–30 tok/s
Apple M2 Ultra · 64GB 8x7B (MoE) Q5_K_M ✅ Runs comfortably 25–40 tok/s
Apple M2 Max · 96GB 8x7B (MoE) Q8_0 ✅ Runs comfortably 13–20 tok/s
Apple M2 Ultra · 128GB 8x7B (MoE) Q8_0 ✅ Runs comfortably 17–30 tok/s
Apple M3 Max · 128GB 8x7B (MoE) Q8_0 ✅ Runs comfortably 13–20 tok/s

Already have a machine? See Mixtral 8x7B across popular rigs → or check your exact rig →

Planning a whole workflow? Rigs for a coding agent · local chat · reasoning · local RAG setup.

$npx runlocal-sh can-i-run mixtral --hardware <your-rig>

Verdicts use the same GQA-aware fit math as the CLI — a NVIDIA GeForce RTX 5090 verdict here matches what runlocal tells you on the machine.