What hardware runs OLMo 2 7B?

The cheapest cataloged machine that runs OLMo 2 7B on the GPU is a NVIDIA GeForce RTX 3080 · 10GB VRAM. Here are the most affordable rigs that fit it, smallest memory first.

machinebest fitverdictspeed
NVIDIA GeForce RTX 3080 · 10GB VRAM 7B Q4_K_M ✅ Runs (tight) 35–60 tok/s
AMD Radeon RX 6700 XT · 12GB VRAM 7B Q6_K ✅ Runs (tight) 15–25 tok/s
AMD Radeon RX 7700 XT · 12GB VRAM 7B Q6_K ✅ Runs (tight) 16–25 tok/s
NVIDIA GeForce RTX 3060 · 12GB VRAM 7B Q6_K ✅ Runs (tight) 14–25 tok/s
NVIDIA GeForce RTX 4070 · 12GB VRAM 7B Q6_K ✅ Runs (tight) 20–35 tok/s
AMD Radeon RX 6800 XT · 16GB VRAM 7B Q8_0 ✅ Runs (tight) 17–30 tok/s
AMD Radeon RX 6950 XT · 16GB VRAM 7B Q8_0 ✅ Runs (tight) 19–30 tok/s
AMD Radeon RX 7800 XT · 16GB VRAM 7B Q8_0 ✅ Runs (tight) 20–35 tok/s
NVIDIA GeForce RTX 4080 · 16GB VRAM 7B Q8_0 ✅ Runs (tight) 25–40 tok/s
NVIDIA GeForce RTX 5080 · 16GB VRAM 7B Q8_0 ✅ Runs (tight) 35–55 tok/s
Apple M3 Pro · 18GB 7B Q4_K_M ✅ Runs (tight) 10–16 tok/s
AMD Radeon RX 7900 XT · 20GB VRAM 7B Q8_0 ✅ Runs comfortably 25–45 tok/s

Already have a machine? See OLMo 2 7B across popular rigs → or check your exact rig →

Planning a whole workflow? Rigs for a coding agent · local chat · reasoning · local RAG setup.

$npx runlocal-sh can-i-run olmo2 --hardware <your-rig>

Verdicts use the same GQA-aware fit math as the CLI — a NVIDIA GeForce RTX 3080 verdict here matches what runlocal tells you on the machine.