Can I run Llama 3.2?

Tiny Llamas for edge + on-device. Fast, light, 128K context.

chatgeneralagents · sizes: 1B, 3B · Llama 3.2 Community

What runs it

machine	best fit	verdict	speed
Apple M1 · 8GB	1B Q8_0	✅ Runs comfortably	30–55 tok/s
Apple M1 Pro · 16GB	3B Q8_0	✅ Runs comfortably	30–55 tok/s
Apple M2 · 16GB	3B Q8_0	✅ Runs comfortably	18–30 tok/s
Apple M3 Pro · 18GB	3B Q8_0	✅ Runs comfortably	25–40 tok/s
Apple M2 Pro · 32GB	3B Q8_0	✅ Runs comfortably	30–55 tok/s
Apple M4 Pro · 48GB	3B Q8_0	✅ Runs comfortably	40–70 tok/s
Apple M3 Max · 36GB	3B Q8_0	✅ Runs comfortably	55–90 tok/s
Apple M2 Max · 64GB	3B Q8_0	✅ Runs comfortably	55–90 tok/s
Apple M4 Max · 128GB	3B Q8_0	✅ Runs comfortably	70–110 tok/s
Apple M2 Ultra · 192GB	3B Q8_0	✅ Runs comfortably	95–160 tok/s
NVIDIA GeForce RTX 3060 · 12GB VRAM	3B Q8_0	✅ Runs comfortably	45–75 tok/s
NVIDIA GeForce RTX 4070 · 12GB VRAM	3B Q8_0	✅ Runs comfortably	65–100 tok/s
NVIDIA GeForce RTX 4090 · 24GB VRAM	3B Q8_0	✅ Runs comfortably	130–210 tok/s
NVIDIA GeForce RTX 5080 · 16GB VRAM	3B Q8_0	✅ Runs comfortably	120–200 tok/s
NVIDIA GeForce RTX 5090 · 32GB VRAM	3B Q8_0	✅ Runs comfortably	220–370 tok/s
AMD Radeon RX 7900 XTX · 24GB VRAM	3B Q8_0	✅ Runs comfortably	110–190 tok/s