Strong open embedding model for retrieval. Small and quick.
embeddingsrag · sizes: 335M · Apache-2.0
| machine | best fit | verdict | speed |
|---|---|---|---|
| Apple M1 · 8GB | 335M F16 | ✅ Runs comfortably | 60–100 tok/s |
| Apple M1 Pro · 16GB | 335M F16 | ✅ Runs comfortably | 160–260 tok/s |
| Apple M2 · 16GB | 335M F16 | ✅ Runs comfortably | 85–140 tok/s |
| Apple M3 Pro · 18GB | 335M F16 | ✅ Runs comfortably | 120–200 tok/s |
| Apple M2 Pro · 32GB | 335M F16 | ✅ Runs comfortably | 160–260 tok/s |
| Apple M4 Pro · 48GB | 335M F16 | ✅ Runs comfortably | 200–340 tok/s |
| Apple M3 Max · 36GB | 335M F16 | ✅ Runs comfortably | 260–440 tok/s |
| Apple M2 Max · 64GB | 335M F16 | ✅ Runs comfortably | 260–440 tok/s |
| Apple M4 Max · 128GB | 335M F16 | ✅ Runs comfortably | 330–550 tok/s |
| Apple M2 Ultra · 192GB | 335M F16 | ✅ Runs comfortably | 460–760 tok/s |
| NVIDIA GeForce RTX 3060 · 12GB VRAM | 335M F16 | ✅ Runs comfortably | 220–360 tok/s |
| NVIDIA GeForce RTX 4070 · 12GB VRAM | 335M F16 | ✅ Runs comfortably | 300–510 tok/s |
| NVIDIA GeForce RTX 4090 · 24GB VRAM | 335M F16 | ✅ Runs comfortably | 610–1020 tok/s |
| NVIDIA GeForce RTX 5080 · 16GB VRAM | 335M F16 | ✅ Runs comfortably | 580–970 tok/s |
| NVIDIA GeForce RTX 5090 · 32GB VRAM | 335M F16 | ✅ Runs comfortably | 1080–1810 tok/s |
| AMD Radeon RX 7900 XTX · 24GB VRAM | 335M F16 | ✅ Runs comfortably | 550–920 tok/s |
Shopping for a machine? What hardware do I need to run mxbai-embed-large? →
Check your exact rig: open the checker →