← All models
Mistral AI · dense · Apache-2.0
What runs Ministral 3 14B Reasoning (2512)
Dense 14B reasoning model from Mistral's Ministral 3 line with image input. Fits 12-16 GB GPUs at 4-bit.
- Parameters
- 13.9B
- 4-bit file
- 7.7 GB
- Q4_K_M
- Needs at 8k context
- 10.4 GB
- Longest context
- 262,144 tokens
Context memory: 163,840 bytes per token. Standard GQA: 2 x 40 layers x 8 KV heads x 128 head dim x 2 bytes (fp16). How context memory works.
Measured on this hardware
Machines that hold the 4-bit file with 8,192 tokens of context and have published runs on the same chip or cards, fastest first. Median of single-user runs with plain decoding.
No published run on a machine that fits it.
Estimated, not measured
These fit but nobody has published a run we could match. The figure is memory bandwidth divided by the bytes read per token, scaled by the share of that ceiling measured runs reach. How estimates work.
| Machine | Fit | Price | Generation |
|---|---|---|---|
| Dell Pro Precision with GB300NVIDIA workstation | Fits | ~$159,283 | ~585–701 tok/sestimate |
| Dell Pro Max Tower T2 with NVIDIA RTX PRO 6000 BlackwellNVIDIA workstation | Fits | ~$13,909 | ~107–167 tok/sestimate |
| 1x RTX 5090Single GPU | Fits | ~$3,234 + unpriced parts | ~107–167 tok/sestimate |
| 2x RTX 5090Multi-GPU | Fits | ~$4,109 + unpriced parts | ~107–167 tok/sestimate |
| 1x RTX PRO 6000 BlackwellSingle GPU | Fits | ~$20,833 | ~107–167 tok/sestimate |
| RTX 5090 + EPYC 9355P with 768 GB DDR5 (MoE offload)Hybrid GPU + RAM | Fits | ~$3,763 + unpriced parts | ~107–167 tok/sestimate |
| Apple Mac Studio (M5 Ultra, 64-core GPU)Apple unified memory | Fitsassumed limitfrom 96 GB | ~$5,499–$9,499 | ~107–133 tok/sestimate |
| Apple Mac Studio (M5 Ultra, 80-core GPU)Apple unified memory | Fitsassumed limitfrom 96 GB | ~$6,799–$10,799 | ~107–133 tok/sestimate |
| 4x Instinct MI50 32GB (used) on EPYC 7003Multi-GPU | Fits | ~$1,998 + unpriced parts | ~61–96 tok/sestimate |
| 2x Radeon RX 7900 XTXMulti-GPU | Fits | ~$5,637 | ~57–90 tok/sestimate |
| 1x RTX 3090 (used)Single GPU | Fits | ~$2,944 + unpriced parts | ~56–87 tok/sestimate |
| 2x RTX 3090 (used)Multi-GPU | Fits | ~$3,639 + unpriced parts | ~56–87 tok/sestimate |
| 4x RTX 3090 (used) on EPYC 7003, open frameMulti-GPU | Fits | ~$2,178 + unpriced parts | ~56–87 tok/sestimate |
| RTX 3090 (used) + 128 GB DDR5 on AM5 (MoE offload)Hybrid GPU + RAM | Fits | ~$4,833 + unpriced parts | ~56–87 tok/sestimate |
| Apple Mac Studio (M5 Max, 40-core GPU)Apple unified memory | Fitsassumed limitfrom 48 GB | ~$3,099–$5,099 | ~55–68 tok/sestimate |
| Apple MacBook Pro 14-inch (M5 Max, 40-core GPU)Apple unified memory | Fitsassumed limitfrom 48 GB | ~$4,699–$6,699 | ~55–68 tok/sestimate |
| Apple MacBook Pro 16-inch (M5 Max, 40-core GPU)Apple unified memory | Fitsassumed limitfrom 48 GB | ~$4,999–$6,999 | ~55–68 tok/sestimate |
| tiny corp tinybox red flashGPU desktop (prebuilt) | Fits | ~$22,000 | ~38–60 tok/sestimate |
| Apple Mac Studio (M5 Max, 32-core GPU)Apple unified memory | Fitsassumed limit | ~$2,499 | ~41–51 tok/sestimate |
| Apple MacBook Pro 14-inch (M5 Max, 32-core GPU)Apple unified memory | Fitsassumed limit | ~$4,099 | ~41–51 tok/sestimate |
| Apple MacBook Pro 16-inch (M5 Max, 32-core GPU)Apple unified memory | Fitsassumed limit | ~$4,399 | ~41–51 tok/sestimate |
| 2x Intel Arc Pro B60Multi-GPU | Fits | ~$4,367 | ~27–43 tok/sestimate |
| Apple Mac mini (M5 Pro, 16-core GPU)Apple unified memory | Fitsassumed limitfrom 24 GB | ~$1,699–$2,699 | ~27–34 tok/sestimate |
| Apple Mac mini (M5 Pro, 20-core GPU)Apple unified memory | Fitsassumed limitfrom 24 GB | ~$1,899–$2,899 | ~27–34 tok/sestimate |
| Framework Desktop (Ryzen AI Max+ PRO 495)AMD unified memory | Fitsassumed limit | ~$6,799 | ~22–27 tok/sestimate |
| NVIDIA DGX SparkNVIDIA GB10 | Fitsassumed limit | ~$4,699 | ~22–27 tok/sestimate |
| Dell Pro Precision with GB10NVIDIA GB10 | Fitsassumed limit | ~$5,523 | ~22–27 tok/sestimate |
| Framework Desktop (Ryzen AI Max+ 395)AMD unified memory | Fitsassumed limitfrom 64 GB | ~$1,959–$3,449 | ~21–25 tok/sestimate |
| Framework Desktop (Ryzen AI Max 385)AMD unified memory | Fitsassumed limit | ~$1,269 | ~21–25 tok/sestimate |
| GMKtec EVO-X2 (Ryzen AI Max+ 395)AMD unified memory | Fitsassumed limitfrom 64 GB | ~$2,600–$4,000 | ~21–25 tok/sestimate |
| Beelink GTR9 Pro (Ryzen AI Max+ 395)AMD unified memory | Fits | ~$4,699 | ~21–25 tok/sestimate |
| Minisforum MS-S1 MAX (Ryzen AI Max+ 395)AMD unified memory | Fits | ~$4,899 | ~21–25 tok/sestimate |
| Corsair AI Workstation 300 (Ryzen AI Max+ 395)AMD unified memory | Fits | ~$4,800 | ~21–25 tok/sestimate |
| HP Z2 Mini G1a (Ryzen AI Max+ PRO 395)AMD unified memory | Fits | ~$4,999 | ~21–25 tok/sestimate |
Fits, no speed figure
Files
| Quant | Format | Size | Repo |
|---|---|---|---|
| Q4_K_M | GGUF | 7.7 GB | unsloth/Ministral-3-14B-Reasoning-2512-GGUF |
| 4bit | MLX | 7.8 GB | mlx-community/Ministral-3-14B-Reasoning-2512-4bit |
| Q5_K_M | GGUF | 9.0 GB | unsloth/Ministral-3-14B-Reasoning-2512-GGUF |
| Q6_K | GGUF | 10.3 GB | unsloth/Ministral-3-14B-Reasoning-2512-GGUF |
| Q8_0 | GGUF | 13.4 GB | unsloth/Ministral-3-14B-Reasoning-2512-GGUF |
| 8bit | MLX | 14.2 GB | mlx-community/Ministral-3-14B-Reasoning-2512-8bit |
Sources
- huggingface.co: model card: params, context, license, attention layout, description
- huggingface.co: license and parameter count from the published weights (the card gives none)
- huggingface.co: layer count, KV heads and head size
- huggingface.co: GGUF file sizes (shards summed)
- huggingface.co: MLX 4bit safetensors sizes
- huggingface.co: MLX 8bit safetensors sizes