Framework Desktop (Ryzen AI Max+ 395) vs RTX 3090 (used) + 128 GB DDR5 on AM5 (MoE offload)
The Framework Desktop (Ryzen AI Max+ 395) gives a model 96 GB to work in, against 24 GB on the RTX 3090 (used) + 128 GB DDR5 on AM5 (MoE offload). The RTX 3090 (used) + 128 GB DDR5 on AM5 (MoE offload) has 3.7× the memory bandwidth (936 against 256 GB/s), which sets the ceiling on generation speed. The largest 4-bit model each holds at 8,192 tokens of context: Nemotron 3 Super 120B-A12B on the Framework Desktop (Ryzen AI Max+ 395), Qwen3.6 35B-A3B on the RTX 3090 (used) + 128 GB DDR5 on AM5 (MoE offload). The RTX 3090 (used) + 128 GB DDR5 on AM5 (MoE offload) has no complete price: used GPU price not included. Rows where the two differ are tinted.
AMD unified memory
Framework Desktop (Ryzen AI Max+ 395)
A 4.5-liter desktop built around the full Strix Halo chip, sold as a DIY Edition you finish with your own SSD and OS. The 128GB version lets the GPU use 96GB, enough for a 70B dense model or a 100B-class MoE model at 4-bit.
gpt-oss-20b, 4-bit: 73 tok/s
Hybrid GPU + RAM
RTX 3090 (used) + 128 GB DDR5 on AM5 (MoE offload)
Budget MoE offload: a used 3090 holds attention and KV cache while 128 GB of desktop DDR5 holds the experts, enough for ~100B-class MoE models at 4-bit.
gpt-oss-20b, 4-bit: 162 tok/s
| Specification | Framework Desktop (Ryzen AI Max+ 395) | RTX 3090 (used) + 128 GB DDR5 on AM5 (MoE offload) |
|---|---|---|
| Kind | AMD unified memory · Framework | Hybrid GPU + RAM · DIY |
| Chip or GPUs | Ryzen AI Max+ 395 | RTX 3090 |
| Memory | 64 GB, 128 GB | 24 GB VRAM + 128 GB RAM |
| Memory for models | 96 GB (GPU-usable memory) | 24 GB (VRAM) |
| Other memory figure | none | 144 GB (GPU + RAM offload)assumption |
| Memory bandwidth | 256 GB/s | 936 GB/s |
| FP16 compute | not published | 71.2 TFLOPS |
| Price | ~$1,959–$3,449 | ~$4,833 + unpriced parts (used GPU price not included) |
| Largest at 4-bit, 8k context | Nemotron 3 Super 120B-A12B | Qwen3.6 35B-A3B |
| Software | ROCm, Vulkan, DirectML | CUDA, Vulkan |
| Power | 400 W | 1200 W power supply |
What each one runs
Every model in the catalog that at least one of the two holds at 4-bit with 8,192 tokens of context. Copper speeds are measured medians; outlined ones are estimates. Rows where only one fits, or where the speed differs by more than a quarter, are tinted.
| Model | Framework Desktop (Ryzen AI Max+ 395) | RTX 3090 (used) + 128 GB DDR5 on AM5 (MoE offload) |
|---|---|---|
| MiniMax M2.7228.7B · 129.3 GB file | does not fit | GPU + RAM offloadassumed limit– |
| Qwen3.8 Flash-Next125B, 6B active · 111.4 GB file | does not fit | GPU + RAM offloadassumed limit~5.4–7.9 tok/sestimate, part in RAM |
| Nemotron 3 Super 120B-A12B120B, 12B active · 81.0 GB file | 15 tok/smedian of 2 runs | GPU + RAM offloadassumed limit~3.9–5.7 tok/sestimate, part in RAM |
| Qwen3.5 122B-A10B122B, 10B active · 71.3 GB file | 20 tok/smedian of 2 runs | GPU + RAM offloadassumed limit~5.6–8.2 tok/sestimate, part in RAM |
| Mistral Medium 3.5 128B128B · 69.8 GB file | ~2.3–2.8 tok/sestimate | GPU + RAM offloadassumed limit~0.9–1.4 tok/sestimate, part in RAM |
| GLM-4.5-Air106B, 12B active · 68.0 GB file | ~15–19 tok/sestimate | GPU + RAM offloadassumed limit~4.3–6.2 tok/sestimate, part in RAM |
| Mistral Small 4 119B (2603)119B, 6.5B active · 67.6 GB file | ~30–39 tok/sestimate | GPU + RAM offloadassumed limit~9.1–13 tok/sestimate, part in RAM |
| Llama 4 Scout 17B-16E Instruct109B, 17B active · 60.9 GB file | 18 tok/smedian of 2 runs | GPU + RAM offloadassumed limit~3.7–5.4 tok/sestimate, part in RAM |
| gpt-oss-120b117B, 5.1B active · 58.5 GB file | 52 tok/smedian of 5 runs | GPU + RAM offloadassumed limit~14–21 tok/sestimate, part in RAM |
| Qwen3 Coder Next80B, 3B active · 45.2 GB file | ~66–85 tok/sestimate | GPU + RAM offloadassumed limit~25–36 tok/sestimate, part in RAM |
| Llama 3.3 70B Instruct70B · 39.6 GB file | 4.8 tok/smedian of 4 runs | GPU + RAM offloadassumed limit~2.1–3.4 tok/sestimate, part in RAM |
| Nemotron 3.5 Lightning 30B-A3B30B, 3B active · 23.7 GB file | ~47–60 tok/sestimate | GPU + RAM offloadassumed limit~64–93 tok/sestimate, part in RAM |
| Qwen3.6 35B-A3B35B, 3B active · 20.8 GB file | 60 tok/smedian of 7 runs | ~122–178 tok/sestimate |
| Ornith 1.5 35B-A3B35B, 3B active · 20.2 GB file | ~65–83 tok/sestimate | ~125–183 tok/sestimate |
| Qwen3 Coder 30B-A3B Instruct30.5B, 3.3B active · 17.3 GB file | ~60–77 tok/sestimate | ~116–169 tok/sestimate |
| Gemma 4 31B IT30.7B · 17.1 GB file | 11 tok/smedian of 2 runs | 35 tok/smedian of 1 run |
| Granite 4.2 30B29.3B · 16.8 GB file | ~9.6–12 tok/sestimate | ~25–40 tok/sestimate |
| Qwen3.8 27B27B · 16.2 GB file | 12 tok/smedian of 2 runs | ~26–41 tok/sestimate |
| Gemma 4 26B-A4B IT25.2B, 3.8B active · 15.9 GB file | 52 tok/smedian of 2 runs | 119 tok/smedian of 1 run |
| Qwen3.6 27B27B · 15.7 GB file | ~10–12 tok/sestimate | ~27–43 tok/sestimate |
| Devstral Small 2 24B (2512)24B · 13.3 GB file | ~12–15 tok/sestimate | ~32–50 tok/sestimate |
| gpt-oss-20b21B, 3.6B active · 10.8 GB file | 73 tok/smedian of 3 runs | 162 tok/smedian of 3 runs |
| Phi-414.7B · 8.3 GB file | ~20–23 tok/sestimate | ~52–81 tok/sestimate |
| Ministral 3 14B Reasoning (2512)13.9B · 7.7 GB file | ~21–25 tok/sestimate | ~56–87 tok/sestimate |
| Gemma 4 12B IT11.95B · 6.6 GB file | ~24–29 tok/sestimate | ~64–101 tok/sestimate |
| Qwen3.5 9B9B · 5.3 GB file | ~31–37 tok/sestimate | ~81–127 tok/sestimate |
| Granite 4.2 8B8.8B · 5.2 GB file | ~31–38 tok/sestimate | ~83–130 tok/sestimate |
| Gemma 4 E4B IT8B · 5.0 GB file | ~57–68 tok/sestimate | ~151–237 tok/sestimate |
| Qwen3 8B8.2B · 4.7 GB file | ~35–41 tok/sestimate | 115 tok/smedian of 1 run |
| Llama 3.1 8B Instruct8B · 4.6 GB file | 40 tok/smedian of 2 runs | 122 tok/smedian of 2 runs |
| Qwen3.5 4B4B · 2.6 GB file | ~63–76 tok/sestimate | ~167–263 tok/sestimate |
Full pages: Framework Desktop (Ryzen AI Max+ 395) · RTX 3090 (used) + 128 GB DDR5 on AM5 (MoE offload) · check a different quant or context length