AMD RX 7900 XT vs Apple M2 Ultra (192GB)

How these GPUs compare for running local LLMs — VRAM, bandwidth, price, and per-model fit across popular open-weights models.

54 models compared20 GB vs 192 GB VRAM800 GB/s vs 800 GB/s$679 vs $5,499
GPU A

AMD RX 7900 XT

VRAM
20 GB
Bandwidth
800 GB/s
Street price
$679
Vendor
amd
GPU BRuns more models

Apple M2 Ultra (192GB)

VRAM
192 GB
Bandwidth
800 GB/s
Street price
$5,499
Vendor
apple

The short answer

Apple M2 Ultra (192GB) can run 19 models that AMD RX 7900 XT can't fit in VRAM — mostly the larger models. For the 27 models both can handle, speeds are similar. If you want headroom for bigger models, Apple M2 Ultra (192GB) is the clear choice.

19 models B runs, A can't
10 models A is 20%+ faster
17 equal (both run, <20% diff)
8 too large for either

Model-by-model fit

Click any row for the full breakdown. Tie% shown in the Winner column when both GPUs run the model within 20% of each other.

ModelAMD RX 7900 XTApple M2 Ultra (192GB)Winner
c4ai-command-r-v01 35B
35B · command
Too large10 tok/s · FP16B (only)
Command-R+ 104B
104B · command
Too large6 tok/s · Q8_0B (only)
DeepSeek R1 Distill Llama 8B
8B · deepseek
41 tok/s · FP1641 tok/s · FP16equal
DeepSeek R1 Distill Qwen 14B
14.8B · deepseek
44 tok/s · Q8_023 tok/s · FP16A (faster)
DeepSeek R1 Distill Llama 70B
70.6B · deepseek
Too large5 tok/s · FP16B (only)
DeepSeek R1 671B
671B · deepseek
Too largeToo large
DeepSeek-V3 685B
685B · deepseek
Too largeToo large
DeepSeek-V3.2 685.4B
685.4B · deepseek
Too largeToo large
gemma-2-9b
9.2B · gemma
36 tok/s · FP1636 tok/s · FP16equal
gemma-2-27b
27.2B · gemma
43 tok/s · Q4_K_M12 tok/s · FP16A (faster)
Llama 3.1 8B Compact
8B · llama
37 tok/s · FP1637 tok/s · FP16equal
CodeLlama 34B
34B · llama
Too large10 tok/s · FP16B (only)
CodeLlama 34B
34B · llama
Too large10 tok/s · FP16B (only)
Llama 3.3 70B
70.6B · llama
Too large5 tok/s · FP16B (only)
Llama 3.1 70B
70.6B · llama
Too large5 tok/s · FP16B (only)
Llama 4 Scout 17B
109B · llama
Too large5 tok/s · Q8_0B (only)
Llama-4-Maverick-17B-128E
400B · llama
Too largeToo large
Llama 3.1 405B
405B · llama
Too largeToo large
Mistral 7B v0.1
7.25B · mistral
45 tok/s · FP1645 tok/s · FP16equal
Codestral 22B
22.2B · mistral
36 tok/s · Q6_K15 tok/s · FP16A (faster)
Mixtral 8x7B Instruct v0.1
47B · mixtral
Too large6 tok/s · FP16B (only)
Mistral Large 2 123B
123B · mistral
Too large5 tok/s · Q8_0B (only)
Phi-4-mini 3.8B
3.8B · phi
84 tok/s · FP1684 tok/s · FP16equal
Phi-4 14B
14B · phi
42 tok/s · Q8_021 tok/s · FP16A (faster)
Qwen 2.5 1.5B
1.5B · qwen
195 tok/s · FP16195 tok/s · FP16equal
Qwen 2.5 3B
3.1B · qwen
102 tok/s · FP16102 tok/s · FP16equal
Qwen3.5-4B
4.7B · qwen
69 tok/s · FP1669 tok/s · FP16equal
Qwen 2.5 7B
7.6B · qwen
43 tok/s · FP1643 tok/s · FP16equal
Qwen 2.5 7B
7.6B · qwen
43 tok/s · FP1643 tok/s · FP16equal
Qwen 3 8B
8B · qwen
37 tok/s · FP1637 tok/s · FP16equal
Qwen3.5-9B
9.7B · qwen
67 tok/s · Q8_034 tok/s · FP16A (faster)
Qwen 3 32B
32B · qwen
Too large9 tok/s · FP16B (only)
Qwen3.5-35B-A3B
36B · qwen
Too large9 tok/s · FP16B (only)
Qwen 2.5 72B
72.7B · qwen
Too large5 tok/s · FP16B (only)
Qwen 2.5 72B
72.7B · qwen
Too large5 tok/s · FP16B (only)
Llama 3.2 1B
1.24B · llama
238 tok/s · FP16238 tok/s · FP16equal
Llama 4 Scout 17B
109B · llama
Too large5 tok/s · Q8_0B (only)
DeepSeek R1 671B
671B · deepseek
Too largeToo large
Gemma 3 27B
27B · gemma
39 tok/s · Q4_K_M11 tok/s · FP16A (faster)
Qwen 3 8B
8B · qwen
37 tok/s · FP1637 tok/s · FP16equal
Qwen 3 32B
32B · qwen
Too large9 tok/s · FP16B (only)
Llama 3.1 8B Compact
8B · llama
37 tok/s · FP1637 tok/s · FP16equal
Mixtral 8x7B Instruct v0.1
47B · mixtral
Too large6 tok/s · FP16B (only)
Mistral Small 3.2 24B
24B · mistral
52 tok/s · Q4_K_M15 tok/s · FP16A (faster)
Command A 111B
111B · command
Too large6 tok/s · Q8_0B (only)
DeepSeek R1 0528
685B · deepseek
Too largeToo large
DeepSeek-V3-0324
684.5B · deepseek
Too largeToo large
DeepSeek-R1-0528-Qwen3-8B
8.2B · qwen
42 tok/s · FP1642 tok/s · FP16equal
Qwen3-235B-A22B-Instruct-2507
235B · qwen
Too large5 tok/s · Q4_K_MB (only)
Qwen3-30B-A3B-Instruct-2507
30B · qwen
41 tok/s · Q4_K_M23 tok/s · Q8_0A (faster)
Qwen3-4B-Instruct-2507
4B · qwen
87 tok/s · FP1687 tok/s · FP16equal
gemma-4-E4B-it
8B · gemma
44 tok/s · FP1644 tok/s · FP16equal
gemma-4-26B-A4B-it
26.5B · gemma
47 tok/s · Q4_K_M26 tok/s · Q8_0A (faster)
gemma-4-31B-it
32.7B · gemma
38 tok/s · Q4_K_M21 tok/s · Q8_0A (faster)

Want a different pairing? Browse all comparisons →

Stay ahead of local AI