What AI models can AMD Radeon RX 9060 XT 8GB run?

The AMD Radeon RX 9060 XT 8GB can run 61 AI models. Top performers include Llama 3.2 1B Instruct, Llama 3.2 3B Instruct, Phi-4 Mini. See the full compatibility table above for speeds and quality ratings.

Is AMD Radeon RX 9060 XT 8GB good for AI coding?

With 8 GB, the AMD Radeon RX 9060 XT 8GB has limited VRAM for AI coding workflows.

How much VRAM does AMD Radeon RX 9060 XT 8GB have?

The AMD Radeon RX 9060 XT 8GB has 8 GB of GDDR6 VRAM with 256 GB/s bandwidth.

Can AMD Radeon RX 9060 XT 8GB run 70B models?

70B models can run on the AMD Radeon RX 9060 XT 8GB with CPU offloading, but performance will be reduced. Consider a device with 48GB+ inference memory for full-speed 70B inference.

Is AMD Radeon RX 9060 XT 8GB worth it for AI?

At $299, the AMD Radeon RX 9060 XT 8GB offers 8 GB GDDR6 VRAM and runs 61 AI models. It works for smaller models and experimentation.

Desktop GPU

AMD Radeon RX 9060 XT 8GB

8 GB GDDR6 · 256 GB/s

From

$299

Estimated street price

VRAM

8 GB

Bandwidth

256 GB/s

TDP

150W

Models

Tier

Limited

The AMD Radeon RX 9060 XT 8GB with 8 GB GDDR6 VRAM can handle 61 AI models across embedding, ai_building, coding. Best performance: Llama 3.2 1B Instruct at 106 tok/s (good). Current price: approximately $299.

Source: OwnRig methodology

VRAM

8 GB

Bandwidth

256 GB/s

Memory Type

GDDR6

TDP

150W

Form Factor

2-slot, 240mm

Builder Capability: Limited

Insufficient VRAM for most AI coding workflows.

Software

Inference Backends

The software stacks that matter most for real-world inference on this device.

ROCm

beta

Newer RDNA 4 ROCm path with improving runtime support but less field maturity than CUDA.

Vulkan

stable

Most reliable llama.cpp path for local inference on early RDNA 4 cards.

What it can run

61 models


all-MiniLM-L6-v2	FP16	–	Excellent
Arcee Trinity Mini 26B	Q3_K_M	–	Not viable
Arcee Trinity Nano 6B	Q8_0	56 tok/s	Excellent
Code Llama 34B Instruct	Q2_K	–	Not viable
Codestral 22B	Q3_K_M	–	Not viable
Command R 35B	Q3_K_M	–	Not viable
DeepSeek Coder V2 Lite 16B	Q5_K_M	–	Not viable
DeepSeek R1	Q2_K	–	Not viable
DeepSeek R1 Distill Qwen 32B	Q3_K_M	–	Not viable
DeepSeek R1 Distill Qwen 7B	Q8_0	–	Not viable
DeepSeek V3	Q2_K	–	Not viable
FLUX.1 Dev	Q4_K_M	–	Acceptable
Gemma 2 27B Instruct	Q3_K_M	–	Not viable
Gemma 2 9B Instruct	Q8_0	–	Not viable
Gemma 3 12B	Q5_K_M	–	Not viable
Gemma 3 27B	Q3_K_M	–	Not viable
Gemma 3 4B	Q5_K_M	17 tok/s	Acceptable
Gemma 4 26B-A4B	Q3_K_M	–	Not viable
Gemma 4 31B	Q3_K_M	–	Not viable
Gemma 4 E2B	Q8_0	48 tok/s	Good
Gemma 4 E4B	Q8_0	–	Not viable
GigaChat Lightning 10B	Q8_0	–	Not viable
InternLM 2.5 7B Chat	Q8_0	–	Not viable
Llama 3.1 70B Instruct	Q2_K	–	Not viable
Llama 3.1 8B Instruct	Q8_0	–	Not viable
Llama 3.2 11B Vision	Q6_K	–	Not viable
Llama 3.2 1B Instruct	Q8_0	106 tok/s	Good
Llama 3.2 3B Instruct	Q8_0	66 tok/s	Good
Llama 3.3 70B Instruct	Q3_K_M	–	Not viable
Llama 4 Scout	Q3_K_M	–	Not viable
LLaVA 1.6 13B	Q4_K_M	19 tok/s	Acceptable
Mistral 7B Instruct v0.3	Q8_0	–	Not viable
Mistral Large 2 123B	Q2_K	–	Not viable
Mistral Small 24B Instruct	Q3_K_M	–	Not viable
Mixtral 8x7B Instruct	Q2_K	–	Not viable
nomic-embed-text v1.5	FP16	–	Acceptable
NVIDIA Nemotron-3-super-120B-A12B	Q2_K	–	Not viable
Phi-3 Medium 14B Instruct	Q5_K_M	–	Not viable
Phi-3 Mini 3.8B Instruct	Q8_0	–	Acceptable
Phi-4 14B	Q4_K_M	–	Not viable
Phi-4 Mini	Q8_0	60 tok/s	Good
Qwen 2.5 14B Instruct	Q4_K_M	–	Not viable
Qwen 2.5 72B Instruct	Q2_K	–	Not viable
Qwen 2.5 7B Instruct	Q8_0	–	Not viable
Qwen 2.5 Coder 32B Instruct	Q2_K	–	Not viable
Qwen 2.5 Coder 7B Instruct	Q5_K_M	46 tok/s	Good
Qwen3-14B Instruct	Q5_K_M	–	Not viable
Qwen3-30B-A3B	Q3_K_M	–	Not viable
Qwen3-32B Instruct	Q3_K_M	–	Not viable
Qwen3-8B Instruct	Q8_0	–	Not viable
Qwen3.5-122B-A10B	Q3_K_M	–	Not viable
Qwen3.5-27B	Q3_K_M	–	Not viable
Qwen3.5-397B (MoE)	Q2_K	–	Not viable
QwQ 32B Preview	Q2_K	–	Not viable
Stable Diffusion 3 Medium	FP16	–	Acceptable
Stable Diffusion 3.5 Large	FP16	–	Not viable
Stable Diffusion XL 1.0	FP16	–	Excellent
StarCoder 2 15B	Q5_K_M	–	Not viable
Whisper Large V3	FP16	–	Excellent
Whisper Large V3 Turbo	FP16	–	Good
Yi 1.5 34B Chat	Q3_K_M	–	Not viable

Showing 61 of 61 entries

Buy Used

Prices and availability vary. Inspect hardware before purchasing. Some links may be affiliate links.

eBay Marketplace r/hardwareswap

FAQ

Frequently Asked Questions

What AI models can AMD Radeon RX 9060 XT 8GB run?: The AMD Radeon RX 9060 XT 8GB can run 61 AI models. Top performers include Llama 3.2 1B Instruct, Llama 3.2 3B Instruct, Phi-4 Mini. See the full compatibility table above for speeds and quality ratings.
Is AMD Radeon RX 9060 XT 8GB good for AI coding?: With 8 GB, the AMD Radeon RX 9060 XT 8GB has limited VRAM for AI coding workflows.
How much VRAM does AMD Radeon RX 9060 XT 8GB have?: The AMD Radeon RX 9060 XT 8GB has 8 GB of GDDR6 VRAM with 256 GB/s bandwidth.
Can AMD Radeon RX 9060 XT 8GB run 70B models?: 70B models can run on the AMD Radeon RX 9060 XT 8GB with CPU offloading, but performance will be reduced. Consider a device with 48GB+ inference memory for full-speed 70B inference.
Is AMD Radeon RX 9060 XT 8GB worth it for AI?: At $299, the AMD Radeon RX 9060 XT 8GB offers 8 GB GDDR6 VRAM and runs 61 AI models. It works for smaller models and experimentation.

Own this GPU?

See every AI model it supports, expected performance, and how to build around it.

Check my rig

Related Guides

Buying Guide

RX 9060 XT vs RTX 5060: which budget GPU wins for local AI?

Same $299 entry point, different ecosystems. We compare VRAM tiers, memory bandwidth, model counts from our compatibility matrix, and when AMD ROCm is worth the friction.

All GPUs