Qwen 2.5 72B Instruct on NVIDIA GeForce RTX 4070 Ti 12GB
NVIDIA GeForce RTX 4070 Ti 12GB cannot run Qwen 2.5 72B Instruct at any quantization level. The 12 GB of VRAM is insufficient.
Model Size
72.7B
Device VRAM
12 GB
Bandwidth
504 GB/s
Quantizations Tested
1
Performance by Quantization
Each row shows Qwen 2.5 72B Instruct performance at a different quality level on NVIDIA GeForce RTX 4070 Ti 12GB.
| Quantization | Speed | TTFT | Fits in VRAM | Rating | Confidence |
|---|---|---|---|---|---|
| Q2_K | — | — | ✗ Offload | Not Viable | estimated |
Notes
Q2_K
Requires 48GB+ for viable quality.
About Qwen 2.5 72B Instruct
Qwen 2.5 72B Instruct (72.7B) is a chat, coding, ai coding, reasoning, multi-purpose model. Top-tier 72B model, competitive with Llama 3.1 70B. Excellent at coding and structured output. Requires 48GB+ VRAM for usable quantizations.
View all Qwen 2.5 72B Instruct hardware options →About NVIDIA GeForce RTX 4070 Ti 12GB
NVIDIA GeForce RTX 4070 Ti 12GB has 12 GB at 504 GB/s. Street price: $749.
See all models NVIDIA GeForce RTX 4070 Ti 12GB can run →Source: 72B model exceeds 12GB (2026-03-15)
Data last updated: 2026-03-01