Mixtral 8x7B Instruct on NVIDIA GeForce RTX 4070 Ti 12GB
NVIDIA GeForce RTX 4070 Ti 12GB cannot run Mixtral 8x7B Instruct at any quantization level. The 12 GB of VRAM is insufficient.
Model Size
46.7B
Device VRAM
12 GB
Bandwidth
504 GB/s
Quantizations Tested
1
Performance by Quantization
Each row shows Mixtral 8x7B Instruct performance at a different quality level on NVIDIA GeForce RTX 4070 Ti 12GB.
| Quantization | Speed | TTFT | Fits in VRAM | Rating | Confidence |
|---|---|---|---|---|---|
| Q4_K_M | — | — | ✗ Offload | Not Viable | estimated |
Notes
Q4_K_M
Requires 24GB+ for viable quality.
About Mixtral 8x7B Instruct
Mixtral 8x7B Instruct (46.7B) is a chat, coding, reasoning, multi-purpose model. Mixture of Experts model — 46.7B total params but only ~12.9B active per token. Excellent quality-to-speed ratio. Despite large total params, inference speed closer to a 13B model. Needs more VRAM for the full weight set though.
View all Mixtral 8x7B Instruct hardware options →About NVIDIA GeForce RTX 4070 Ti 12GB
NVIDIA GeForce RTX 4070 Ti 12GB has 12 GB at 504 GB/s. Street price: $749.
See all models NVIDIA GeForce RTX 4070 Ti 12GB can run →Source: 46.7B total MoE. Q4 ~26GB exceeds 12GB (2026-03-15)
Data last updated: 2026-03-01