OwnRig

Yi 1.5 34B Chat on NVIDIA GeForce RTX 4070 Ti 12GB

NVIDIA GeForce RTX 4070 Ti 12GB cannot run Yi 1.5 34B Chat at any quantization level. The 12 GB of VRAM is insufficient.

Model Size

34.4B

Device VRAM

12 GB

Bandwidth

504 GB/s

Quantizations Tested

1

Performance by Quantization

Each row shows Yi 1.5 34B Chat performance at a different quality level on NVIDIA GeForce RTX 4070 Ti 12GB.

QuantizationSpeedTTFTFits in VRAMRatingConfidence
Q2_K✗ OffloadNot Viableestimated

Notes

Q2_K

Requires 24GB+ for viable quality.

About Yi 1.5 34B Chat

Yi 1.5 34B Chat (34.4B) is a chat, reasoning, multi-purpose model. 01.AI's 34B model with strong multilingual chat and reasoning.

View all Yi 1.5 34B Chat hardware options →

About NVIDIA GeForce RTX 4070 Ti 12GB

NVIDIA GeForce RTX 4070 Ti 12GB has 12 GB at 504 GB/s. Street price: $749.

See all models NVIDIA GeForce RTX 4070 Ti 12GB can run →

Source: 34.4B model exceeds 12GB (2026-03-15)

Data last updated: 2026-03-15