DeepSeek V3 on NVIDIA GeForce RTX 3060 12GB

NVIDIA GeForce RTX 3060 12GB cannot run DeepSeek V3 at any quantization level. The 12 GB of VRAM is insufficient.

Model Size

671B

Device VRAM

12 GB

Bandwidth

360 GB/s

Quantizations Tested

Performance by Quantization

Each row shows DeepSeek V3 performance at a different quality level on NVIDIA GeForce RTX 3060 12GB.

Quantization	Speed	TTFT	Fits in VRAM	Rating	Confidence
Q2_K	—	—	✗ Offload	Not Viable	estimated

Notes

Q2_K

671B MoE model requires 115GB+ even at Q2_K. 12GB is nowhere near sufficient. Would need 128GB+ unified memory or multi-GPU.

About DeepSeek V3

DeepSeek V3 (671B) is a chat, coding, ai coding, reasoning, multi-purpose model. Massive MoE model rivaling GPT-4 class. Only ~37B parameters active per token despite 671B total. Requires multi-GPU or very large unified memory (128GB+ Apple Silicon at Q2/Q3). Not for casual home use — included for completeness and to show what the high end looks like.

View all DeepSeek V3 hardware options →