LLaVA 1.6 13B on NVIDIA GeForce RTX 4060 Ti 16GB

NVIDIA GeForce RTX 4060 Ti 16GB handles LLaVA 1.6 13B well at 22 tok/s at Q4_K_M. A solid choice for this model.

Model Size

13B

Device VRAM

16 GB

Bandwidth

288 GB/s

Quantizations Tested

Performance by Quantization

Each row shows LLaVA 1.6 13B performance at a different quality level on NVIDIA GeForce RTX 4060 Ti 16GB.

Quantization	Speed	TTFT	Fits in VRAM	Rating	Confidence
Q4_K_M	22 tok/s	500ms	✓ Yes	Good	estimated

Notes

Q4_K_M

Q4 at 7.7GB fits on 16GB. First token is slower due to vision encoder processing.

About LLaVA 1.6 13B

LLaVA 1.6 13B (13B) is a chat, reasoning, multi-purpose model. Multimodal model — processes images and text together. Built on Vicuna 13B with a vision encoder. Can analyze screenshots, diagrams, and photos. Useful for builders who need to process visual content in their workflows.

View all LLaVA 1.6 13B hardware options →