Gemma 3 27B on NVIDIA GeForce RTX 5080
NVIDIA GeForce RTX 5080 can run Gemma 3 27B at 18 tok/s at Q3_K_M, though performance is acceptable. Consider a higher-end GPU for better results.
Model Size
27.23B
Device VRAM
16 GB
Bandwidth
960 GB/s
Quantizations Tested
1
Performance by Quantization
Each row shows Gemma 3 27B performance at a different quality level on NVIDIA GeForce RTX 5080.
| Quantization | Speed | TTFT | Fits in VRAM | Rating | Confidence |
|---|---|---|---|---|---|
| Q3_K_M | 18 tok/s | 500ms | ✓ Yes | Acceptable | estimated |
Notes
Q3_K_M
16GB limits to Q3_K_M. Fast bandwidth (960 GB/s) helps speed but Q3 quality loss is noticeable.
About Gemma 3 27B
Gemma 3 27B (27.23B) is a chat, coding, reasoning, multi-purpose model. Google's strongest open-weight model. Excellent reasoning and instruction following. At 27B parameters, it's the sweet spot between 8B models (too limited) and 70B models (too expensive). Strong multilingual support. Fits on 24GB GPUs at Q4.
View all Gemma 3 27B hardware options →About NVIDIA GeForce RTX 5080
NVIDIA GeForce RTX 5080 has 16 GB at 960 GB/s. Street price: $1,099.
See all models NVIDIA GeForce RTX 5080 can run →Source: Performance estimates based on model size and device bandwidth (2026-03-15)
Data last updated: 2026-03-15