Whisper Large V3 Turbo
Whisper · MIT
Distilled version of Whisper Large V3. 8x faster than the full model with minimal quality loss. The go-to for real-time transcription on local hardware. Runs comfortably on any GPU with 2GB+ VRAM.
- Parameters
- 810M
- Architecture
- Dense
- Context
- 1,500 tokens
- Released
- 2024-10-01
- Engines
- whisper.cpp, faster-whisper, transformers
Parameters
810M
VRAM
1.6 GB
Context
1K
Formats
1
GPUs
43
Whisper Large V3 Turbo (810M) requires 1.6 GB VRAM at recommended quality (FP16). On NVIDIA Grace Blackwell Ultra GB300, expect approximately 600 tok/s at FP16. For the best experience, Starter AI Desktop ($582) is recommended.
Source: OwnRig methodology
1.6 GB
FP16
1.5 GB
1K tokens
Transcription
Compatible GPUs
43 devicesShowing 43 of 43 entries
Frequently Asked Questions
- How much VRAM does Whisper Large V3 Turbo need?
- Whisper Large V3 Turbo requires 1.6 GB VRAM at recommended quality (FP16).
- What is the best GPU for Whisper Large V3 Turbo?
- The NVIDIA Grace Blackwell Ultra GB300 delivers the best performance for Whisper Large V3 Turbo, achieving 600 tok/s at FP16 with an excellent rating.
- Can I run Whisper Large V3 Turbo on an RTX 4060 Ti?
- Yes. On the NVIDIA GeForce RTX 4060 Ti 16GB, Whisper Large V3 Turbo runs at – (FP16, excellent).
Related Guides
Tutorial
Running Whisper locally: GPU requirements and setup
Whisper Large V3 and V3 Turbo GPU requirements, VRAM usage, and hardware recommendations. Any GPU with 4 GB handles it; here is what you actually need for production use.
Buying Guide
Mac Mini M4 for AI: which models run on 16 GB
Which AI models run on the Mac Mini M4 with 16 GB, 24 GB, or 48 GB of unified memory. Honest compatibility table, real quantization requirements, and the upgrade case for M4 Pro.
Data confidence: estimated. Source
VRAM requirements are calculated from model parameters and may vary by inference engine, context length, and batch size. Performance estimates are based on community benchmarks and should be verified for your specific configuration.Whisper is a trademark of its respective owner. OwnRig is not affiliated with or endorsed by the model creator.