Qwen3-32B Instruct on Apple M4 Ultra (192GB)

M4 Ultra (192GB) runs Qwen3-32B Instruct at Q8_0 — 21 tok/s. Usable on 192 GB VRAM — see full quantization options below.

Model Size

32B

Device VRAM

192 GB

Bandwidth

819 GB/s

Quantization

Q8_0

Benchmarks

Performance by Quantization

OwnRig currently has one published compatibility entry for Qwen3-32B Instruct on Apple M4 Ultra (192GB) at Q8_0. This is the best supported pairing we can stand behind today.

Quantization	Speed	TTFT	Fits in VRAM	Rating	Confidence
Q8_0	21 tok/s	467ms	✓ Yes	Acceptable	estimated

Notes

Q8_0

Apple-specific Q8_0 estimate scaled from the rebased M4 Max floor. The 21 tok/s figure remains a conservative bandwidth-ratio projection.

About Qwen3-32B Instruct

Qwen3-32B Instruct (32B) is a chat, coding, ai coding, reasoning, multi-purpose model. Qwen 3 dense 32B instruct for high-quality local inference where VRAM allows; 32K default and 128K max context. Apache 2.0.

View all Qwen3-32B Instruct hardware options →

About Apple M4 Ultra (192GB)

Apple M4 Ultra (192GB) has 192 GB at 819 GB/s. Available in Mac Studio, Mac Pro.

See all models Apple M4 Ultra (192GB) can run →

Estimate method: Estimated from the Apple Q8_0 M4 Max baseline and scaled by the M4 Ultra memory bandwidth ratio (819/546 GB/s). Reference hardware source: siliconscore.com (2026-04-12)

Performance varies by driver version, inference engine, quantization method, context length, and system configuration. Figures shown are estimates based on community benchmarks and may not reflect your exact setup. Product names are trademarks of their respective owners. OwnRig is independent and not affiliated with any hardware or AI model provider.