nomic-embed-text v1.5 on NVIDIA GeForce RTX 4090
NVIDIA GeForce RTX 4090 runs nomic-embed-text v1.5 excellently at FP16. This is a strong pairing.
Model Size
137M
Device VRAM
24 GB
Bandwidth
1008 GB/s
Quantizations Tested
1
Performance by Quantization
Each row shows nomic-embed-text v1.5 performance at a different quality level on NVIDIA GeForce RTX 4090.
| Quantization | Speed | TTFT | Fits in VRAM | Rating | Confidence |
|---|---|---|---|---|---|
| FP16 | — | 8ms | ✓ Yes | Excellent | estimated |
Notes
FP16
Negligible VRAM footprint. The key enabler for local RAG pipelines in builder workflows.
Running alongside Qwen 2.5 Coder 32B Q4: total ~19GB, leaving 5GB free on 4090.
About nomic-embed-text v1.5
nomic-embed-text v1.5 (137M) is a embeddings, ai building model. High-quality text embedding model for RAG pipelines. 137M params — negligible VRAM. Competitive with OpenAI's ada-002 on MTEB benchmarks. Essential for builders running local RAG with Cursor or similar tools. Can run concurrently with coding models without meaningful VRAM impact.
View all nomic-embed-text v1.5 hardware options →About NVIDIA GeForce RTX 4090
NVIDIA GeForce RTX 4090 has 24 GB at 1008 GB/s. Street price: $1,799.
See all models NVIDIA GeForce RTX 4090 can run →Builds with NVIDIA GeForce RTX 4090
Source: Model card (2026-01-15)
Data last updated: 2026-03-01