OwnRig

nomic-embed-text v1.5 on NVIDIA GeForce RTX 4070 Ti 12GB

NVIDIA GeForce RTX 4070 Ti 12GB runs nomic-embed-text v1.5 excellently at 6500 tok/s at Q8_0. This is a strong pairing.

Model Size

137M

Device VRAM

12 GB

Bandwidth

504 GB/s

Quantizations Tested

1

Performance by Quantization

Each row shows nomic-embed-text v1.5 performance at a different quality level on NVIDIA GeForce RTX 4070 Ti 12GB.

QuantizationSpeedTTFTFits in VRAMRatingConfidence
Q8_06500 tok/s5ms✓ YesExcellentestimated

Notes

Q8_0

Embedding model. Negligible VRAM. Excellent for RAG pipelines.

About nomic-embed-text v1.5

nomic-embed-text v1.5 (137M) is a embeddings, ai building model. High-quality text embedding model for RAG pipelines. 137M params — negligible VRAM. Competitive with OpenAI's ada-002 on MTEB benchmarks. Essential for builders running local RAG with Cursor or similar tools. Can run concurrently with coding models without meaningful VRAM impact.

View all nomic-embed-text v1.5 hardware options →

About NVIDIA GeForce RTX 4070 Ti 12GB

NVIDIA GeForce RTX 4070 Ti 12GB has 12 GB at 504 GB/s. Street price: $749.

See all models NVIDIA GeForce RTX 4070 Ti 12GB can run →

Source: Performance estimates based on model size and device bandwidth (2026-03-15)

Data last updated: 2026-03-01