NVIDIA GeForce RTX 4060 Ti 16GB vs NVIDIA GeForce RTX 4090 D 24GB

The GeForce RTX 4090 D delivers 3.3x the FP8 throughput of the GeForce RTX 4060 Ti (294 vs 88 TFLOPS dense). The GeForce RTX 4090 D also carries 8 GB more memory (24 GB vs 16 GB).

GeForce RTX 4060 Ti: Ada Lovelace, 2023 GeForce RTX 4090 D: Ada Lovelace, 2023
FP8 dense lead
3.3x
GeForce RTX 4090 D: 294 vs 88 TFLOPS
VRAM
16 vs 24 GB
8 GB more for the GeForce RTX 4090 D
TDP
165 W vs 425 W
GeForce RTX 4060 Ti draws 260 W less

Specifications

GeForce RTX 4060 Ti
GeForce RTX 4090 D
Architecture
Ada LovelaceAda Lovelace
Launch Year
20232023
Form Factor
PCIePCIe
VRAM
16 GB24 GB
Memory Bandwidth
TDP
165 W425 W
Process Node
4nm4nm

Performance (TFLOPS)

GeForce RTX 4060 Ti
GeForce RTX 4090 D
FP64
0.3 TFlops 1.1 TFlops
FP32
22.1 TFlops 73.5 TFlops
TF32
22.1 TFlops
sparse not published
73.5 TFlops
sparse not published
BF16
44.1 TFlops
sparse not published
147.1 TFlops
sparse not published
FP16
44.1 TFlops
sparse not published
147.1 TFlops
sparse not published
FP8
88.3 TFlops
sparse not published
294.2 TFlops
sparse not published
FP6
No verified data available No verified data available
FP4
No verified data available No verified data available
INT8
176.5 TFlops
sparse not published
588.4 TFlops
sparse not published

FLOPS by Precision

What actually differs

Both GPUs launched in 2023: the GeForce RTX 4060 Ti on Ada Lovelace and the GeForce RTX 4090 D on Ada Lovelace.

Dense throughput for the GeForce RTX 4060 Ti against the GeForce RTX 4090 D: FP64 0.3 vs 1.1 TFLOPS, FP32 22 vs 74 TFLOPS, FP16 44 vs 147 TFLOPS, FP8 88 vs 294 TFLOPS. Sparse figures, where the vendor publishes them, appear under each dense number in the performance table.

Memory is 16 GB against 24 GB. More memory per GPU means larger models fit before you have to shard across cards, which often matters more than raw TFLOPS for inference.

Power budgets are 165 W for the GeForce RTX 4060 Ti and 425 W for the GeForce RTX 4090 D. At FP32 that works out to 0.13 against 0.17 TFLOPS per watt.

For LLM training and inference, weight the FP8 and FP16 rows and memory capacity most heavily. For scientific and HPC workloads, the FP64 row is the one to read.

Frequently asked questions

Is the GeForce RTX 4060 Ti faster than the GeForce RTX 4090 D?

At FP8 precision the GeForce RTX 4090 D reaches 294 TFLOPS dense against 88 TFLOPS for the GeForce RTX 4060 Ti. The performance table on this page lists every published precision for both GPUs.

Which has more memory, the GeForce RTX 4060 Ti or the GeForce RTX 4090 D?

The GeForce RTX 4090 D carries 24 GB of VRAM versus 16 GB for the GeForce RTX 4060 Ti.

How much power do the GeForce RTX 4060 Ti and the GeForce RTX 4090 D draw?

The GeForce RTX 4060 Ti is rated at 165 W TDP and the GeForce RTX 4090 D at 425 W. On FP32 throughput per watt, the GeForce RTX 4090 D is the more efficient part.

Can I rent the GeForce RTX 4060 Ti or the GeForce RTX 4090 D in the cloud?

Yes. Live cloud listings tracked by Flopper start at $0.07 per GPU hour. The rental pricing section on this page lists current providers and rates for both GPUs.

Where to Rent

NVIDIA GeForce RTX 4060 Ti 16GB

ProviderConfigurationPrice/GPU-hrChecked
Vast.ai
4× GeForce RTX 4060 Ti 16GB Community $0.07 2h ago View →
All GeForce RTX 4060 Ti listings and price history →

NVIDIA GeForce RTX 4090 D 24GB

ProviderConfigurationPrice/GPU-hrChecked
Vast.ai
1× GeForce RTX 4090 D 24GB Community $0.40 2h ago View →
All GeForce RTX 4090 D listings and price history →

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.