NVIDIA GeForce RTX 4060 Ti 16GB
Overview
The 16 GB GeForce RTX 4060 Ti is an unusual card: a small AD106 die with only 4,352 CUDA cores and a 128-bit memory bus, paired with twice the memory of anything else at its price. That makes it a capacity play rather than a performance one. It reaches 22.1 TFLOPS of FP32 and 88.3 TFLOPS of dense FP8, and its 32 MB L2 cache does real work in hiding the narrow bus, but token generation on a large model will be bandwidth-bound long before the Tensor cores are. For people who want to hold a quantised 13B model locally on a 165 W card that runs from a 550 W supply, it remains one of the cheapest ways to do it.
Performance
Peak theoretical throughput by precision type
| Precision | Dense | 2:4 Sparse |
|---|---|---|
FP64 64-bit floating point | 0.3TFLOPS | Structured sparsity is a tensor-core feature; this vector precision has no sparse form |
FP32 32-bit floating point | 22TFLOPS | Structured sparsity is a tensor-core feature; this vector precision has no sparse form |
TF32 TensorFloat-32 | 22TFLOPS | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
BF16 Brain Float 16 | 44TFLOPS | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
FP16 16-bit floating point | 44TFLOPS | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
FP8 8-bit floating point | 88TFLOPS | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
FP6 | No verified data available | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
FP4 | No verified data available | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
INT8 8-bit integer | 177TOPS | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
Per watt divides the dense figure by the 165 W board power. Where only a sparse figure exists, the cell says so.
The GeForce RTX 4060 Ti 16GB in the GPU landscape
Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper
Higher and further left is better: more half-precision throughput for less power.
Specifications
Architecture
Ada Lovelace
Form Factor
PCIe
Launch Year
2023
Process Node
4nm
Memory
16 GB GDDR6
Bandwidth
No verified data available
TDP
165 W
Max Power
165 W
CUDA Cores
4,352
Spec Confidence
Official
Full Specifications
| Compute Engine | |
|---|---|
| CUDA Cores | 4,352 |
| Tensor Cores | 136 (4th Gen) |
| Streaming Multiprocessors | 34 |
| Base Clock | 2.31 GHz |
| Boost Clock | 2.54 GHz |
| Memory | |
| VRAM | 16 GB |
| Memory Type | GDDR6 |
| Bandwidth | No verified data available |
| Interface Width | 128-bit |
| Interconnect & I/O | |
| PCIe | 4.0 |
| Cache | |
| L2 Cache | 32 MB |
| Power & Thermal | |
| TDP | 165 W |
| Max Board Power | 165 W |
| Cooling | Active |
| Enterprise Features | |
| Sparsity | Yes |
| Physical & Media | |
| Card Length | 244 mm |
| Width | 2-slot |
| General | |
| Form Factor | PCIe |
| Architecture | Ada Lovelace |
| Process Node | 4nm |
| Launch Year | 2023 |
Datasheet & Resources
Flopper Datasheet
NVIDIA GeForce RTX 4060 Ti 16GB specifications, generated from our database. Printable.
Vendor product page
NVIDIA documentation for the GeForce RTX 4060 Ti 16GB
NVIDIA GeForce RTX 4060 Ti and RTX 4060 product page
NVIDIA · 2023-05-18
NVIDIA Developer Documentation
Technical specs, programming guides
Data Provenance
Every figure traced to a source
Primary Source
- Publisher
- NVIDIA
- Published
- 2023-05-18
Data Quality
- Spec confidence
- Official
- Clock basis
- Boost
- Core precisions with figures
- 7 of 9
- Normalization
- All values in TFLOPS
Rent this GPU
$0.07 / GPU-hr
Lowest of 1 live listing across 1 provider
Price history and every provider on the pricing page. Some links are affiliate links.
Similar GPUs
Frequently Asked Questions
How many TFLOPS does the NVIDIA GeForce RTX 4060 Ti have?
The NVIDIA GeForce RTX 4060 Ti delivers 22 TFLOPS FP32, 44 TFLOPS FP16 and 88 TFLOPS FP8 at peak.
What is the power consumption of the NVIDIA GeForce RTX 4060 Ti?
The NVIDIA GeForce RTX 4060 Ti has a TDP (Thermal Design Power) rating of 165 watts.
How much memory does the NVIDIA GeForce RTX 4060 Ti have?
The NVIDIA GeForce RTX 4060 Ti is equipped with 16 GB of VRAM. Flopper does not currently have a verified memory bandwidth figure for it.
What architecture is the NVIDIA GeForce RTX 4060 Ti based on?
The NVIDIA GeForce RTX 4060 Ti is based on the Ada Lovelace architecture, launched in 2023.
Stay Updated on GPU Releases
Get notified when new GPUs are added or specifications are updated.
No spam, unsubscribe anytime.