NVIDIA T4 16GB

Turing PCIe 2019 12nm Spec confidence: Official
FP32
8.1
TFLOPS
VRAM
16 GB
GDDR6
Bandwidth
300 GB/s
memory
TDP
70 W
115.7 TFLOPS/kW

Performance

Peak theoretical throughput by precision type

INT8
8-bit integer
130 TOPS
INT4
4-bit integer
260 TOPS
FP16
16-bit floating point
65 TFLOPS
FP32
32-bit floating point
8.1 TFLOPS
Every figure here is dense. The vendor documents no structured (2:4) sparsity mode for this part, so there is no second number to quote.
0.929 TFLOPS/W FP16 at 70 W
0.116 TFLOPS/W FP32 at 70 W

The T4 16GB in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

06001,2001,8002,4003,0000 W250 W500 W750 W1000 W1250 W1500 WInstinct MI355XT4 16GB

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

Turing

Form Factor

PCIe

Launch Year

2019

Process Node

12nm

Memory

16 GB GDDR6

Bandwidth

300 GB/s

TDP

70 W

Max Power

~81 W

Spec Confidence

Official

Full Specifications

Memory
VRAM 16 GB
Memory Type GDDR6
Bandwidth 300 GB/s
Power & Thermal
TDP 70 W
Enterprise Features
Sparsity No
General
Form Factor PCIe
Architecture Turing
Launch Year 2019

Datasheet & Resources

Data Provenance

Every figure traced to a source

Primary Source

Document
--
Publisher
NVIDIA
Published
--

Data Quality

Spec confidence
Official
Clock basis
Boost
Precisions tracked
4
Normalization
All values in TFLOPS

Rent this GPU

$0.34 / GPU-hr

Lowest of 4 live listings across 1 provider· median $0.60

See all rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Frequently Asked Questions

How many TFLOPS does the NVIDIA T4 have?

The NVIDIA T4 delivers 8.1 TFLOPS for FP32 operations, 65 TFLOPS for FP16, and N/A TFLOPS for FP8 precision.

What is the power consumption of the NVIDIA T4?

The NVIDIA T4 has a TDP (Thermal Design Power) rating of 70 watts.

How much memory does the NVIDIA T4 have?

The NVIDIA T4 is equipped with 16 GB of VRAM with 300 GB/s memory bandwidth.

What architecture is the NVIDIA T4 based on?

The NVIDIA T4 is based on the Turing architecture, launched in 2019.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs