Google TPU v5p vs NVIDIA A100
Side-by-side comparison of specifications, performance, and efficiency.
Google TPU v5p
Architecture
TPU v5p
Year
2023
VRAM
95 GB
TDP
450 W
NVIDIA A100
Architecture
Ampere
Year
2020
VRAM
40 GB
TDP
250 W
Specifications
Google TPU v5p NVIDIA A100
Architecture
TPU v5p Ampere
Launch Year
2023 2020
Form Factor
Custom PCIe
VRAM
95 GB40 GB
Memory Bandwidth
2.8 TB/s1.6 TB/s
TDP
450 W250 W
Process Node
5nm 7nm
| Spec | Google TPU v5p | NVIDIA A100 |
|---|---|---|
| Architecture | TPU v5p | Ampere |
| Launch Year | 2023 | 2020 |
| Form Factor | Custom | PCIe |
| VRAM | 95 GB | 40 GB |
| Memory Bandwidth | 2.8 TB/s | 1.6 TB/s |
| TDP | 450 W | 250 W |
| Process Node | 5nm | 7nm |
Performance (TFLOPS)
Google TPU v5p NVIDIA A100
FP64
—9.7 TFlops
FP32
—19.5 TFlops
FP16
—312.0 TFlops
BF16
459.0 TFlops312.0 TFlops
FP8
459.0 TFlops—
INT8
—624.0 TFlops
| Precision | Google TPU v5p | NVIDIA A100 |
|---|---|---|
| FP64 | — | 9.7 TFlops |
| FP32 | — | 19.5 TFlops |
| FP16 | — | 312.0 TFlops |
| BF16 | 459.0 TFlops | 312.0 TFlops |
| FP8 | 459.0 TFlops | — |
| INT8 | — | 624.0 TFlops |
FLOPS by Precision
Efficiency — TDP vs FP32 Performance
Analysis
Most Efficient
NVIDIA
A100
0.08 TFLOPS/W
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.