Google TPU v5p vs NVIDIA GH200
Side-by-side comparison of specifications, performance, and efficiency.
Google TPU v5p
Architecture
TPU v5p
Year
2023
VRAM
95 GB
TDP
450 W
NVIDIA GH200
Architecture
Hopper
Year
2023
VRAM
468 GB
TDP
1.0 kW
Specifications
Google TPU v5p NVIDIA GH200
Architecture
TPU v5p Hopper
Launch Year
2023 2023
Form Factor
Custom SXM
VRAM
95 GB468 GB
Memory Bandwidth
2.8 TB/s900 GB/s
TDP
450 W1.0 kW
Process Node
5nm 4nm
| Spec | Google TPU v5p | NVIDIA GH200 |
|---|---|---|
| Architecture | TPU v5p | Hopper |
| Launch Year | 2023 | 2023 |
| Form Factor | Custom | SXM |
| VRAM | 95 GB | 468 GB |
| Memory Bandwidth | 2.8 TB/s | 900 GB/s |
| TDP | 450 W | 1.0 kW |
| Process Node | 5nm | 4nm |
Performance (TFLOPS)
Google TPU v5p NVIDIA GH200
FP64
—34.0 TFlops
FP32
—67.0 TFlops
FP16
—989.5 TFlops
BF16
459.0 TFlops989.5 TFlops
FP8
459.0 TFlops1979.0 TFlops
INT8
—1979.0 TFlops
| Precision | Google TPU v5p | NVIDIA GH200 |
|---|---|---|
| FP64 | — | 34.0 TFlops |
| FP32 | — | 67.0 TFlops |
| FP16 | — | 989.5 TFlops |
| BF16 | 459.0 TFlops | 989.5 TFlops |
| FP8 | 459.0 TFlops | 1979.0 TFlops |
| INT8 | — | 1979.0 TFlops |
FLOPS by Precision
Efficiency — TDP vs FP32 Performance
Analysis
Most Efficient
NVIDIA
GH200
0.07 TFLOPS/W
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.