NVIDIA GeForce RTX 3090 vs NVIDIA GH200
Side-by-side comparison of specifications, performance, and efficiency.
NVIDIA GeForce RTX 3090
Architecture
Ampere
Year
2020
VRAM
24 GB
TDP
350 W
NVIDIA GH200
Architecture
Hopper
Year
2023
VRAM
468 GB
TDP
1.0 kW
Specifications
NVIDIA GeForce RTX 3090 NVIDIA GH200
Architecture
Ampere Hopper
Launch Year
2020 2023
Form Factor
PCIe SXM
VRAM
24 GB468 GB
Memory Bandwidth
936 GB/s900 GB/s
TDP
350 W1.0 kW
Process Node
8nm 4nm
| Spec | NVIDIA GeForce RTX 3090 | NVIDIA GH200 |
|---|---|---|
| Architecture | Ampere | Hopper |
| Launch Year | 2020 | 2023 |
| Form Factor | PCIe | SXM |
| VRAM | 24 GB | 468 GB |
| Memory Bandwidth | 936 GB/s | 900 GB/s |
| TDP | 350 W | 1.0 kW |
| Process Node | 8nm | 4nm |
Performance (TFLOPS)
NVIDIA GeForce RTX 3090 NVIDIA GH200
FP64
0.6 TFlops34.0 TFlops
FP32
35.6 TFlops67.0 TFlops
FP16
35.6 TFlops989.5 TFlops
BF16
35.6 TFlops989.5 TFlops
FP8
—1979.0 TFlops
INT8
71.2 TFlops1979.0 TFlops
| Precision | NVIDIA GeForce RTX 3090 | NVIDIA GH200 |
|---|---|---|
| FP64 | 0.6 TFlops | 34.0 TFlops |
| FP32 | 35.6 TFlops | 67.0 TFlops |
| FP16 | 35.6 TFlops | 989.5 TFlops |
| BF16 | 35.6 TFlops | 989.5 TFlops |
| FP8 | — | 1979.0 TFlops |
| INT8 | 71.2 TFlops | 1979.0 TFlops |
FLOPS by Precision
Efficiency — TDP vs FP32 Performance
Analysis
Most Efficient
NVIDIA
GeForce RTX 3090
0.10 TFLOPS/W
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.