Flopper.io GPU Specification Sheet
September 26, 2026
flopper.io/gpu/nvidia-a800-sxm4NVIDIA A800 SXM4
Ampere SXM 2022 7nm
Overview
19.5
FP32 TFLOPS
80 GB
Memory HBM2e
2.0 TB/s
Memory Bandwidth
400 W
TDP
Performance Metrics
| Precision | Peak (dense) | 2:4 Sparse | Bits | Type |
|---|---|---|---|---|
| FP64 | 9.7 | N/A | 64 | Standard |
| FP32 | 19.5 | N/A | 32 | Standard |
| TF32 | 156.0 | 312.0 | 32 | Standard |
| BF16 | 312.0 | 624.0 | 16 | Standard |
| FP16 | 312.0 | 624.0 | 16 | Standard |
| FP8 | — | not published | — | Standard |
| FP6 | — | not published | — | Standard |
| FP4 | — | not published | — | Standard |
| INT8 | 624.0 | 1248.0 | 8 | Standard |
| INT4 | 1248.0 | 2496.0 | 4 | Standard |
Memory Specifications
- Capacity
- 80 GB
- Type
- HBM2e
- Bandwidth
- 2.0 TB/s
- Interface Width
- —
Power & Efficiency
- TDP
- 400 W
- Max power
- 500 W
- FP32 dense TFLOPS per W of TDP
- 0.05 TFLOPS/W
- FP16 dense TFLOPS per W of TDP
- 0.78 TFLOPS/W
Per W of TDP figures divide dense peak by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead.
Hardware Details
Vendor: NVIDIA
Architecture: Ampere
Process Node: 7nm
Form Factor: SXM
Launch Year: 2022
Variant: SXM4
Compute Engine
CUDA Cores: 6,912
Tensor Cores: 432 (3rd Gen)
SMs: 108
Interconnect
GPU-to-GPU: NVLink
Bandwidth: 400 GB/s bidirectional, per GPU
PCIe: Gen4 x16
Enterprise Features
ECC: Yes
MIG: Up to 7 MIGs @ 10GB
Sparsity: Yes