NVIDIA A100 PCIe 40GB
Performance
Peak theoretical throughput by precision type
| Precision | Dense | 2:4 Sparse |
|---|---|---|
FP64 64-bit floating point | 9.7TFLOPS | Structured sparsity is a tensor-core feature; this vector precision has no sparse form |
FP32 32-bit floating point | 20TFLOPS | Structured sparsity is a tensor-core feature; this vector precision has no sparse form |
TF32 TensorFloat-32 | 156TFLOPS | 312TFLOPS |
BF16 Brain Float 16 | 312TFLOPS | 624TFLOPS |
FP16 16-bit floating point | 312TFLOPS | 624TFLOPS |
FP8 | No verified data available | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
FP6 | No verified data available | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
FP4 | No verified data available | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
INT8 8-bit integer | 624TOPS | 1,248TOPS |
INT4 4-bit integer | 1,248TOPS | 2,496TOPS |
Dense peak divided by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead. TDP for this part: 250 W.
The A100 PCIe 40GB in the GPU landscape
Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper
Higher and further left is better: more half-precision throughput for less power.
Specifications
Architecture
Ampere
Form Factor
PCIe
Launch Year
2020
Process Node
7nm
Memory
40 GB
Bandwidth
1,555 GB/s
TDP
250 W
Max power (Flopper estimate)
~288 W est. Flopper estimate: 250 W TDP x 1.15. The vendor publishes no maximum board power for this part.
Spec Confidence
Official
Full Specifications
| Memory | |
|---|---|
| Memory | 40 GB |
| Memory Type | No verified data available |
| Bandwidth | 1.6 TB/s |
| Interface Width | No verified data available |
| Power & Thermal | |
| TDP | 250 W |
| Max power (Flopper estimate) | ~288 W est. |
| Enterprise Features | |
| Sparsity | Yes |
| General | |
| Form Factor | PCIe |
| Architecture | Ampere |
| Process Node | 7nm |
| Launch Year | 2020 |
Datasheet & Resources
Flopper Datasheet
NVIDIA A100 PCIe 40GB specifications, generated from our database. Printable.
Vendor product page
NVIDIA documentation for the A100 PCIe 40GB
NVIDIA A100 Tensor Core GPU
NVIDIA · 2020-05-14
NVIDIA Developer Documentation
Technical specs, programming guides
Data Provenance
Every figure traced to a source
Primary Source
- Document
- NVIDIA A100 Tensor Core GPU
- Publisher
- NVIDIA
- Published
- 2020-05-14
Data Quality
- Spec confidence
- Official
- Clock basis
- Boost
- Core precisions with figures
- 6 of 9
- Normalization
- All values in TFLOPS
Rent this GPU
$0.53 / GPU-hr
Lowest of 1 live listing across 1 provider
Price history and every provider on the pricing page. Some links are affiliate links.
Similar GPUs
Systems Using This GPU
Pre-configured systems featuring the NVIDIA A100
| System | GPU Count | Peak Performance | Total Power | |
|---|---|---|---|---|
NVIDIA DGX A100 320GB DGX · rack · 2020 | 8x A100 | 4.99 PFLOPS | 6.0 kW | View System |
Frequently Asked Questions
How many TFLOPS does the NVIDIA A100 have?
The NVIDIA A100 delivers 20 TFLOPS FP32 and 312 TFLOPS FP16 at peak. Flopper does not currently have a verified FP8 throughput figure for it.
What is the power consumption of the NVIDIA A100?
The NVIDIA A100 has a TDP (Thermal Design Power) rating of 250 watts.
How much memory does the NVIDIA A100 have?
The NVIDIA A100 is equipped with 40 GB of memory with 1,555 GB/s of memory bandwidth.
What architecture is the NVIDIA A100 based on?
The NVIDIA A100 is based on the Ampere architecture, launched in 2020.
Stay Updated on GPU Releases
Get notified when new GPUs are added or specifications are updated.
No spam, unsubscribe anytime.