Flopper.io
Flopper.io GPU Specification Sheet

NVIDIA RTX 4000 Ada 20GB

Ada Lovelace PCIe 2023 4nm

Overview

26.7
FP32 TFLOPS
20 GB
Memory GDDR6
360 GB/s
Memory Bandwidth
130 W
TDP

Performance Metrics

PrecisionPeak (dense)2:4 SparseBitsType
FP640.4N/A64Standard
FP3226.7N/A32Standard
TF32—not published—Standard
BF16—not published—Standard
FP16—not published—Standard
FP8213.8427.68Standard
FP6—not published—Standard
FP4—not published—Standard
INT8—not published—Standard

Memory Specifications

Capacity
20 GB
Type
GDDR6
Bandwidth
360 GB/s
Interface Width
160-bit

Power & Efficiency

TDP
130 W
Max power
130 W
FP32 dense TFLOPS per W of TDP
0.21 TFLOPS/W
FP16 dense TFLOPS per W of TDP
—

Per W of TDP figures divide dense peak by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead.

Hardware Details

Vendor: NVIDIA
Architecture: Ada Lovelace
Process Node: 4nm
Form Factor: PCIe
Launch Year: 2023
Variant: 20GB

Compute Engine

CUDA Cores: 6,144
Tensor Cores: 192 (4th Gen)
SMs: 48

Interconnect

PCIe: 4.0 x16

Enterprise Features

ECC: Yes
Sparsity: Yes