Flopper.io
Flopper.io GPU Specification Sheet

NVIDIA RTX 4000 Ada 20GB

Ada Lovelace PCIe 2023 4nm

Overview

26.7
FP32 TFLOPS
20 GB
VRAM GDDR6
360 GB/s
Memory Bandwidth
130 W
TDP

Performance Metrics

PrecisionPeak (dense)2:4 SparseBitsType
FP640.4N/A64Standard
FP3226.7N/A32Standard
TF32not publishedStandard
BF16not publishedStandard
FP16not publishedStandard
FP8213.8427.68Standard
FP6not publishedStandard
FP4not publishedStandard
INT8not publishedStandard

Memory Specifications

Capacity
20 GB
Type
GDDR6
Bandwidth
360 GB/s
Interface Width
160-bit

Power & Efficiency

TDP
130 W
Max Power
130 W
FP32 Efficiency
0.21 TFLOPS/W
FP16 Efficiency

Hardware Details

Vendor: NVIDIA
Architecture: Ada Lovelace
Process Node: 4nm
Form Factor: PCIe
Launch Year: 2023
Variant: 20GB

Compute Engine

CUDA Cores: 6,144
Tensor Cores: 192 (4th Gen)
SMs: 48

Interconnect

PCIe: 4.0 x16

Enterprise Features

ECC: Yes
Sparsity: Yes