Flopper.io
Flopper.io GPU Comparison Sheet

AMD Instinct MI100 32GB vs NVIDIA L40 48GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

AMD Instinct MI100 32GBNVIDIA L40 48GB
FP32 TFLOPS23.190.5
Memory32 GB48 GB
Memory Bandwidth1.2 TB/s864 GB/s
TDP300 W300 W

Performance by Precision

PrecisionAMD Instinct MI100 32GB peak TFLOPS (dense)NVIDIA L40 48GB peak TFLOPS (dense)
FP64 11.5—
FP32 23.190.5
TF32 —90.5
BF16 92.3181.1
FP16 184.6181.1
FP8 —362.0
FP6 ——
FP4 ——
INT8 184.6362.0
INT4 184.6724.0

Specifications

AMD Instinct MI100 32GBNVIDIA L40 48GB
ArchitectureCDNAAda Lovelace
Process Node7nm4nm
Launch Year20202023
Form FactorPCIePCIe
Memory TypeHBM2GDDR6
Interface Width——
Interconnect——
TDP300 W300 W
FP32 Efficiency0.08 TFLOPS/W0.30 TFLOPS/W