Side by side datacenter GPU specifications from the Flopper.io database.
| Groq GroqChip 1 | NVIDIA L40 48GB | |
|---|---|---|
| FP32 TFLOPS | — | 90.5 |
| Memory | — | 48 GB |
| Memory Bandwidth | — | 864 GB/s |
| TDP | 215 W | 300 W |
| Precision | Groq GroqChip 1 peak TFLOPS (dense) | NVIDIA L40 48GB peak TFLOPS (dense) |
|---|---|---|
| FP64 | — | — |
| FP32 | — | 90.5 |
| TF32 | — | 90.5 |
| BF16 | — | 181.1 |
| FP16 | 188.0 | 181.1 |
| FP8 | — | 362.0 |
| FP6 | — | — |
| FP4 | — | — |
| INT8 | 750.0 | 362.0 |
| INT4 | — | 724.0 |
| Groq GroqChip 1 | NVIDIA L40 48GB | |
|---|---|---|
| Architecture | Tensor Streaming Processor | Ada Lovelace |
| Process Node | 14nm | 4nm |
| Launch Year | 2019 | 2023 |
| Form Factor | PCIe | PCIe |
| Memory Type | On-die SRAM | GDDR6 |
| Interface Width | — | — |
| Interconnect | RealScale | — |
| TDP | 215 W | 300 W |
| FP32 Efficiency | — | 0.30 TFLOPS/W |