Google TPU v5e 16GB vs Google TPU v4 32GB

The TPU v4 delivers 40% more BF16 throughput than the TPU v5e (275 vs 197 TFLOPS dense). The TPU v4 also carries 16 GB more memory (32 GB vs 16 GB).

TPU v5e: TPU, 2023 TPU v4: TPU, 2020
BF16 dense lead
+40%
TPU v4: 275 vs 197 TFLOPS
VRAM
16 vs 32 GB
16 GB more for the TPU v4
Bandwidth
800 GB/s vs 1.2 TB/s
TPU v4 moves data faster

Specifications

TPU v5e
TPU v4
Architecture
TPUTPU
Launch Year
20232020
Form Factor
VRAM
16 GB32 GB
Memory Bandwidth
800 GB/s1.2 TB/s
TDP
Process Node

Performance (TFLOPS)

TPU v5e
TPU v4
BF16
197.0 TFlops 275.0 TFlops
INT8
393.0 TFlops 275.0 TFlops

FLOPS by Precision

What actually differs

The TPU v5e is the newer part: TPU, launched in 2023, against the TPU v4's TPU from 2020. Newer architectures typically add lower-precision formats and better throughput per watt, so check the precision rows your workload actually uses.

Memory is 16 GB against 32 GB, fed at 800 GB/s versus 1.2 TB/s. More memory per GPU means larger models fit before you have to shard across cards, which often matters more than raw TFLOPS for inference.

For LLM training and inference, weight the FP8 and FP16 rows and memory capacity most heavily. For scientific and HPC workloads, the FP64 row is the one to read.

Frequently asked questions

Is the TPU v5e faster than the TPU v4?

At BF16 precision the TPU v4 reaches 275 TFLOPS dense against 197 TFLOPS for the TPU v5e. The performance table on this page lists every published precision for both GPUs.

Which has more memory, the TPU v5e or the TPU v4?

The TPU v4 carries 32 GB of VRAM versus 16 GB for the TPU v5e. Memory bandwidth is 800 GB/s for the TPU v5e and 1.2 TB/s for the TPU v4.

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.