NVIDIA Jetson AGX Orin 64GB

The Jetson AGX Orin 64GB is the largest of the Orin modules and the one that carried NVIDIA's edge line until Thor arrived. It pairs a 2048-core Ampere GPU with 64 third-generation tensor cores and two NVDLA v2.0 accelerators, and NVIDIA rates the whole module at 275 sparse INT8 TOPS, of which 170 comes from the GPU and 105 from the deep learning accelerators. On the GPU alone that is 85 dense INT8 TOPS and 43 dense FP16 TFLOPS, plus 5.3 TFLOPS of FP32 from the CUDA cores. The 64 GB of 256-bit LPDDR5 at 204.8 GB/s is the striking part for local model work, since it is eight times the frame buffer of the Orin Nano at twice the bandwidth, in a 100 by 87 mm module drawing between 15 W and 60 W. It remains the sensible choice for a robot that needs a lot of memory and does not need Blackwell.