AWS Graviton5: Arm CPU Boosts AI Performance & Value

AWS is now shipping its new Graviton5 Arm server CPU in M9g and M9gd instances. This chip is comprised of four CPU blocks, each with 48 V3 cores. The Graviton5 socket features 192 V3 cores, twelve DDR5 memory controllers, and eight PCI-Express 6.0 controllers. These controllers support the CXL 3.0 memory extension protocol, which is important for in-memory databases. The Graviton5 uses a 3 nanometer process, a change from the 4 nanometer process of the Graviton4. This design choice helps lower the cost of each chiplet. The Graviton5 also has increased L3 cache compared to previous versions. This means more efficient processing for demanding workloads.