In mid-2024, Amazon found itself in a surprising bind: despite AWS operating one of the world’s largest fleets of AI chips—including Nvidia H100s and custom Trainium processors—the company’s retail division was struggling with a severe GPU shortage.