“With Catalina we’re introducing the ORv3, a high-power rack (HPR) capable of supporting up to 140kW.”
Llama 3.1 405B trained on more than 16,000 Nvidia H100s, and Catalina is built around Nvidia’s GB200. One liquid-cooled rack now draws up to 140kW. Meta also adds AMD’s MI300X to its Grand Teton platform and hands the design to OCP. Opening the rack costs Meta little and gives it a second GPU supplier to wave at Nvidia.