“Meta pulled the plug on a large-scale rollout of the custom chip, which was planned for 2022, and instead placed orders for billions of dollars’ worth of Nvidia GPUs that required major redesigns of several of its data centers.”
Meta’s last custom AI chip got cancelled and replaced with billions in Nvidia orders. The new MTIA only runs inference for ad and feed recommendations, and its efficiency claim comes from a benchmark Meta designed. The supercomputer has 16,000 A100s and trains on “real-world examples from Meta’s production systems.” That means your posts. The chip is for show. The data is the asset.