“If you want to scale at the scale of Google, which serves 8 or 9 billion queries every day, you actually need to spend $80 billion on DGXs.”
Nvidia holds 95% of the market for machine learning GPUs. Its overall sales fell 21% last quarter and the stock still jumped 14% because data center revenue hit $3.6 billion. Putting ChatGPT in Bing for everyone would take over 20,000 eight-GPU servers, about $4 billion. Jensen Huang calls a $10 to $20 million language model “really, really affordable.” It is, if you’re the one selling the chips.