“The biggest problem: developers don’t want GPUs. They don’t even want AI/ML models. They want LLMs.”

Fly.io bet on GPUs, hex-edited Nvidia’s closed drivers to make them work, and paid for two large security audits. Developers wanted LLM APIs instead. The only card that sells is the L40S. The rest will get liquidated.