“Optane’s otherworldly write endurance and low latency would have made it a perfect choice for this workload.”

KV caching is a write-heavy job that chews through NAND and demands DRAM nobody can get. Optane did sub-10-microsecond latency with endurance flash cannot touch, and Intel shut it down in 2022 because Micron walked away from the silicon. Intel was not wrong that it had no market then. It killed the product two years before the exact workload that justified it showed up.