“Oddly enough, though, the full o1 performs worse than the preview version on a number of common benchmarks.”
ChatGPT Pro costs $200 a month, 10x Plus, and its headline feature is o1 pro mode, which “uses more compute.” The full o1 scores worse than the preview on several benchmarks, including MLE-Bench. OpenAI expects to lose roughly $5 billion this year. Charging your heaviest users more to run the model longer is a price hike sold as a breakthrough.