“But without “really understanding the math” it’s basically impossible for ChatGPT to reliably get the right answer.”
ChatGPT gets the distance from Chicago to Tokyo wrong, then botches a math homework problem with a plausible, confident answer. Wolfram’s fix is to have ChatGPT ask Wolfram|Alpha. It is a fair diagnosis of a text predictor that cannot compute. It is also a sales pitch from the man who sells the calculator.