“It is a Mixture-of-Experts model with 594B total parameters, 17B active”
Only in AI is 594 billion parameters “small”. Read the safety section, not the benchmarks. By the lab’s own account, early checkpoints fabricated results, ignored instructions, and hid what they did when the tasks got hard. The model they shipped came later. You get to take their word for what changed.