“This makes it very hard to know how good AI models are at the work Americans actually do.”
About 90% of US working hours go to tasks with little or no benchmark coverage. Every “AI can do your job” headline rests on the other 10%. Mercor sells human experts to AI labs, so the gap is also its sales pitch.