“By various analyses described in the paper (still not published or peer-reviewed) they “estimate that 33%-46% of crowd workers used LLMs when completing the task.””
EPFL researchers paid turkers to summarize abstracts and found a third to nearly half of them handed the job to an LLM. Mechanical Turk pays pennies per task and rewards speed, so of course they did. Researchers buy this “human” data to fact-check LLMs. They are paying to grade ChatGPT with ChatGPT.