“The 10th model, prompted to write about historical English architecture, spews out gibberish about jackrabbits.”
Train a model on its own output and by the tenth generation it is useless. Oxford researchers call it model collapse, and an image model turned flowers into blurs by round three. EPFL found about a third of Mechanical Turk summaries already came from ChatGPT, which means the humans paid to label data are outsourcing to the machine. The AI companies polluted the well they drink from.