“We can confirm that your email does not appear in our training dataset.”
Breunig asked OpenAI what personal data of his sat in its training set. Over 101 days it blew the 45-day CCPA deadline, offered an “organization” exclusion he never asked for, and searched using the first name in his support chat profile. When ChatGPT produced his real email address, OpenAI said the model guessed it. Hallucination is now a privacy compliance strategy.