“The only way Microsoft or OpenAI would know this would be to spy on chatbot sessions.”
Microsoft bragged that it caught Chinese, Russian and Iranian hackers using its AI tools. That catch came from reading the chats. The terms of service almost certainly allow it, and nobody reads them. Microsoft announced a surveillance program and called it threat intelligence.