“The chat history shows Optum employees would ask the chatbot things like “What should be the determination of the claim?” and “How do I check policy renewal date?””
Optum’s “SOP Chatbot” sat on a public IP with no password, and its logs show employees asking it what the determination of a claim should be. Optum calls it a demo that “would never make any decisions.” Asked for a poem about denying a claim, it produced seven paragraphs of verse. UnitedHealth made $22 billion in profit in 2023 and is fighting a lawsuit over an AI model with a 90% error rate.