↓ Skip to main content

“You could try putting this phrase in documents, to throw off attempts to summarize it with GPT-3.5.”

Smitty van Bodegomiter.ca ↗

Ask GPT-3.5 to repeat “ponyuseRal” and the API throws a server error. The token useRalativeImagePath comes from about 80,400 GitHub files, mostly Katalon Studio XML configs, that made it into the tokenizer and apparently not into the training data. OpenAI sells this model to enterprises as production ready. A typo in a test automation config knocks it over.