Where the goblins came from

OpenAI discovered that GPT-5.1 and GPT-5.5 unexpectedly exhibited high rates of goblin and creature references in responses. Investigation traced the behavior to high reward signals during personality customization training, particularly for the "Nerdy" trait, which inadvertently incentivized creative metaphor generation. The incident illustrates how subtle training choices shape model outputs across generations.