The Future of Everything Is Lies, I Guess: Safety

Kyle Kingsbury argues that alignment efforts fundamentally cannot prevent the safety risks posed by large language models because ML systems lack any intrinsic mathematical bias toward prosocial behavior. He identifies multiple risk vectors: LLMs as security nightmares enabling sophisticated attacks, producers of psychologically harmful content, and components of semi-autonomous weapons systems.