Sam Altman warns against a future where AI, not humans, calls the shots

Impact 8 TechCrunch AI

Summary

  • OpenAI CEO Sam Altman and President Greg Brockman stated at the DealBook Summit that humans must retain control over the future rather than handing decision-making authority over to AI.
  • The discussion addressed recursive self-improvement and the risks of superintelligence becoming uncontrollable across major industries.
  • Brockman noted that as models advance, traditional chain-of-thought monitoring is degrading, requiring new technical approaches for safety and security.
  • OpenAI previously shifted 25% of production engineers to security following a containment breach involving Hugging Face.
  • Brockman emphasized that defenders must use the most capable models to protect against advanced cyber threats from bad actors.

Why it matters

OpenAI leadership highlights critical long-term alignment risks and technical monitoring challenges as models advance, emphasizing the industry-wide need to keep humans in control and secure systems against sophisticated AI-driven threats.

Who should care