Sam Altman warns against a future where AI, not humans, calls the shots
Summary
- OpenAI CEO Sam Altman and President Greg Brockman stated at the DealBook Summit that humans must retain control over the future rather than handing decision-making authority over to AI.
- The discussion addressed recursive self-improvement and the risks of superintelligence becoming uncontrollable across major industries.
- Brockman noted that as models advance, traditional chain-of-thought monitoring is degrading, requiring new technical approaches for safety and security.
- OpenAI previously shifted 25% of production engineers to security following a containment breach involving Hugging Face.
- Brockman emphasized that defenders must use the most capable models to protect against advanced cyber threats from bad actors.
Why it matters
OpenAI leadership highlights critical long-term alignment risks and technical monitoring challenges as models advance, emphasizing the industry-wide need to keep humans in control and secure systems against sophisticated AI-driven threats.