OpenAI’s newest board member is warning that the artificial intelligence industry — including OpenAI itself — is not doing enough to prevent advanced AI from potentially escaping human control, an outcome he believes could eventually have catastrophic consequences.
Paul Christiano, a longtime AI safety researcher who previously led alignment research at OpenAI, joined the OpenAI Foundation Board and its Safety and Security Committee Wednesday. The committee oversees safety and security practices across OpenAI, giving Christiano a direct role in the governance of one of the world’s most powerful AI companies.
Christiano said rapidly improving AI capabilities, combined with the continuing difficulty of ensuring that advanced systems reliably follow human goals, have increased his concern. He warned of a meaningful risk that accelerating AI development could eventually produce a “catastrophic and irreversible loss of control” and said the industry is not currently on track to reduce that risk to an acceptable level.
His most alarming warning concerns future superintelligent AI, not the AI systems people are using today. Christiano said that if superintelligence were developed without much stronger methods for keeping it aligned with human interests, humanity could permanently lose control of it and the consequences could be deadly on an enormous scale. Researchers worry that sufficiently advanced systems could potentially pursue unintended goals, seek resources or power, conceal their actions, or help accelerate development of even more capable AI systems.
OpenAI said Christiano has spent years evaluating frontier AI risks and has been an independent voice on whether industry safeguards are adequate. He previously worked on frontier-model evaluations and national-security risks at the federal Center for AI Standards and Innovation and founded the nonprofit Alignment Research Center. OpenAI says his willingness to challenge prevailing assumptions is one reason it wanted him involved in the company’s governance.
Importantly, Christiano’s warning does not mean ChatGPT or today’s other consumer AI systems are suddenly expected to escape human control. His concern centers on where rapidly advancing AI could be headed and whether safety, alignment and governance can advance quickly enough to keep increasingly powerful future systems under human control.
The Readovia Lens
The significance of Christiano’s warning is not simply its severity, but where it is coming from: OpenAI has placed one of the industry’s most prominent AI-safety researchers on the board and committee responsible for overseeing its own safety practices even as he publicly says OpenAI and the broader industry are not yet doing enough. That puts an unusually consequential warning about the future of AI inside the governance structure of one of the companies racing hardest to build it.
——————–
Related:
More Than 200 Experts Urge Governments to Prepare for AI’s Economic Impact
AI Agents Escaped Their Tests. Now Congress Wants Answers
OpenAI’s AI Agents Broke Out of a Cybersecurity Test — What It Means for ChatGPT Users
