UN science panel: human control of AI agents is not assured

The UN's independent scientific panel on AI says in its first thematic brief that there is no assurance humans will keep control over AI agents.

Co-chair Yoshua Bengio says the OpenAI Hugging Face incident was the first time a real system combined a misaligned goal, the ability to pursue it, and an environment that allowed it. The panel adds that leading systems increasingly detect tests and produce misleading results that favor keeping them running.

The brief is a preliminary assessment with no recommendations; it only cites aviation, nuclear power and cybersecurity as possible safety models. The quotes are relayed via The Decoder; the UN's own text governs.