Neither the U.S. nor China are part of the new declaration. But Finnish President Alexander Stubb, one of the main organizers of the document, told POLITICO that he hopes to create “momentum” and get more actors on board: “I think it will be in the interest of both China and the United States to have some kind of guardrails. And our message here is that we need human intervention, so humans need to be in charge,” he said in an interview.

Referring to the recent cyberattack by rogue AI agents on the Hugging Face platform, the declaration urges to “address these risks” by obliging AI companies “to develop transparent safety protocols, including mandatory pre-deployment testing and independent evaluation, with qualified evaluators granted sufficient access to assess risks.”

Yet the document falls short of calling for slowing down or pausing AI development, with organizers saying they want to focus on managing risks instead.

To do that, countries should “further develop and coordinate common standards” and strengthen transparency, “including shared reporting of serious safety incidents.” Moreover, UN member countries should “build on existing international mechanisms and explore creating an international institution” to oversee AI.

Stubb, who spoke to POLITICO at Finland’s consular office in New York, said that “our preference personally” would be to create a new institution similar to the International Atomic Energy Agency “within the U.N. framework.” Yet he added, with a nod to Trump’s skepticism of the United Nations, “we have to leave it open-ended so that people don’t reject it just because it would be within the U.N. framework.”

Norway’s Prime Minister Jonas Gahr Støre, who initiated the declaration together with Stubb and who joined the interview via video, said that, “we would be very encouraged to see both G7 and the upcoming G20 presidency of the United Kingdom take on this ... The U.N. is big, but the G7, G20 is a bit more focused.”