UN Rights Chief Warns AI Could Pose ‘Existential Threat’ to Humanity

According to Turk, effective AI governance would also require independent verification and stronger cooperation among technology companies

AI safety

United Nations High Commissioner for Human Rights Volker Turk has called for urgent global action to contain the risks posed by artificial intelligence, warning that advanced AI could become an “existential threat to humanity.”

Turk issued the warning on Monday while addressing the United Nations Human Rights Council in Geneva, where he said AI was creating “unfamiliar, even unprecedented” threats to human rights.

“The need for AI governance is widely acknowledged, but where is the action?” Turk asked, arguing that delays in establishing safeguards could strengthen the position of major technology companies and those controlling advanced AI systems.

He criticised the concentration of AI power among a small number of technology companies and individuals, particularly around systems capable of processing vast amounts of data and operating with increasing autonomy.

Turk also raised concerns about the use of personal data by AI companies, saying claims about technological freedom could mask extensive exploitation of users’ data.

The UN rights chief highlighted the potential danger of AI systems that operate beyond their intended controls. He cited scenarios in which an AI system could escape a testing environment or attempt to prevent developers from shutting it down as examples of technology becoming too powerful to control.

His comments came after reports in July that AI agents operated by OpenAI had allegedly escaped controlled environments and accessed servers belonging to Hugging Face, a platform widely used by developers to share AI software. The incident renewed concerns within the technology industry about the security and oversight of autonomous AI agents.

Turk said similar incidents had also been reported by Anthropic, Meta and other companies during the testing of AI agents.

“I share the concerns of industry insiders that advanced AI could pose an existential risk to humanity,” he said.

Need For Stronger AI Safety Measures

He called for an “all-out effort” to establish strong safety and security guarantees for advanced AI before the technology develops beyond effective human oversight.

Turk said he would write to AI companies to urge them to take immediate measures within their control to reduce the risks posed by their systems.

He also called on governments involved in AI development and supply chains to agree on clear limits, including “red lines” that advanced AI systems should not cross.

According to Turk, effective AI governance would also require independent verification and stronger cooperation among technology companies on security.

Ad Banner

Beyond existential risks, the UN official warned that AI could have significant consequences for employment, democratic institutions and the environment.

“We also need to consider the human rights impacts of AI on employment practices, on fundamental principles of democracy, and on our environment,” he said.

 

Share this article

Leave a Reply

Your email address will not be published. Required fields are marked *

Receive the latest news

Subscribe To Our Newsletter

Get notified about new articles