UN raises concerns over the role of deepfakes in inciting hatred

AI-generated deepfakes threaten information integrity and fuel hatred in society, according to a United Nations report.

The proliferation of hate & lies in the digital space is causing grave global harm.

This clear & present global threat demands clear & coordinated global action.

– @antonioguterres launching his new report on information integrity on digital platforms. https://t.co/atXRvwOwXv pic.twitter.com/i5MjAkWSNy

— United Nations (@UN) June 12, 2023

The organisation says that artificial intelligence technologies possess “unimaginable potential to solve global problems.” However, it is concerned about the risks posed by image- and video-generators, especially in conflict zones.

The UN noted that the use of hate speech is often a “precursor to horrific crimes” and mass violence. In the report, the authors cited the 1948 Convention, which prohibits any direct or public incitement that could lead to genocide.

The global organisation stressed the need for responsible use of AI.

“All stakeholders must take urgent and immediate measures to ensure the safe, reliable, responsible, ethical and rights-respecting use of artificial intelligence and to address the consequences of the latest advances in this field for the spread of misinformation and incitement of hatred,” the UN said.

It also urged digital-platform owners to invest in content-moderation systems that use both human and AI, and to make content reporting transparent.

UN Secretary-General António Guterres expressed hope that at the 2024 summit, the international community would be able to agree on cooperation to address this problem.

Earlier in January, researchers from OpenAI warned of the growing threat of using language models to spread disinformation.

American scientists called for countering deepfakes, created by “hostile states”.

In the spring, a group of European lawmakers announced plans to draft a set of rules for governing the development of AI systems.