News update
  • UNGA President Urges Four Steps for Rohingya Justice     |     
  • Fugitives can’t be brought back from Delhi through violence: Kobir     |     
  • ICJ asks Myanmar: cease violations, prosecute perpetrators, take back-compensate Rohingya     |     
  • Dhaka Ranks 13th Among World's Most Polluted Cities on Friday     |     
  • Petrol Bomb Allegedly Hurled at State Minister's Home     |     

UN Warns AI Is Giving Child Predators New Weapons

GreenWatch Desk: Refugee 2026-11-20, 2:16pm

image770x420cropped5-8741e7c8550b4ece2ec6922333e1533b1795162958.jpg

A technician works in a data service centre.



Artificial intelligence (AI) is giving predators and criminal groups new ways to groom, extort and exploit children, while efforts to protect young people are failing to keep pace, senior United Nations officials warned on Thursday.

“We lost the battle on social media because we were lagging behind, and we are now losing the battle on artificial intelligence because we are still lagging behind,” said Dr Najat Maalla M’jid, the UN Special Representative of the Secretary-General on Violence against Children.

She made the remarks at a high-level event at the UN General Assembly on the risks and opportunities of AI in efforts to end violence against children.

At least 1.2 million children in 11 countries had their images manipulated into sexually explicit deepfakes in the past year alone, UN Deputy Secretary-General Amina Mohammed told the event at UN Headquarters in New York, citing a recent study by the UN Children's Fund (UNICEF).

Reports of child sexual abuse material linked to generative AI increased by 1,325 per cent between 2023 and 2024, according to the US-based National Center for Missing and Exploited Children, Dr M’jid said.

She added that most AI-facilitated crimes against children remain unreported and are not adequately prosecuted.

Weaponising technology

Chatbots are being used to gain children's trust, collect personal information and pressure them into sharing explicit images, Dr M’jid said.

Deepfakes created through so-called nudification apps are also being used to humiliate, threaten and exploit children.

Profiling and predictive targeting are making it easier for predators, traffickers and criminal groups to identify and reach vulnerable children.

John Trenary, who has worked on child exploitation investigations for more than 25 years, said offenders had always looked for ways to weaponise technology to exploit children.

However, AI's ability to automate processes and generate entirely synthetic content allows such abuse to spread rapidly and perpetuate itself, he warned. As investigators address one form of misuse, new methods emerge.

Kay Chau of the Tech Coalition, a non-profit alliance focused on child protection, said perpetrators may be using chatbots to facilitate abusive role-play or generate grooming scripts.

The emergence of agentic AI — systems capable of carrying out tasks independently — is creating additional risks, she added.

'Lucia is our agent'

Mariana Rozo-Paz of the Datasphere Initiative recalled working with teenage girls in a digital literacy programme in rural Colombia last year.

When asked to draw what the internet looked like, the girls drew a girl named Lucia, whom they described as their AI agent.

“We talk to Lucia every day,” they told her. “Whenever adults don’t want to answer specific questions, we ask Lucia. She’s always there for us. She has intimate mode, best friend mode.”

Calls for proven safety standards

UN Deputy Secretary-General Amina Mohammed said AI systems were reaching children without the level of safety scrutiny expected for products designed for young users.

She said children's safety could not be left to the goodwill of technology companies.

In July, UN Secretary-General António Guterres launched the AI Child Safety Pledge, which aims to ensure AI systems are certified as safe before reaching children and establish zero tolerance for AI-generated child sexual abuse material.

Dr M’jid said voluntary commitments by technology companies were insufficient, calling for global standards as part of AI governance, including mandatory safeguards for child safety and privacy by design.

Mohammed also noted that AI could help detect abusive material, identify victims and recognise early signs of grooming.

A young participant in a World Childhood Foundation study in Sweden highlighted the gap between technological progress and oversight.

“The technology is really cool. But you can tell that the people in charge of controlling it cannot keep up,” the participant said.

World Childhood Foundation Secretary-General Paula Guillet de Monthoux said children should never have to worry that the adults responsible for their safety cannot keep pace with technological developments.

She said ensuring children's protection was the responsibility of adults and institutions.

Source: UN News