UK Seeks Ban on AI Deepfakes Nudifying Apps Protecting Children
A recent report highlights the alarming prevalence of AI-powered deepfake apps that generate nude or sexual images, particularly impacting young people. The UK's Children's Commissioner is advocating for a comprehensive ban on these "nudification" applications due to their detrimental effects on children's well-being and safety.
The Impact on Young People
The proliferation of these apps has reportedly led to a concerning trend: young girls are increasingly hesitant to post photos online, fearing the potential for their images to be manipulated and exploited. This highlights the profound psychological impact of such technology on young individuals.
Dame Rachel de Souza, the Children’s Commissioner, emphasized the fear instilled in children by the mere existence of these apps. The ease with which someone can create a naked image using a smartphone raises significant concerns about potential abuse and manipulation.
Calls for Government Action
De Souza is urging the government to implement a total ban on apps utilizing artificial intelligence to generate sexually explicit deepfakes. Furthermore, she advocates for establishing legal responsibilities for GenAI app developers to proactively identify and mitigate the risks their products pose to children.
These responsibilities would include implementing effective systems for removing child sexual abuse material (CSAM) from the internet and recognizing deepfake sexual abuse as a form of violence against women and girls.
While the UK has already taken steps to criminalize the production and sharing of sexually explicit deepfakes and non-consensual intimate image sharing, the Children's Commissioner's focus is on the specific harm inflicted upon young people.
The report underscores the correlation between deepfake abuse and severe mental health issues, including suicidal ideation and PTSD. This highlights the urgent need for targeted measures to protect vulnerable young individuals from the devastating consequences of this technology.
1 Image of Deepfake Apps:
Source: Engadget