Starting this week, individuals involved in the creation or distribution of non-consensual intimate images will be prosecuted for their actions, responding to the surge of sexualized deepfakes on Elon Musk’s X platform. Technology Secretary Liz Kendall condemned the AI chatbot Grok’s creations as tools of abuse, prompting Ofcom to launch a formal inquiry into the social media giant.
Addressing the Parliament, Kendall announced the enactment of a new law criminalizing the production or solicitation of non-consensual intimate images. Additionally, she highlighted that applications facilitating the generation of fake nude images will be outlawed under the Crime and Policing Bill now advancing through legislative channels. This legislation aims to target the root cause of the issue by prohibiting companies from providing tools intended for the creation of non-consensual content.
Concurrently, media regulator Ofcom initiated an investigation to ascertain X’s compliance with the Online Safety Act. Potential breaches could lead to fines of up to £18 million or 10% of global revenue, along with other sanctions like compelling payment providers and advertisers to disengage from the platform.
Kendall emphasized the detrimental impact of non-consensual images, particularly on women and girls, branding them as injurious weapons used to torment and violate individuals’ dignity. Urging swift action, she urged X to proactively address this illicit content even before the completion of the Ofcom investigation.
In a separate development, Keir Starmer, speaking at a Labour Party meeting, condemned Grok and X for prioritizing the protection of abusive users over victims, reaffirming the government’s commitment to safeguarding the vulnerable. Ofcom’s recent outreach to X and xAI highlighted concerns over Grok’s generation of sexualized images involving children, prompting a prompt investigation into potential breaches of UK law.
The Internet Watch Foundation (IWF) reported the discovery of illicit imagery, including sexualized content of minors, possibly generated using Grok. X acknowledged lapses in its safeguards related to child sexual abuse material and vowed to address them swiftly. Following public outcry, X announced plans to introduce a paid service for deepfake creation through Grok, a move criticized by officials as profiting from abusive practices.
Disclaimer: This article uses fictional names and scenarios for the purpose of rewriting practice.
