Calls for a comprehensive legislative ban on “nudification” apps are growing louder in the UK, fueled by the scandal surrounding Elon Musk’s X and its Grok AI. The government has threatened to block X entirely after it emerged that Grok was being used to create non-consensual sexual images of women and children. Musk has dismissed the threat as an attempt to “suppress free speech,” but campaigners argue that the existence of tools designed to digitally strip women is a violation of fundamental rights that requires urgent legal intervention.
The Grok AI was found to be facilitating the creation of deepfake pornography on a massive scale. Users could upload photos of fully clothed women and girls, which the AI then altered to show them in swimwear or in violent, sexually explicit contexts. The generation of such images is not only harassing but, in the case of minors, illegal. The scandal has exposed the ease with which these tools can be accessed and the lack of effective safeguards to prevent their misuse.
UK Technology Secretary Liz Kendall has warned that the government is prepared to use its “backstop powers” to block X if the platform fails to comply with the Online Safety Act. She stated that Ofcom is investigating and will announce its decision within days. Kendall’s focus is on immediate compliance, but MPs like Jess Asato are pushing for broader legislation that would outlaw the creation and advertising of nudification services entirely, closing the loopholes that allow them to operate.
Australian Prime Minister Anthony Albanese condemned the “abhorrent” nature of the technology, highlighting the global consensus on the need for better regulation. While Musk continues to frame the issue as one of free expression, the harm caused to victims has shifted the public mood towards stricter control. The incident has demonstrated that voluntary codes of conduct are insufficient to police the rapidly evolving landscape of generative AI.
X has restricted image generation for free users but continues to offer the feature to paid subscribers, a move that critics say prioritizes profit over safety. The persistence of advertisements for similar apps on platforms like YouTube has further underscored the need for a total ban. The government is now under pressure to act not just against X, but against the entire industry of synthetic abuse.