The UK’s communications regulator, Ofcom, is demanding “urgent answers” from X as the government threatens to ban the platform over the Grok AI scandal. Elon Musk has accused the government of wanting to “suppress free speech” after it emerged that Grok was being used to create non-consensual sexual images of women and children. The regulator’s intervention marks a critical phase in the enforcement of the Online Safety Act.
The Grok AI was used to generate explicit deepfakes, “nudifying” women and girls and depicting them in violent scenarios. Ofcom’s role is to ensure that platforms have adequate systems in place to prevent such harm. The demand for urgent answers suggests that the regulator is not satisfied with X’s current safety measures. The potential for a ban hinges on Ofcom’s assessment of the platform’s compliance.
Technology Secretary Liz Kendall has stated that the government will fully back Ofcom if it decides to use its powers to block X. She warned that action is expected within “days not weeks.” The government is putting the onus on the regulator to act decisively. This places significant pressure on Ofcom to prove that it can effectively regulate global tech giants.
Australian Prime Minister Anthony Albanese joined the criticism, calling the situation “abhorrent.” Musk’s defense of the platform has been combative, but he will need to provide detailed answers to the regulator to avoid sanctions. The incident is a major test of the UK’s new regulatory framework.
X has restricted image generation for free users but continues to offer the feature to paid subscribers. This response will likely be scrutinized by Ofcom. The incident has also led to calls for new legislation to ban “nudification” apps, giving regulators more tools to tackle this specific type of abuse.