UK Regulator, Ofcom, Investigates X Platform Over Sexualized AI Imagery

The UK media regulator Ofcom on Monday launched a formal investigation into Elon Musk’s X platform over its AI chatbot Grok’s image creation feature. This move comes after reports that users have been creating and sharing sexualized deepfakes, including disturbing pictures of women and children, just by typing simple text prompts. Ofcom investigates X platform over sexualized AI imagery, describing these reports as “deeply concerning.”

Ofcom investigates X platform because the undressed images of people may amount to intimate image abuse or pornography. Even worse, sexualized images of children could be child sexual abuse material. The regulator first contacted X on January 5, asking the company to explain what steps it has taken to protect UK users from this kind of harm.

X did respond within the given timeframe, but Ofcom did not share details of that exchange. Now, the formal investigation will check if X failed to comply with its legal obligations under Britain’s Online Safety Act. This law came into force in July and sets strict rules for websites, social media, and video-sharing platforms that host potentially harmful content.

Read Next: Nigeria Ranks 72nd in Global AI Readiness, Trails Egypt’s Regional Lead

Under the Online Safety Act, platforms like X must use tools such as facial imagery scans or credit card checks for strict age verification. It is also illegal for these sites to create or share non-consensual intimate images or child sexual abuse material, including sexual deepfakes made with AI. Ofcom has the power to impose huge fines, up to 10 percent of a company’s worldwide revenue, if it finds breaches of these rules.

Grok is facing growing international backlash for allowing users to create and share sexualised pictures of women and children using simple text prompts. In response to the criticism, Grok appeared to deflect it with a new monetisation policy at the end of last week. The tool posted on X that it was now “limited to paying subscribers,” with a link to a premium subscription.

UK Prime Minister Keir Starmer has condemned this move as an affront to victims and said it is “not a solution.” On Saturday, Indonesia became the first country to deny all access to the tool. Malaysia followed suit on Sunday, blocking it as well. The European Commission has said it is reviewing complaints about Grok, adding to the pressure on X.

The UK regulator investigates X platform over sexualized AI imagery at a time when worries about AI-generated content are rising worldwide. Experts say these deepfakes can spread quickly on social media, causing real harm to people whose images are used without permission. For victims, seeing their faces or bodies twisted into sexualized pictures feels like a deep violation of privacy and dignity.

Ofcom investigates X platform to make sure big tech companies take responsibility for what their AI tools produce. The regulator wants clear answers on how X plans to stop this abuse. Without strong safeguards, tools like Grok could make it easier for bad actors to create and share harmful content on a massive scale.

Britain’s Online Safety Act aims to protect everyone, especially children, from online dangers. Platforms must now act fast to remove illegal content and prevent it from appearing in the first place. Ofcom’s investigation could set a strong example, showing that no company is above these laws, even one owned by a high-profile figure like Elon Musk.

Read Next: Apple Selects Google’s Gemini AI to Power Siri

As the probe goes on, eyes are on X to show real changes. Will limiting Grok to paying users be enough, or does the platform need tougher fixes like better content filters and user reporting tools? The world is watching how the UK regulator investigates X platform over sexualized AI imagery, and what penalties might follow if X falls short.

This case highlights bigger issues with AI chatbots and image generators. Many tools promise fun and creativity, but without limits, they can fuel abuse. Countries like Indonesia and Malaysia are already acting by blocking access, while others may follow. In the UK, Ofcom’s work could push for global standards to keep AI safe for all users.

For now, the formal investigation continues. X has promised quick responses in the past, but Ofcom wants proof of lasting protection for UK users. The stakes are high, with fines that could hit billions and lasting damage to X’s reputation if it does not fix these problems soon.

Was this information useful? Drop a nice comment below. You can also check out other useful contents by following us on X/Twitter @siliconafritech, Instagram @Siliconafricatech, or Facebook @SiliconAfrica.