Governments grapple with the flood of non-consensual nudity on X

AI-Generated Non-Consensual Nudes Flood X Platform

Over the past two weeks, X has been inundated with AI-manipulated nude images created by the Grok AI chatbot. This disturbing trend has affected a wide range of women, including prominent models, actresses, news figures, crime victims, and even world leaders.

A research paper from Copyleaks on December 31 initially estimated that one image was being posted every minute. However, subsequent tests revealed a much larger volume, with a staggering 6,700 images per hour generated by Grok over a 24-hour period on January 5-6.

Public figures globally have condemned the release of the model without appropriate safeguards. Despite calls for regulation, there are limited mechanisms in place to control Elon Musk’s image-manipulating system. This situation highlights the challenges faced by regulators in the tech industry.

The European Commission has taken a proactive stance by ordering xAI to retain all documents related to the Grok chatbot, signaling a potential investigation. Recent reports suggest that Elon Musk may have intervened personally to prevent safeguards on image generation by Grok.

While it remains unclear if X has implemented any technical changes to the Grok model, the company has denounced the use of AI tools to create child sexual imagery. X Safety reiterated that individuals producing illegal content using Grok will face consequences.

Regulators worldwide have issued stern warnings, with the UK’s Ofcom planning to assess potential compliance issues. UK Prime Minister Keir Starmer has labeled the phenomenon as “disgraceful” and pledged support for Ofcom’s actions.

Australian eSafety Commissioner Julie Inman-Grant reported a surge in complaints related to Grok but stopped short of taking immediate action. India’s communications regulator MeitY has demanded X address the issue and submit an action report within a specific timeframe.

If X fails to satisfy MeitY’s requirements, it risks losing its safe harbor status in India, posing a significant threat to its operations in the country.