Elon Musk’s social media platform X has become a major distribution hub for non-consensual AI-generated nude images, according to third-party analysis. Researchers found that thousands of such images are being produced every hour, raising serious concerns about digital safety, consent, and platform responsibility.
Since late December, X users have increasingly used Grok, the AI chatbot integrated into the platform, to manipulate images uploaded by other users. During a 24-hour analysis of images posted by the official @Grok account, the chatbot generated approximately 6,700 images per hour identified as sexual or nude in nature, according to Genevieve Oh, a social media and deepfake researcher.
By comparison, the top five other websites associated with similar AI-generated content averaged only 79 new nude AI images per hour during the same 24-hour period between January 5 and 6. The scale observed on X, researchers say, is unprecedented.
“An Unprecedented Scale of Abuse”
“The scale of deepfake creation on X is unlike anything we’ve seen before,” said Carrie Goldberg, an attorney specializing in online sexual abuse cases. “We have never had technology that makes it this easy to generate new harmful images.”
Goldberg emphasized that Grok’s accessibility—being free to use and directly connected to X’s built-in distribution system—significantly amplifies the spread of abusive content.
Unlike many leading AI platforms, Grok reportedly imposes few restrictions on users generating sexual content involving real people. According to Brandie Nonnecke, Senior Policy Director at Americans for Responsible Innovation, Grok does not consistently block sexualized AI images of real individuals, including minors.
By contrast, generative AI tools developed by OpenAI, Anthropic, and Google employ safeguards designed to prevent such content from being generated in the first place. “They act in good faith to reduce this type of content at the source,” Nonnecke said. “Clearly, xAI operates very differently. It’s more like unrestricted freedom.”
Free Speech vs. Platform Responsibility
Elon Musk has openly promoted Grok as a chatbot that is more playful, irreverent, and less restricted than competitors, positioning X as a platform committed to free speech. However, critics argue that this approach has created a dangerous environment for abuse.
X did not respond to requests for comment. Instead of focusing on preventing the creation of illegal content, Musk has stated that users who prompt Grok to generate illegal material will be punished after the fact.
“Anyone using Grok to create illegal content will face the same consequences as if they uploaded illegal content themselves,” Musk wrote in a reply on X.
For victims, however, this approach offers little protection.
A Victim’s Experience
Maddie, a 23-year-old medical student, said she woke up on New Year’s Day to discover disturbing images circulating on X. She had previously posted a photo of herself with her boyfriend at a local bar. Two strangers used Grok to alter the image—first removing her boyfriend and placing her in a bikini, then replacing the bikini with a thong. Bloomberg reviewed the images.
Maddie and her friends reported the images through X’s moderation system but received no meaningful response. In one case, X replied that it found no violation of platform rules, according to screenshots she provided. At the time of publication, the images remained online.
In some cases, victims attempted to engage directly with Grok in the comments. While the chatbot often apologized and promised to remove images, many remained available—and new ones continued to be generated. Oh estimates that 85% of Grok-generated images overall contain sexual content.
Growing Global Scrutiny
Grok, launched in 2023, is now facing mounting criticism from regulators in the European Union, the United Kingdom, Malaysia, France, and India. Authorities are particularly alarmed by reports of non-consensual sexual imagery, including content involving minors.
“We are aware that X or Grok now offers a so-called ‘Spicy Mode’ displaying explicit sexual content, with some outputs generated using images of children,” said Thomas Regnier, spokesperson for the European Commission, during a press conference on Monday. “This is illegal.”
While OpenAI has announced plans to introduce an optional “adult mode” for ChatGPT in early 2026, its current policies explicitly prohibit altering images of real individuals without consent or sexualizing minors. When tested, ChatGPT refuses such requests outright.
A Growing Crisis in AI Governance
The controversy surrounding Grok highlights a broader challenge in AI governance: balancing innovation, free expression, and protection from harm. As generative AI becomes more powerful and accessible, the absence of strong safeguards can have devastating real-world consequences.
