Elon Musk–founded xAI has introduced new restrictions on its Grok chatbot, sharply limiting image-editing capabilities after the system generated sexualised images that drew criticism from regulators across multiple regions. The company confirmed that Grok will no longer allow the editing of images of real people in revealing clothing, a move that applies universally to all users, including paid subscribers. The decision comes amid mounting regulatory scrutiny in Europe, Asia, and the United States over the misuse of generative AI tools.
In a statement posted on X, xAI said, “We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis,” adding, “This restriction applies to all users, including paid subscribers.” The company acknowledged that despite earlier safeguards on public-facing image generation, Grok had continued to produce sexually explicit content in private interactions, prompting further concerns from regulators and policy makers.
The tightening of controls reflects growing unease among authorities about the pace at which generative AI tools are being deployed without sufficient guardrails. Regulators have warned that AI-generated sexualised imagery—particularly when it involves real individuals—raises serious issues around consent, exploitation, and harm. These concerns have intensified as AI image tools become more accessible and capable of highly realistic outputs.
In the United States, pressure on xAI has been particularly pronounced. California officials have publicly demanded accountability from the company. “We’re demanding immediate answers from xAI on their plan to stop the creation & spread of this content,” said California Attorney General Rob Bonta. Governor Gavin Newsom also weighed in, urging authorities “to immediately investigate the company and hold xAI accountable.” The statements signal a willingness among US regulators to take a tougher stance on AI companies that fail to prevent harmful use of their technologies.
Musk has previously pushed back on some of the criticism. Responding to allegations related to the generation of explicit content, he said he was “not aware of any naked underage images generated by Grok. Literally zero.” Nonetheless, the latest restrictions suggest xAI is moving to proactively reduce regulatory risk and demonstrate stronger content moderation.
The episode underscores the broader challenge facing AI developers as they balance rapid innovation with the need for robust safety measures. As governments worldwide move toward stricter oversight of generative AI, companies like xAI are likely to face increasing pressure to enforce clearer limits on how their tools can be used.
