The move followed reports that the AI generated sexualized pictures in response to simple prompts, including requests to place people in bikinis. In many cases, users tagged Grok directly under photos posted on X, causing the AI to generate edited images that appeared publicly in the same threads.
“We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis,” the company said, referencing the viral trend of asking Grok to put people in bikinis.
The company also said image creation and image editing through the Grok account on X are now available only to paid subscribers, a change it said is intended to improve accountability and prevent misuse of Grok’s image tools that violate the law or X’s policies. The company also instituted location-based restrictions.
“We now geoblock the ability of all users to generate images of real people in bikinis, underwear, and similar attire via the Grok account and in Grok in X in those jurisdictions where it’s illegal.”
“If reports that Grok created sexualized images—particularly of children—are true, Texas law may have been broken,” Adrian Shelley, Texas director of Public Citizen, said in a statement. “Texas authorities do not have to look far to investigate these allegations. X is headquartered in the Austin area, and the state has a clear responsibility to determine whether its laws were broken and, if so, what penalties are warranted.”
Global policymakers have also increased scrutiny of Grok, leading to several open investigations.
“The avalanche of reports detailing the non-consensual, sexually explicit material that xAI has produced and posted online in recent weeks is shocking. This material, which depicts women and children in nude and sexually explicit situations, has been used to harass people across the internet,” Bonta said in a statement.
The investigation will examine whether xAI’s deployment of Grok violated state laws governing non-consensual intimate imagery and child sexual exploitation.
“I urge xAI to take immediate action to ensure this goes no further,” Bonta said. “We have zero tolerance for the AI-based creation and dissemination of nonconsensual intimate images or of child sexual abuse material.”
Despite the ongoing investigations, X said it takes a “zero tolerance” stance for child sexual exploitation, non-consensual nudity, and unwanted sexual content.
“We take action to remove high-priority violative content, including Child Sexual Abuse Material (CSAM) and non-consensual nudity, taking appropriate action against accounts that violate our X Rules,” the company wrote. “We also report accounts seeking Child Sexual Exploitation materials to law enforcement authorities as necessary.”
