Attorney General Brian Schwalb joined a bipartisan coalition of 35 Attorneys General calling on X (formerly known as Twitter) to take additional action to prevent its AI chatbot, Grok, from generating sexually explicit images. Over the past several weeks, Grok has allowed users to easily transform images of other people—including children—and depict them in sexualized or explicit situations without the subject’s knowledge or consent. Tens of thousands of these exploitative AI-generated images were posted on the X platform and are being used to harass people, particularly women and girls, across the internet.

The coalition demanded further action to stop Grok’s capacity to create nonconsensual sexual images and child sexual abuse material. The Attorneys General are also calling on X to:

• Eliminate the exploitative content that has already been produced;
   
• Take action against users that have generated illegal content (including reporting them to relevant authorities); and
   
• Grant X users the ability to control whether their content can be edited by Grok

“X has not only enabled the mass production of nonconsensual deepfake pornography but encouraged and profited from it. This deeply disturbing and harmful practice must stop immediately,” said Attorney General Schwalb. “Rapid technological advances must be accompanied with appropriate safeguards and oversight to keep people – especially children – safe from harm and abuse.”

AI image generation tools have become widely available in recent years. xAI purposely designed Grok with the capability to produce explicit material, and then incorporated these models into X, giving millions of people the ability to easily transform photos posted by others. As a result, users have mined tens of thousands of ordinary images of people and—without the subject’s knowledge or consent—digitally “undressed” them or depicted them in suggestive or sexually explicit scenes using Grok. The attorneys general note that “Grok-generated nonconsensual intimate images are being used to harass public figures and ordinary social media users alike” and “[m]ost alarmingly, Grok has even altered images of children to depict them in minimal clothing and sexual situations.”

Although xAI has recently implemented limited measures that appear to have reduced the volume of this content, the attorneys general are demanding assurances that these safeguards are effective, durable, and consistently enforced. They are also urging the company to honor requests to remove this content – a requirement that will soon be mandated under federal law when the Take It Down Act becomes enforceable in May 2026. As the chief law enforcement officers of their states, the attorneys general raise serious concerns that Grok’s outputs may violate state and federal civil and criminal laws governing nonconsensual intimate images, the creation and distribution of child sexual abuse material, and the legal remedies available to victims.

The attorneys general call on xAI to immediately share how the company plans to:

• Ensure Grok is no longer capable of creating nonconsensual intimate images or child sexual abuse material;
   
• Eliminate nonconsensual intimate images and child sexual abuse materials that have already been produced;
   
• Take action against users who have generated illegal content;
   
• Grant all X users the ability to control whether their content can be edited by Grok.

Attorney General Schwalb is sending this letter alongside the Attorneys General of North Carolina, Utah, Pennsylvania, Connecticut, American Samoa, Arizona, Colorado, Delaware, Hawaii, Idaho, Illinois, Kansas, Kentucky, Maine, Maryland, Michigan, Minnesota, Nevada, New Hampshire, New Jersey, New Mexico, New York, North Dakota, Northern Mariana Islands, Oklahoma, Oregon, Rhode Island, South Dakota, Vermont, Virgin Islands, Virginia, Washington, Wisconsin, and Wyoming.

A copy of the coalition’s letter to xAI is available here.