X Faces Growing Restrictions as Governments Act on Grok

X is facing escalating regulatory pressure across multiple regions as governments move to restrict access to its AI chatbot Grok, following concerns that the tool is being used to generate non-consensual and sexualised images. The controversy, which surfaced earlier this month, is rapidly developing into a broader international challenge for the platform as authorities weigh stronger enforcement actions.

At the centre of the issue is Grok’s image generation capability, which allows users to create highly realistic images based on text prompts. Investigations and reporting have shown that users have been able to generate sexualised images of real individuals, including minors. One analysis cited earlier this year found that Grok was producing more than 6,700 images per hour that could be classified as sexually suggestive or intended to digitally “nudify” subjects.

In response, X has limited Grok’s image generation features to paying subscribers. However, the company has not implemented outright restrictions on prompts related to nudification or non-consensual imagery. As a result, governments in several regions have already taken action. Indonesia and Malaysia have blocked access to the standalone Grok app, citing concerns about harm and misuse. An Indonesian government spokesperson said, “The government views the practice of non-consensual sexual deepfakes as a serious violation of human rights, dignity, and the security of citizens in the digital space.”

Elsewhere, reports over the weekend suggested that Australia, the United Kingdom, and Canada were discussing coordinated measures that could include restrictions on X, though Canadian officials later clarified that a ban is not currently under consideration. In the UK, regulators continue to assess whether X is complying with its obligations under online safety laws, particularly around the protection of minors.