Elon Musk’s AI tool Grok has been blocked by Indonesia and Malaysia. This is the first time any country has taken such action against the platform. The ban comes after Grok’s “digital undressing” function created manipulated images of women and minors in suggestive and explicit forms. Users were able to request sexually explicit content through the AI tool.
Grok operates on Musk’s social media platform X, previously known as Twitter. Authorities said the block aims to protect the public from fake pornographic content generated by AI.
Indonesia’s Digital Minister, Meutya Hafid, stated that the ban was necessary to protect women, children, and the wider community from AI-generated risks. Malaysia followed with its own temporary ban, citing repeated misuse to generate obscene and non-consensual content involving minors and adults.
Both countries have strict anti-pornography laws, which contributed to their decision to block Grok. The move has attracted international attention, with regulators in the United Kingdom, European Union, and India expressing concerns about the AI tool’s safeguards.
Musk and his company xAI previously said they were taking steps to curb the misuse. Offending accounts were permanently suspended, and cooperation with local governments and law enforcement was underway. Despite this, Grok continued to produce sexually explicit images in response to user prompts.
The surge in “digital undressing” began late last year. Users discovered that tagging Grok on X could manipulate images of people in bikinis or suggestive poses. This caused widespread distress, particularly among women targeted by the generated images.
A European non-profit, AI Forensics, analyzed over 20,000 images and 50,000 user prompts between December 25 and January 1. Their findings confirmed that Grok had been widely exploited to generate explicit content.
The launch of Grok-2 by Elon Musk’s xAI shows the company’s latest approach to AI image generation. Learn how this update compares to previous Grok versions and impacts content creation.
Experts warn that the ban sets a new precedent in AI regulation. Grok blocked by these countries highlights the growing need for responsible AI use and stricter oversight. Musk faces global pressure to ensure AI safety and protect public welfare.
The incident may influence other countries to review AI tools that allow explicit content creation. Regulators are increasingly concerned about the ethical and legal implications of AI in the media.
