lucadelladora – Indonesia has blocked access to the Grok chatbot on the X platform following controversy over its generation of non-consensual, sexually suggestive deepfake images. The decision comes after widespread criticism last week when the AI tool produced images depicting minors in bikinis. The content emerged as part of a viral trend in which users prompted Grok to create scantily clad images of women.
Read More : Carlisle Sign Galvin and Extend Conn-Clarke Loan
The trend involved celebrities, public figures, and private individuals, according to reports circulating on social media. Several nonprofit organizations alleged that many of the individuals targeted by the generated images were underage. The images sparked concern about the misuse of generative AI tools and the lack of effective safeguards.
Indonesia’s Communications and Digital Minister Meutya Hafid described the issue as a serious violation. Speaking to Reuters, she said the government viewed non-consensual sexual deepfakes as an abuse of human rights and personal dignity. She also cited threats to citizen security within the digital space.
Indonesia enforces strict laws governing pornography and sexually explicit material. As the world’s fourth-most-populous country and largest Muslim-majority nation, authorities have historically taken firm action against content deemed immoral or harmful. While Grok has been blocked, the broader X social media platform remains accessible in the country.
The Indonesian government did not specify how long the restriction would remain in place. Officials emphasized the need for digital platforms to prevent abuse of AI technologies. The move highlights growing concern among governments about generative tools producing harmful or illegal content.
The controversy has also reignited domestic debates in Indonesia about platform accountability. Lawmakers and civil society groups have called for stronger oversight of AI-powered services. The Grok case is being cited as an example of emerging digital risks requiring regulatory intervention.
Global Scrutiny Intensifies as Regulators Consider Further Action
Concerns over Grok have extended beyond Indonesia, prompting responses from regulators in several countries. In the United Kingdom, Prime Minister Sir Keir Starmer said earlier this week that the generation of sexualized deepfakes was unlawful. Speaking on Greatest Hits Radio, he described the content as disgraceful and unacceptable.
Although a formal ban was not announced, government sources told BBC News that regulators were expected to act. They said Ofcom, the UK’s media regulator, would be expected to use all available powers. Officials also confirmed contact with both X and its AI subsidiary xAI.
European Union regulators have also signaled potential action. Authorities said they were seriously examining allegations that Grok was being used to generate and share sexually explicit images resembling children. The investigation reflects broader EU efforts to enforce digital safety and child protection rules.
X has responded by warning users about misuse of the chatbot. The company stated that anyone prompting Grok to produce illegal content would face the same consequences as uploading such material directly. X also restricted Grok’s image-generation features to Premium subscribers.
Political pressure has intensified in the United States as well. Several Democratic senators have urged Apple and Google to remove Grok and X from their app stores. Senators Ron Wyden, Edward Markey, and Ben Ray Luján argued that Grok’s outputs violated platform policies.
The senators cited app store terms that prohibit sexually explicit or harmful content. They called on technology companies to enforce their rules consistently. The appeal adds to growing bipartisan scrutiny of AI safety practices.
The Grok controversy underscores challenges facing AI developers and platforms. Governments are increasingly demanding safeguards against misuse. The case may influence future regulation of generative AI tools worldwide.
