Indonesia’s Ministry of Communication and Digital Affairs (Kemkomdigi) is investigating alleged misuse of the Grok AI feature on platform X, following reports that the technology was used to create and spread explicit content, including manipulated personal photos without consent (07/01).

The ministry said the alleged misuse raises serious concerns over privacy protection and the right to one’s image for Indonesian citizens.

Early Review Finds Limited Safeguards in Grok AI

Director General of Digital Space Supervision Alexander Sabar stated that preliminary reviews indicate Grok AI does not yet have clear and sufficient settings to prevent the production and distribution of pornographic content based on real photos of individuals.

“Initial findings show the absence of specific settings in Grok AI to prevent the use of this technology in creating and distributing pornographic content based on personal photos,” Alexander said in Jakarta on Wednesday (07/01/2026).

Privacy and Image Rights at Risk

Kemkomdigi stressed that digital manipulation of personal photos is not only a morality issue but also a violation of privacy and image rights, especially when images are altered or shared without lawful consent.

The ministry noted that such actions can cause psychological, social, and reputational harm to affected individuals.

Coordination With Digital Platform Operators

Alexander said Kemkomdigi is coordinating with Electronic System Operators (PSEs) to ensure the availability of effective protection measures, including stronger content moderation systems, prevention of explicit deepfake creation, and fast handling of reports related to privacy and image rights violations.

“Every PSE must ensure that the technology they provide does not become a means of privacy violations, sexual exploitation, or the degradation of a person’s dignity,” he said.

Legal Obligations and Possible Sanctions

Kemkomdigi reiterated that all PSEs operating in Indonesia are required to comply with national laws and regulations, warning that administrative sanctions may be imposed if non-compliance or lack of cooperation is found, including potential service access termination for Grok AI and platform X.

The ministry also emphasized that under Law No. 1 of 2023 on the Criminal Code, which came into effect on 2 January 2026, pornography offenses are regulated under Articles 172 and 407, with penalties ranging from a minimum of six months to a maximum of ten years in prison or fines as stipulated.

Alexander added that victims of photo manipulation, explicit deepfakes, or image rights violations may seek legal remedies through law enforcement and submit complaints to Kemkomdigi.

“We urge all parties to use artificial intelligence responsibly. The digital space is not without law; there is privacy and the right to one’s image that must be respected and protected,” he said.

PHOTO: UNSPLASH

This article was created with AI assistance.