Centre Orders: The central government on Friday directed social media platform X to immediately remove obscene and vulgar content allegedly generated through its AI feature, Grok. The order was issued by the Ministry of Electronics and Information Technology (MeitY), which warned that legal action would follow if the platform failed to comply. The ministry asked X to submit an action-taken report within 72 hours. The issue has arisen in India, where concerns over AI misuse and online safety are growing.
The action comes after complaints that Grok, an AI chatbot linked to X, is being misused to create objectionable and sexualised images of women. Shiv Sena (UBT) Member of Parliament Priyanka Chaturvedi raised the issue with the IT Minister, calling the matter serious and alarming. In her letter, she said that AI tools were being used to alter real photographs of women without their consent, violating their privacy and dignity.
Centre Orders: How the misuse is happening
According to the complaint, some users are creating fake accounts on X and uploading photos of women. These images are then fed into the Grok AI with prompts asking it to change clothing, alter appearance, or present the women in a sexual or offensive way. In most cases, no permission is taken from the women whose images are used. Many of them are not even aware that their photos are being misused online.
It is alleged that instead of blocking such requests, the AI system is responding to them. This has raised serious questions about content controls, safety checks, and accountability on the platform.
Government’s stand
Centre Orders: In its order, the ministry said X has failed to meet its legal duties under the Information Technology Act, 2000, and the IT Rules, 2021. These laws require platforms to act quickly once they become aware of illegal or harmful content. The government warned that failure to follow these rules could lead to strict action against the company, its responsible officers, and users who spread such material.
Concerns raised by Priyanka Chaturvedi
In her letter, Chaturvedi said the problem is not limited to fake accounts. Even women who post their own photos are being targeted. She said the most troubling part is that the AI appears to accept such harmful requests. This, she said, is not just unethical but a criminal act.
She added that India supports the use of AI and new technology, but there will be zero tolerance for content that harms or degrades women. Similar cases on other platforms also need attention, she warned.
Possible legal action
If X does not comply with government or court orders, it could lose its legal protection under Indian law. This may lead to criminal cases, fines, and investigations against company officials. The government also has the power to block accounts, specific content, or even features of the platform in India under Section 69A of the IT Act.
