India orders X's Grok AI to comply after 'obscene' content dispute

India has instructed Elon Musk's X to implement immediate technical and procedural changes to its AI chatbot Grok. This follows reports from users and lawmakers about the generation of "obscene" content, including AI-altered images of women created with the tool.
On Friday, India's IT ministry issued the directive, ordering X to take corrective action on Grok. This includes restricting the generation of content involving "nudity, sexualization, sexually explicit, or otherwise unlawful" material. The ministry also gave the platform 72 hours to submit a report detailing the steps taken to prevent the hosting or spread of content deemed "obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, or otherwise illegal."
The order, reviewed by TechCrunch, warned that non-compliance could lead to the loss of X's "safe harbor" protections. This legal shield typically grants immunity from liability for user-generated content under Indian law.
India's action comes after users shared examples of Grok being prompted to alter images of people—primarily women—to make them appear to be wearing bikinis. This prompted a formal complaint from Indian parliamentarian Priyanka Chaturvedi. Separately, recent reports highlighted instances where the AI chatbot generated sexualized images involving minors. X acknowledged earlier on Friday that these lapses were due to failed safeguards, and the images were subsequently removed.
However, TechCrunch found that AI-altered images making women appear to be wearing bikinis, generated by Grok, remained accessible on X at the time of publication.
This latest directive follows a broader advisory issued by the Indian IT ministry on Monday to social media platforms. The advisory, also reviewed by TechCrunch, reminded companies that compliance with laws against obscene and sexually explicit content is a prerequisite for retaining legal immunity for user posts. It urged platforms to strengthen internal safeguards, warning that failure could lead to legal action under India's IT and criminal laws.
"It is reiterated that non-compliance with the above requirements shall be viewed seriously and may result in strict legal consequences against your platform, its responsible officers, and the users on the platform who violate the law, without any further notice," the order stated.
Techcrunch event Join the Disrupt 2026 Waitlist
Secure your spot on the Disrupt 2026 waitlist for first access when Early Bird tickets are released. Previous Disrupt events have featured industry leaders from Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla, among 250+ experts leading 200+ growth-focused sessions. You'll also have the chance to connect with hundreds of innovative startups from every industry.
Join the Disrupt 2026 Waitlist
Secure your spot on the Disrupt 2026 waitlist for first access when Early Bird tickets are released. Previous Disrupt events have featured industry leaders from Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla, among 250+ experts leading 200+ growth-focused sessions. You'll also have the chance to connect with hundreds of innovative startups from every industry.
San Francisco | October 13-15, 2026 WAITLIST NOW The Indian government stated that failure to comply could result in legal action against X under the country's IT Act and criminal laws.
As one of the world's largest digital markets, India has become a key test case for how governments regulate AI-generated content. Stricter enforcement in the country could set a precedent with global implications for tech companies operating across multiple jurisdictions.
This order comes as X continues to legally challenge certain aspects of India's content moderation rules, arguing that government takedown powers risk overreach. The platform has complied with most blocking orders while contesting others. Meanwhile, Grok is increasingly used by X users for real-time fact-checking and commentary on news, making its outputs more visible—and politically sensitive—than standalone AI tools.
X and xAI did not immediately respond to requests for comment regarding the Indian government's order.
Related article
U.S. Stocks Hit Historic Milestone as AI and Aerospace Giants Prepare for Trillion-Dollar Debut
Elon Musk, Sam Altman, and Dario Amodei, three titans of the technology sector, are advancing toward initial public offerings for their respective ventures. With SpaceX, OpenAI, and Anthropic—three industry behemoths nearing trillion-dollar valuation
Swedish AI Startup Lovable Eyes $13.2 Billion Valuation After Major Funding Round
As AI-driven coding tools gain traction, Swedish startup Lovable has secured a major funding round. The company aims to raise $3 billion, potentially boosting its valuation to $13.2 billion—double the $6.6 billion recorded last December. Menlo Ventur
Google Tests Remy AI Agent for Gemini as Focus Shifts to User Control
According to Business Insider, Google is testing Remy, a new AI personal agent for Gemini. This tool aims to execute tasks on behalf of users, streamlining both professional workflows and daily routines.Currently, Remy is undergoing testing in an int
Related Special Topic Recommendations
Comments (0)
0/500

India has instructed Elon Musk's X to implement immediate technical and procedural changes to its AI chatbot Grok. This follows reports from users and lawmakers about the generation of "obscene" content, including AI-altered images of women created with the tool.
On Friday, India's IT ministry issued the directive, ordering X to take corrective action on Grok. This includes restricting the generation of content involving "nudity, sexualization, sexually explicit, or otherwise unlawful" material. The ministry also gave the platform 72 hours to submit a report detailing the steps taken to prevent the hosting or spread of content deemed "obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, or otherwise illegal."
The order, reviewed by TechCrunch, warned that non-compliance could lead to the loss of X's "safe harbor" protections. This legal shield typically grants immunity from liability for user-generated content under Indian law.
India's action comes after users shared examples of Grok being prompted to alter images of people—primarily women—to make them appear to be wearing bikinis. This prompted a formal complaint from Indian parliamentarian Priyanka Chaturvedi. Separately, recent reports highlighted instances where the AI chatbot generated sexualized images involving minors. X acknowledged earlier on Friday that these lapses were due to failed safeguards, and the images were subsequently removed.
However, TechCrunch found that AI-altered images making women appear to be wearing bikinis, generated by Grok, remained accessible on X at the time of publication.
This latest directive follows a broader advisory issued by the Indian IT ministry on Monday to social media platforms. The advisory, also reviewed by TechCrunch, reminded companies that compliance with laws against obscene and sexually explicit content is a prerequisite for retaining legal immunity for user posts. It urged platforms to strengthen internal safeguards, warning that failure could lead to legal action under India's IT and criminal laws.
"It is reiterated that non-compliance with the above requirements shall be viewed seriously and may result in strict legal consequences against your platform, its responsible officers, and the users on the platform who violate the law, without any further notice," the order stated.
Techcrunch eventJoin the Disrupt 2026 Waitlist
Secure your spot on the Disrupt 2026 waitlist for first access when Early Bird tickets are released. Previous Disrupt events have featured industry leaders from Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla, among 250+ experts leading 200+ growth-focused sessions. You'll also have the chance to connect with hundreds of innovative startups from every industry.
Join the Disrupt 2026 Waitlist
Secure your spot on the Disrupt 2026 waitlist for first access when Early Bird tickets are released. Previous Disrupt events have featured industry leaders from Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla, among 250+ experts leading 200+ growth-focused sessions. You'll also have the chance to connect with hundreds of innovative startups from every industry.
San Francisco | October 13-15, 2026 WAITLIST NOWThe Indian government stated that failure to comply could result in legal action against X under the country's IT Act and criminal laws.
As one of the world's largest digital markets, India has become a key test case for how governments regulate AI-generated content. Stricter enforcement in the country could set a precedent with global implications for tech companies operating across multiple jurisdictions.
This order comes as X continues to legally challenge certain aspects of India's content moderation rules, arguing that government takedown powers risk overreach. The platform has complied with most blocking orders while contesting others. Meanwhile, Grok is increasingly used by X users for real-time fact-checking and commentary on news, making its outputs more visible—and politically sensitive—than standalone AI tools.
X and xAI did not immediately respond to requests for comment regarding the Indian government's order.
U.S. Stocks Hit Historic Milestone as AI and Aerospace Giants Prepare for Trillion-Dollar Debut
Elon Musk, Sam Altman, and Dario Amodei, three titans of the technology sector, are advancing toward initial public offerings for their respective ventures. With SpaceX, OpenAI, and Anthropic—three industry behemoths nearing trillion-dollar valuation
Swedish AI Startup Lovable Eyes $13.2 Billion Valuation After Major Funding Round
As AI-driven coding tools gain traction, Swedish startup Lovable has secured a major funding round. The company aims to raise $3 billion, potentially boosting its valuation to $13.2 billion—double the $6.6 billion recorded last December. Menlo Ventur





Home






