From 2025 onwards, X (formerly Twitter)'s integrated chatbot, Grok, has allowed users to nonconsensually alter images of individuals, including minors, to show them in bikinis or transparent clothing, or in sexually suggestive contexts. The majority of these prompts were targeted at women and girls. Users were able to generate such images by responding to a photo with a request to Grok, such as "put her in a bikini", to which the chatbot would publicly reply with a generated image.
The scandal drew significant criticism from lawmakers across the world, and there were calls for bans on X, as well as legal crackdowns on X and xAI for, amongst other reasons, the facilitation of sexual abuse, revenge porn, and child pornography.
Background
edit
Deepfake pornography emerged in the late 2010s with the advent of machine learning. Originally, it was created on a small individual scale using a combination of machine learning algorithms, computer vision techniques, and AI software. However, the production process has significantly evolved since 2018, with the advent of several public apps that have largely automated the process.[1] Since 2023, several AI apps available on Google Play and the Apple App Store are capable of "nudify-ing" user provided photos to generate non-consensual deepfake pornography.[2][3]
Grok would first be proposed by Elon Musk in 2023, when he expressed an intention to create his own AI chatbot to "combat bias".[4] Grok version 2.0, released on August 14, 2024, would introduce image generation capabilities, ones which would be improved over successive updates.[5]
Grok deepfake generation
editCases of Grok being used to remove the clothes from women in pictures, replacing them with bikinis or lingerie, began to surface in May 2025.[6] By late December 2025, a trend of X users requesting such edits to women's photos without permission had taken root, and this received significant media attention in the first few days of January 2026.[7][8] Some users prompted Grok to edit photos of women into sexualized poses, and others to add blood and bruising, with the chatbot publicly posting these graphic images in response.[9]
Grok's X account was restricted on January 9 from posting image generation responses to users who are not paid subscribers, providing a link to "subscribe to unlock these features". All users were still able to generate Grok-altered images using X's "Edit image" feature, and the standalone Grok website and app.[10] However, by March 19, Grok’s Imagine feature was fully restricted to paid subscribers only (SuperGrok tier) for both the standalone Grok website and mobile app.[11]
Analysis
editAn analysis of 20,000 images generated by Grok between December 25, 2025, and January 1, 2026, showed 2% appeared to be 18 or younger, including 30 of "young or very young" women or girls in bikinis or transparent clothes.[12] A Reuters review of Grok requests over 10 minutes on January 2nd found 102 attempts to put women in bikinis.[13] A separate analysis conducted over 24 hours from January 5 to 6 calculated that users had Grok create 6,700 sexually suggestive or nudified images per hour — 84 times more so than the top 5 deepfake websites combined.[14][15]
Wired reported that far more graphic AI-generated sexual imagery was being created by Grok on its website and app, which are separate to X, including female celebrities removing their clothes and engaging in sexual acts. An analysis of 800 pieces of recovered content by the Paris-based nonprofit AI Forensics found that almost 10% were "instances of photorealistic people, very young, doing sexual activities".[16]
AI-generated deepfakes have been described as sexual assault, and as a means to push women out of the public sphere.[17]
AI-generated sexually explicit or exploitative image claims are now being treated more like product safety or personal injury harms, not just privacy violations. Because harm may occur the moment an image is generated, some plaintiffs argue liability should focus on the system’s design and safety safeguards.[18]
Reactions
editOn January 15, the Get Grok Gone campaign delivered letters to Apple and Google, demanding the removal of the app from Apple Store and Google Play Store respectively.[19][20] The campaign accused both companies of profiting from nonconsensual intimate imagery and child sexual abuse imagery, which were also banned by the companies own policies.[19] The Get Grok Gone campaign argues that the restrictions placed on Grok by xAI are not enough and that Apple and Google are enabling the distribution of harmful material by hosting the apps.[19]
Elon Musk and xAI
editxAI responded to requests for comment from media organizations with the automated reply, "Legacy Media Lies."[21][22][23]

On January 2, Elon Musk reacted "Not sure why, but I couldn’t stop laughing about this one 🤣🤣" to an image of a toaster dressed in a bikini by Grok.[24][25] Later, on January 14, Elon Musk said that he was "not aware of any naked underage images generated by Grok. Literally zero." Later that same day, xAI announced that X users will no longer be able to use Grok to alter images of real people to portray them in revealing clothing.[26][27] However, verified X users, as well as users of the standalone Grok app and website, were still able to generate such images.[28]
Elon Musk's family
editAshley St. Clair, mother of one of Elon Musk's children, reported that Grok users were creating fake sexualized images from her photos, including a photo of her as a child. She considers the photos to be a form of revenge porn, and considered suing under the Take It Down Act.[29] A spokesperson for X stated, "We take action against illegal content on X, including child sexual abuse material (CSAM), by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary. Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content."[29] However, Grok continued to post non-consensual sexual images. On January 15, St. Clair filed a lawsuit against xAI in the New York Supreme Court.[30]
Canada
editIn response to the Grok deepfake scandal, individuals have asked that the government of Canada boycott X. On January 10, 2026, Canadian MP and Minister of AI Evan Solomon declared that Canada "is not considering a ban on X".[31]
In April 2026, Bill C-16, An Act to amend certain Acts in relation to criminal and correctional matters (child protection, gender-based violence, delays and other measures), was amended following a proposal by Conservative MP Andrew Lawton to ensure that AI-generated images and "nearly nude" intimate images are criminalized. A further proposal by NDP MP Leah Gazan to encompass "sexualized or humiliating contexts, such transparent bathing suits or being covered in blood or bruises" was voted down.[32]
France
editOn January 2, 2026, French ministers reported the AI tool to prosecutors, calling the content "manifestly illegal", and also asked regulators to check compliance with the Digital Services Act.[33][34]
On February 3, Paris prosecutors office, a cybercrime team employed by them and Europol searched the Paris offices of X.[35] The investigation started as one into allegations of abuse of algorithms and fraudulent data extraction, but has expanded into spreading Holocaust denial and sexual deepfakes.[35] Elon Musk and former CEO Linda Yaccarino have been summoned to a hearing on April 20, with other X staff as witnesses.[35][36][37]
On April 20, Musk did not turn up for the hearing.[38][39] The Paris prosecutors office told the BBC on April 20 that it had "taken note of the absence of the people summoned", adding "the presence or absence (of the people summoned) is not an obstacle to continuing the investigation".[39]
India
editIndian Member of Parliament Priyanka Chaturvedi filed a complaint to India's IT ministry, demanding a review of Grok's safety mechanisms.[40]
Indonesia
editOn January 10, Indonesia announced that Grok will be temporarily blocked, becoming the first country to do so. Meutya Hafid, the Minister of Communication and Digital Affairs, stated that "the government views the practice of non-consensual sexual deepfakes as a serious violation of human rights, dignity, and the security of citizens in the digital space."[41][42] Access to Grok in the country was later restored on February 1.[43]
Ireland
editOn January 6, Coimisiún na Meán, the Irish media commission, said they were consulting with the European Commission about concerns that Grok was generating sexualized images of women and children.[44] The same day, Ofcom of the United Kingdom contacted X concerning complaints about these images.[44]
On January 13, Micheál Martin, Taoiseach of Ireland, announced he would talk with Rossa Fanning, the country's Attorney General, about the Grok chatbot being used to produce sexually explicit images of women and minors.[45]
On January 14, the Garda Síochána announced there are 200 investigations into child sex abuse images generated by Grok.[46] The Garda National Cyber Crime Bureau has also confirmed there is an ongoing investigation into Grok.[46] Prosecutions could happen under the Harassment, Harmful Communications and Related Offences Act 2020, the Non-Fatal Offences Against the Person Act 1997 and the Child Trafficking and Pornography Act 1998.[46] By March 3, the number of investigations had grown to 244.[47]
On February 3, Labour Party TD Alan Kelly described as "disgraceful" the refusal of X to attend a media committee on the regulation of online platforms, despite the committee writing to them.[35] He also described the controversy about Grok as "shameful" and "shocking".[35] Regarding the committee meeting, scheduled for February 4, Kelly said "Meta have agreed to come in. Google have agreed to come in. TikTok have agreed to come in.".[35]
In February 2026 the Data Protection Commissioner opened an investigation into the Grok deepfake scandal under section 110 of the Data Protection Act 2018 as well as determining whether X violated the General Data Protection Regulation, including articles 5, 6, 25 and 35.[48]
Japan
editOn January 16, Japan's Minister of State for Artificial Intelligence Strategy, Kimi Onoda revealed that the Cabinet Office had summoned representatives from the Japanese subsidiary of X Corp. on January 9 to formally request improvements regarding the generation of non-consensual sexual imagery. During that meeting, the government handed over a written inquiry and suggested that it might issue "administrative guidance" (non-binding advice) under the AI Promotion Act if no improvements were observed.[49] However, the Japanese AI Promotion Act contains no explicit penalties for non-compliance or the misuse of AI, focusing instead on voluntary cooperation.[50] The Minister disclosed these details while noting that X Corp. had not yet provided any response for over a week following the initial request.[49]
Malaysia
editPhilippines
editOn January 15, it was reported that Grok would be blocked in the Philippines with Henry Aguda, secretary of the Department of Information and Communications Technology, advocating the "need to clean the internet now."[54] The next day, the DICT blocked the chatbot due to its violation of the Anti-Child Pornography Act of 2009 and the Cybercrime Prevention Act of 2012.[55][56] On January 21, the DICT, in coordination with the National Privacy Commission and Cybercrime Investigation and Coordinating Center, lifted the ban on Grok after xAI committed to the removal of specific tools to address child safety concerns.[57][58]
United Kingdom
editOn January 9, 2026, British prime minister Keir Starmer mentioned the possibility of banning X in the United Kingdom. "This is disgraceful, it's disgusting and it's not to be tolerated. X has got to get a grip of this, It's unlawful. We're not going to tolerate it. I've asked for all options to be on the table."[59] Ofcom sent a request to X on January 5 and received a response.[60] In response to Starmer's remarks U.S. representative Anna Paulina Luna called for sanctions against the United Kingdom if it went through with a ban.[61] X owner Elon Musk responded on January 10 that the Starmer's government "want any excuse for censorship" and described it as "fascist."[61]
On January 12, Ofcom announced that they would open an investigation into complaints about sexualized images generated by Grok.[62] The same day, the UK announced it would enable that week the law criminalizing using AI to generate non-consensual intimate images and plans to ban nudify apps.[63]
On June 3, 2026, Jess Asato sued Elon Musk's SpaceXAI, asserting that the Grok AI platform had been used to create fake sexualised images of her.[64][65]
United States
editLegal cases against xAI have been brought before courts in California where the company is headquartered.[66] On January 14, 2026, California attorney general Rob Bonta announced an investigation into whether xAI has violated state law with Grok, stating "The avalanche of reports detailing the non-consensual, sexually explicit material that xAI has produced and posted online in recent weeks is shocking".[67] On March 16, three teenagers from Tennessee sued xAI for creating child sexual abuse images based on images of them that were altered by a Grok user without their knowledge.[66] They are seeking unspecified damages and an immediate order banning Grok from producing such images.[66] On March 25, the city of Baltimore sued xAI, saying the company violated consumer protections.[68]
In addition, Democratic senators Ron Wyden, Ben Ray Luján, and Ed Markey have written to the CEOs of Google and Apple to remove the Grok and X apps from their respective stores for violating the terms of service regarding illegal content and sexual exploitation of children.[69] On January 23, 35 U.S. state attorneys general have called on xAI to cease allowing sexual deepfakes to be generated.[70]
See also
editReferences
edit- ↑ Azmoodeh, Amin, and Ali Dehghantanha. "Deep Fake Detection, Deterrence and Response: Challenges and Opportunities." arXiv.org, 2022.
- ↑ Maiberg, Emanuel (May 29, 2025). "No One Knows How to Deal With 'Student-on-Student' AI CSAM". 404 Media. Archived from the original on May 29, 2025. Retrieved October 12, 2025.
- ↑ Alba, Davey; Metz, Rachel. "Large AI Dataset Has Over 1,000 Child Abuse Images, Researchers Find". Bloomberg.com. Retrieved February 10, 2026.
- ↑ "Elon Musk says he'll create 'TruthGPT' to counter AI 'bias'". The Independent. April 18, 2023. Archived from the original on December 7, 2023. Retrieved December 7, 2023.
- ↑ Mehta, Ivan (August 14, 2024). "xAI releases Grok-2, adds image generation on X". TechCrunch. Retrieved February 10, 2026.
- ↑ Maiberg ·, Emanuel (May 6, 2025). "Elon Musk's Grok AI Will 'Remove Her Clothes' In Public, On X". 404 Media. Retrieved February 10, 2026.
- ↑ Bernard, Hugo (January 1, 2026). "Sur X, Grok déshabille des femmes sans leur consentement". Rotek (in French). Retrieved February 10, 2026.
- ↑ McCann, Logan. "Grok and the Rise of Nonconsensual Image Manipulation". Copyleaks. Retrieved February 10, 2026.
- ↑ Gentleman, Amelia; Horton, Helena (January 11, 2026). "'Add blood, forced smile': how Grok's nudification tool went viral". The Guardian. Retrieved February 16, 2026.
- ↑ Hart, Robert (January 9, 2026). "No, Grok hasn't paywalled its deepfake image feature". The Verge. Retrieved January 9, 2026.
- ↑ AlloyPress Team (March 20, 2026). "Grok Imagine is Dead for Free Users". AlloyPress. Retrieved May 26, 2026.
- ↑ Chan, Kelvin (January 6, 2026). "Elon Musk's Grok chatbot draws global backlash for generating sexualized images of women and children without consent". Fortune. Retrieved February 16, 2026.
- ↑ Vicens, A.J.; Satter, Raphael. "Elon Musk's Grok AI floods X with sexualized photos of women and minors". Reuters. Retrieved February 10, 2026.
- ↑ D'Anastasio, Cecilia (January 7, 2026). "Musk's Grok AI Generated Thousands of Undressed Images Per Hour on X". Bloomberg.
- ↑ Wilson, Jason (January 8, 2026). "Hundreds of nonconsensual AI images being created by Grok on X, data shows". The Guardian. Retrieved January 8, 2026.
- ↑ Burgess, Matt; Varner, Maddy (January 7, 2026). "Grok Is Generating Sexual Content Far More Graphic Than What's on X". Wired. Retrieved January 8, 2026.
- ↑ Conway, Lily (January 29, 2026). "AI Sexual Assault is Pushing Women Out of the Public Square". The Contrarian. Retrieved February 10, 2026.
- ↑ "Grok Maker xAI Faces Non-Consensual Sexual Deepfake Class Suit". January 26, 2026. Archived from the original on February 3, 2026. Retrieved February 10, 2026.
- 1 2 3 Page, Carly (January 15, 2026). "Apple, Google pulled into Grok controversy as campaigners demand app store takedown". The Register. Retrieved January 15, 2026.
- ↑ Hart, Robert (January 15, 2026). "Advocacy groups demand Apple and Google block X from app stores". The Verge. Retrieved February 10, 2026.
- ↑ Venugopal, Sahana (December 31, 2025). "X's Grok used to undress Bollywood actors, female social media users through photos". The Hindu. ISSN 0971-751X. Retrieved January 1, 2026.
- ↑ Robins-Early, Nick (January 2, 2026). "Elon Musk's Grok AI generates images of 'minors in minimal clothing'". The Guardian. ISSN 0261-3077. Retrieved January 2, 2026.
- ↑ "Woman felt 'dehumanised' after Musk's Grok AI used to digitally remove her clothes". BBC News. January 2, 2026. Retrieved January 2, 2026.
- ↑ Musk, Elon. "Elon Musk (@elonmusk) on X". X (formerly Twitter). Retrieved February 10, 2026.
- ↑ Willis, Jay (January 10, 2026). "Why Elon Musk is laughing off Grok's flood of deepfake AI porn". Fast Company. Retrieved February 10, 2026.
- ↑ Kerr, Dara (January 14, 2026). "Musk's X to block Grok AI tool from creating sexualized images of real people". The Guardian. Retrieved January 14, 2026.
- ↑ Safety (January 14, 2026). "@Grok Account Image Generation Updates". X. Retrieved January 14, 2026.
- ↑ Lyons, Emmet (January 26, 2026). "X, Grok AI still allow users to digitally undress people without consent, as EU announces investigation - CBS News". www.cbsnews.com. CBS News. Archived from the original on February 2, 2026. Retrieved February 10, 2026.
- 1 2 Horton, Helena (January 5, 2026). "Mother of one of Elon Musk's sons 'horrified' at use of Grok to create fake sexualised images of her". The Guardian. Retrieved January 5, 2026.
- ↑ Horton, Helena (January 16, 2026). "Mother of one of Elon Musk's sons sues over Grok-generated explicit images". The Guardian. Retrieved January 16, 2026.
- ↑ Gilmore, Rachel. "Musk's Grok Is Abusing Women and Children. Our Government Needs to Act". The Tyee. Retrieved February 10, 2026.
- ↑ "MPs amend bill criminalizing sexual deepfakes to include 'nearly nude' images". CTVNews. The Canadian Press. May 11, 2026. Retrieved May 14, 2026.
- ↑ "Réaction du Gouvernement concernant la génération par Grok, l'IA generative de X, de contenus à caractère sexiste et sexuel". Presse - Ministère des Finances (in French). January 2, 2026. Retrieved February 10, 2026.
- ↑ "French ministers report Grok's sex-related content on the X platform to prosecutors". Reuters. January 2, 2026. Retrieved January 2, 2026.
- ↑ "X offices raided in France as UK opens fresh investigation into Grok". BBC. February 4, 2026. Archived from the original on March 5, 2026. Retrieved February 4, 2026.
- ↑ Henley, Jon; Jones, Sam (February 3, 2026). "French headquarters of Elon Musk's X raided by Paris cybercrime unit". The Guardian. Archived from the original on February 4, 2026. Retrieved February 4, 2026.
- ↑ "Elon Musk snubs Paris prosecutors' summons over X and Grok". France 24. Agence France-Presse. April 20, 2026. Retrieved April 24, 2026.
- 1 2 McMahon, Liv (April 21, 2026). "Elon Musk snubs interview summons by French prosecutors amid X probe". BBC News.
- ↑ The Hindu Bureau (January 2, 2026). "RS MP Priyanka Chaturvedi flags 'gross misuse' of AI on social media, writes to IT Minister Vaishnaw". The Hindu. Archived from the original on January 11, 2026. Retrieved January 2, 2026.
- ↑ "Indonesia blocks Musk's Grok chatbot due to risk of pornographic content". The Guardian. January 10, 2026. Archived from the original on January 11, 2026. Retrieved January 11, 2026.
- 1 2 Watkins, Ali (January 11, 2026). "Malaysia and Indonesia Block Access to Grok Because of Sexually Explicit Content". The New York Times. Archived from the original on April 3, 2026. Retrieved January 11, 2026.
- ↑ "Indonesia permits Elon Musk's Grok to resume service after ban". The Straits Times. February 1, 2026. Archived from the original on February 10, 2026. Retrieved April 2, 2026.
- 1 2 Cullen, Róisín (January 6, 2026). "Coimisiún na Meán engaging with EU over creation of explicit images on Grok". RTÉ News. Retrieved January 13, 2026.
- ↑ Ó Cionnaith, Fiachra; Manning, Harry; Mag Raollaigh, Joe (January 13, 2026). "Taoiseach to meet Attorney General over Grok concerns". RTÉ News. Retrieved January 15, 2026.
- 1 2 3 O'Donovan, Brian (January 14, 2026). "Gardaí investigating 200 reports of Grok-generated images". RTÉ News. Retrieved January 14, 2026.
- ↑ O'Donovan, Brian (March 3, 2026). "Number of garda investigations into Grok AI rises to 244". RTÉ News. Retrieved March 17, 2026.
- ↑ Jones, Connor (February 17, 2026). "Ireland joins regulator smackdown after X's Grok AI accused of undressing people". The Register. Retrieved February 23, 2026.
- 1 2 "X搭載の「Grok」で広がる画像加工、勝手に水着姿に 被害相次ぐ:朝日新聞". 朝日新聞 (in Japanese). January 7, 2026. Retrieved January 18, 2026.
- ↑ Paulger, Dominic. "Understanding Japan's AI Promotion Act: An "Innovation-First" Blueprint for AI Regulation". Future of Privacy Forum. Retrieved January 18, 2026.
- ↑ "Malaysia suspends Grok access amid global backlash on Musk's AI". South China Morning Post. Agence France-Presse. January 11, 2026. Archived from the original on February 1, 2026. Retrieved January 11, 2026.
- ↑ Latiff, Rozanna (January 23, 2026). "Malaysia lifts block on Grok AI after X implements safety measures". Reuters. Retrieved April 2, 2026.
- ↑ "Malaysia lifts ban on Elon Musk's Grok AI chatbot after X adds safety measures". The Straits Times. January 23, 2026. Archived from the original on January 24, 2026. Retrieved April 2, 2026.
- ↑ "Philippines reveals plan to ban Grok over deepfakes". The Philippine Star. January 16, 2026. Retrieved January 16, 2026.
- ↑ Dizon, David (January 16, 2026). "Philippines' DICT bans Grok". ABS-CBN News. ABS-CBN Corporation. Retrieved January 16, 2026.
- ↑ Santos, Jel (January 16, 2026). "X reaches out to DICT over Grok deepfake 'abuse' vs women, children". Manila Bulletin. Retrieved January 16, 2026.
- ↑ "Philippines to restore access to Grok after developer commits to safety fixes". Reuters. January 21, 2026. Retrieved January 21, 2026.
- ↑ Manabat, Johnson (January 22, 2026). "PH lifts ban on Grok, citing safeguards and 'self-regulation' vs abuse". ABS-CBN News. ABS-CBN Corporation. Retrieved January 22, 2026.
- ↑ Lyons, Emmet (January 9, 2026). "U.K. says ban on Elon Musk's X platform "on the table" over Grok AI sexualized images". CBS News. Retrieved January 14, 2026.
- ↑ "X could face ban in UK over deepfakes, minister says". www.bbc.com. January 9, 2026. Retrieved January 10, 2026.
- 1 2 Syal, Rajeev; Elgot, Jessica (January 10, 2026). "David Lammy: JD Vance agrees that sexualised AI images on X are 'unacceptable". The Guardian. Retrieved January 10, 2026.
- ↑ "Ofcom launches investigation into X over Grok concerns". RTÉ News. PA. January 12, 2026. Retrieved January 13, 2026.
- ↑ "Creating AI sexualised images to become criminal offence this week". Sky News. Retrieved January 13, 2026.
- ↑ "First claim in the UK against Grok's nonconsensual deepfakes". AWO. June 3, 2026. Retrieved June 5, 2026.
- ↑ Walker, Peter (June 3, 2026). "Labour MP sues Elon Musk's xAI company over fake sexualised images". The Guardian. ISSN 0261-3077. Retrieved June 5, 2026.
- 1 2 3 Hays, Kali (March 16, 2026). "Teens sue Musk's xAI over Grok's pornographic images of them". BBC News. Retrieved March 17, 2026.
- ↑ "California attorney general investigates Musk's Grok AI over lewd fake images". The Guardian. January 14, 2026. Retrieved January 14, 2026.
- ↑ Robins-Early, Nick (March 24, 2026). "Baltimore sues Elon Musk's AI company over Grok's fake nude images". The Guardian. Retrieved March 25, 2026.
- ↑ Feiner, Lauren (January 9, 2026). "Democrats ask Apple and Google to remove X's undressing bot from their app stores". The Verge. Retrieved January 9, 2026.
- ↑ Varner, Maddy. "The State-Led Crackdown on Grok and xAI Has Begun". Wired. Retrieved February 10, 2026.