The European Commission has initiated an investigation into Elon Musk’s social media platform X, previously known as Twitter, in response to growing concerns about its AI tool, Grok. The investigation follows accusations that Grok was used to create sexually explicit deepfake images of real individuals. The inquiry is part of broader efforts by EU regulators to monitor the ethical and legal implications of AI technologies on social media platforms, especially when they involve manipulating images or creating harmful content.
The Growing Scrutiny of AI and Deepfakes
The European Commission’s investigation marks a significant escalation in the scrutiny of AI tools like Grok, which allows users to generate and manipulate images using artificial intelligence. Grok, which has gained significant attention for its image-editing capabilities, has come under fire for its ability to create manipulated images, including explicit and inappropriate content.
In January 2026, the UK’s communications regulator, Ofcom, also launched an investigation into Grok, citing similar concerns over the generation of sexualized images using the tool. This follows growing alarm from advocacy groups, who have expressed their outrage at the potential harm caused by AI-generated content, particularly in terms of deepfakes that manipulate real people’s likenesses without their consent.
X, in response to these concerns, issued a statement from its Safety account, clarifying that it had implemented measures to prevent Grok from altering images in jurisdictions where such content is illegal. However, despite these efforts, the company’s actions are now being reviewed by EU authorities to determine whether they meet the legal requirements set out in the Digital Services Act (DSA), a landmark piece of European legislation aimed at regulating harmful online content and ensuring that tech platforms uphold safety standards.
Potential Legal Repercussions for X
If the investigation finds that X violated the provisions of the Digital Services Act, the company could face significant penalties. Under the DSA, platforms found in breach of the rules could be fined up to 6% of their global annual turnover. This potential fine adds pressure on X to ensure that it is taking adequate measures to prevent harmful content from being generated and distributed on its platform.
Regina Doherty, a member of the European Parliament representing Ireland, emphasized the importance of holding platforms accountable. She stated, “We will assess whether manipulated sexually explicit images have been shown to users in the EU. It’s critical that platforms respect legal obligations and prevent illegal content from spreading.”
The investigation into X’s handling of Grok follows a pattern of increasing regulation in the tech industry. Last month, the European Commission imposed a €120 million fine on X for its handling of its blue verification badges. The Commission accused X of misleading users by failing to verify the identities of those who applied for the badges, highlighting growing concerns about transparency and accountability in social media practices.
AI-Generated Content: The Evolving Challenge
The controversy surrounding Grok is part of a broader challenge in the tech industry regarding the ethical implications of AI-generated content. AI tools like Grok, which can manipulate images, audio, and video, have raised alarms about their potential misuse. Deepfakes, in particular, have emerged as a serious concern, with the ability to create realistic but entirely fabricated content that can damage reputations, spread misinformation, and even contribute to harassment and abuse.
The use of AI to generate sexually explicit images, often targeting women and marginalized groups, has been widely criticized as an unacceptable form of degradation. Henna Virkkunen, Executive Vice-President for Tech Sovereignty, Security, and Democracy at the European Commission, described AI-generated sexual deepfakes as “violent, unacceptable forms of degradation.” She emphasized the importance of regulating AI technologies to protect individuals from the harm that such content can cause.
The debate over AI’s role in generating harmful content is not limited to Europe. Several investigations into X and its AI tool are underway in other countries, including Australia, France, and Germany. The platform has also faced bans in countries like Indonesia and Malaysia, with Indonesia briefly suspending Grok due to concerns over the tool’s potential misuse.
X’s Response: Musk’s Stand on Censorship
Elon Musk, who has been vocal in his criticism of regulatory efforts and content moderation on social media, responded to the EU investigation with characteristic defiance. On social media, Musk posted an image that appeared to mock the restrictions imposed on Grok, suggesting that the investigation was an overreaction. Musk has long been a critic of what he perceives as excessive censorship on social media platforms, particularly in relation to government oversight and the regulation of AI-generated content.
In the past, Musk has also voiced his frustration with government scrutiny of X, calling it “an attack on all American tech platforms.” His comments reflect broader concerns in the tech industry about the increasing influence of regulators, particularly in Europe, over how platforms operate and manage content.
Accountability and Transparency in AI Tools
While X has taken steps to address concerns over Grok’s potential for misuse, campaigners and experts argue that these efforts may not be enough. Andrea Simon, Director of the End Violence Against Women Coalition, stressed that tech companies should not be allowed to profit from online abuse and that governments must take stronger actions to hold platforms accountable. “Given the evolving nature of AI-generated harm, the accountability should not stop with platforms simply removing content,” she said.
Simon’s comments highlight the ongoing challenges in regulating AI tools and ensuring that platforms are held responsible for the impact of their technologies. As AI continues to advance, regulators will need to find ways to balance innovation with the protection of individuals’ rights and safety.
What’s Next for X and AI Regulation?
The European Commission’s investigation into X is still ongoing, with the outcome likely to have significant implications for the platform and its AI tools. The case underscores the growing tension between tech companies’ desire for innovation and the need for robust regulation to protect users from harm.
As AI technologies like Grok evolve, there will undoubtedly be more scrutiny from governments and regulators worldwide. The outcome of the EU investigation may set a precedent for how AI-generated content is regulated in the future, influencing how platforms like X and others manage AI tools and address concerns about their misuse.
X’s response to the investigation and any potential regulatory measures will be watched closely, not only by tech industry insiders but also by lawmakers and advocacy groups seeking to ensure that AI technologies are used responsibly and ethically.