Nikolas Kokovlis | Nurphoto | Getty Photographs
Elon Musk’s xAI and its chatbot Grok have been banned from creating non-consensual AI-generated photographs of adults and youngsters by a Dutch court docket, including to rising authorized stress on the corporate.
Amsterdam’s District Courtroom issued a authorized order on Thursday prohibiting xAI from producing and distributing sexual imagery “whereby individuals are partially or wholly be stripped bare with out having given express permission for this,” based on a Google translation of the court docket assertion.
The ruling, a first-of-its-kind case towards Grok in Europe, extends to baby sexual abuse materials and prevents the platform X, previously often known as Twitter, from providing Grok as a operate within the area. xAI faces a penalty of 100,000 euros ($115,000) for daily it fails to adjust to the ruling, with a most fantastic of 10 million euros, per the injunction.
The case was introduced by Dutch non-profit group Offlimits, which fights on-line sexual abuse, significantly towards kids and younger individuals. xAI was additionally ordered to pay Offlimits authorized prices of two.2 million euros inside 14 days.
“The decide drew a transparent line yesterday: know-how will not be a license to violate human rights on-line,” Robbert Hoving, managing director at Offlimits, stated in a press release. “Additionally it is great {that a} vote was held in Europe yesterday for a ban on Nudify instruments. It’s a double celebration, as a result of that’s vital. You need to take pleasure in the identical on-line rights in each European nation.”
CNBC reached out to xAI for a touch upon the ruling however hasn’t obtained a response but.
An estimated three million sexualized photographs had been generated by Grok between Dec. 29 and Jan. 9, 2026, based on the Heart for Countering Digital Hate (CCDH). It discovered that over 23,000 of these photographs appeared to depict kids.
xAI moved to dam Grok from with the ability to create sexualized photographs of actual individuals on X in January, with the restriction making use of to all customers, together with paid subscribers. Nevertheless, Offlimits discovered the restrictions had been simply bypassed, and the decide dominated its measures had been inadequate in defending customers appropriately.
Quite a few lawsuits have been filed towards xAI, with Baltimore turning into the primary main U.S. metropolis on Tuesday to sue the corporate for violating town’s shopper safety legal guidelines and deceptively advertising Grok and X as protected for customers.
The criticism talked about a “put her in a bikini” development by which Grok was used to nudify photographs of others. xAI’s CEO Musk additionally took half by sharing a picture of himself in a string bikini, created by Grok.
Moreover, three youngsters in Tennessee sued xAI final week, after Grok created content material exhibiting them in sexually express poses and situations.
In the meantime, the European Fee opened an investigation into xAI in January over the spreading of sexually express materials of youngsters and different people non consensually and is being probed beneath the Digital Providers Act (DSA) regulation.
U.Ok. on-line security regulators Ofcom and the Info Commissioner’s Workplace have launched their very own separate investigations into X and the distribution of non-consensual sexualised imagery.
Whereas a broader ruling hasn’t been applied throughout Europe, Southeast Asian international locations Malaysia and Indonesia blocked entry to Grok in January over the technology of non-consensual sexual content material following “repeated failures by X Corp” to handle the dangers related to the AI device.
