X says Grok will now not edit photographs of actual individuals into bikinis

X says it’s altering its insurance policies round Grok’s image-editing talents following a multi-week outcry over the chatbot repeatedly being accused of producing sexualized photographs of youngsters and nonconsensual nudity. In an replace shared from the @Security account on X, the corporate stated it has “carried out technological measures to stop the Grok account from permitting the enhancing of photographs of actual individuals in revealing clothes akin to bikinis.”

The brand new safeguards, in keeping with X, will apply to all customers no matter whether or not they pay for Grok. xAI can be transferring all of Grok’s image-generating options behind its subscriber paywall in order that non-paying customers will now not be capable to create photographs. And it’ll geoblock “the flexibility of all customers to generate photographs of actual individuals in bikinis, underwear, and related apparel by way of the Grok account and in Grok in X” in areas the place it is unlawful.

The corporate’s assertion comes hours after the state of California opened an investigation into xAI and Grok over its dealing with of AI-generated nudity and little one exploitation materials. An announcement from California Lawyer Normal Rob Bonta cited one evaluation that discovered “greater than half of the 20,000 photographs generated by xAI between Christmas and New Years depicted individuals in minimal clothes,” together with some that seemed to be kids.

In its replace, X stated that it has “zero tolerance” for little one exploitation and that it removes “high-priority violative content material, together with Youngster Sexual Abuse Materials (CSAM) and non-consensual nudity” from its platform. Earlier within the day, Elon Musk said he was “not conscious of any bare underage photographs generated by Grok.” He later added that when its NSFW setting is enabled, “Grok is meant [sic] enable higher physique nudity of imaginary grownup people (not actual ones) in keeping with what may be seen in R-rated films on Apple TV.” He added that “this may fluctuate in different areas” primarily based on native legal guidelines.

Malaysia and Indonesia each just lately moved to block Grok citing security considerations and its dealing with of sexually express AI-generated materials. Within the UK, the place regulator Ofcom is also investigating xAI and Grok, officers have additionally stated they’d again the same block of the chatbot.

Have a tip for Karissa? You’ll be able to attain her by email, on X, Bluesky, Threads, or ship a message to @karissabe.51 to speak confidentially on Sign.