The X platform announced the adoption of measures to prevent its artificial intelligence chatbot, Grok, from generating or editing images of real individuals with sexualized content, including the addition of underwear, swimwear, or simulated nudity. According to the company, the restrictions involve geofencing such functionalities in jurisdictions where they are deemed illegal and apply to all users, including paid subscribers.
The announcement follows investigations and reactions from authorities and regulators in multiple countries, including an inquiry initiated by the California Attorney General into the alleged facilitation of large-scale non-consensual intimate image manipulation involving women and children. Additional actions have been taken by governments and regulators, such as blocking access to Grok in parts of Southeast Asia and launching investigations in the United Kingdom and the European Union, intensifying regulatory scrutiny over the use of generative AI for unlawful content creation.