X, the platform owned by Elon Musk, is implementing measures to prevent its AI chatbot, Grok, from generating sexualized images of individuals, following widespread criticism and multiple investigations into the feature’s misuse.
Grok Image Generation Restrictions
X announced it will “geoblock the ability” of all Grok and X users to create images of people in “bikinis, underwear, and similar attire” in jurisdictions where such actions are illegal. The company’s safety team stated that technological measures have been implemented to prevent the editing of images of real people in revealing clothing.
The announcement comes after California’s attorney general launched an investigation into xAI, the developer of Grok, regarding the generation of “non-consensual, sexually explicit material.” International pressure had been mounting to address the creation of sexualized deepfakes of women and children through the platform.
Investigations and Calls for Action
Irish authorities are also responding to the issue. Gardaí have 200 active investigations into child sexual abuse-related images generated by Grok, according to Detective Chief Superintendent Barry Walsh of the Garda National Cyber Crime Bureau. Government ministers are scheduled to meet next week to discuss combating AI-generated and child sexual abuse-related content.
Minister for State with responsibility for AI, Niamh Smyth, stated that Grok should be banned in Ireland if X fails to comply with Irish law concerning the creation of sexualized images. Labour TD and Chair of the Oireachtas Media Committee, Alan Kelly, invited X to appear before the committee on February 4th, deeming their attendance “unacceptable” if they decline.
Kelly emphasized the need for legislative measures to prevent the sexualization of children and adults on these platforms, stating that “moderation does not work” and that AI tools should not be permitted to generate such content.
Criticism of X’s Response
Michael Moran, CEO of Irish Internet Hotline Hotline.ie, welcomed the changes but criticized X for failing to foresee the potential for misuse. He stated that the organization “could have foreseen” these issues and that praising them for the current changes is “not acceptable.”
Moran highlighted the ongoing issue of unregulated AI engines capable of generating harmful content, even as larger companies like X moderate their platforms. He described X’s changes as “a win for the regulators,” specifically Coimisiún na Meán.
Legal Landscape and International Response
Currently, the sharing of images of people in a state of undress is illegal in Ireland, but the generation of such content is not. Moran suggested banning apps that produce these images or making the generation of such content illegal, and also called for making the production of Child Sexual Abuse Material (CSAM) by AI illegal.
Britain’s Ofcom media regulator has launched a probe into X’s compliance with UK law, while France’s commissioner for children has referred Grok’s generated images to French prosecutors and the European Union. Indonesia and Malaysia have blocked access to Grok entirely. India reported that X removed thousands of posts and hundreds of user accounts in response to their complaints.
Discover more from Archyworldys
Subscribe to get the latest posts sent to your email.
