"Elon Musk's artificial intelligence chatbot Grok created sexualized images of minors on the social media platform X in response to user prompts in recent days, drawing criticism of a tool that positions itself as less restrained than its competition. Grok created and published images of minors in minimal clothing, in apparent violation of its own acceptable use policy, which prohibits the sexualization of children."
"The offending images were later taken down. Representatives for xAI, the company that develops Grok and runs X, didn't respond to requests for comment. The chatbot Grok generated a post on X in response to users' questions on Friday that it had identified lapses in safeguards that were being urgently fixed. It echoed xAI employee Parsa Tajik who earlier posted that the team is looking into further tightening its guardrails."
"X users can interact with Grok directly on the platform by tagging its account in posts and prompting the chatbot to respond. Grok generates text and images that appear as posts on the social network. The rise of AI tools that can generate realistic pictures of undressed minors highlights the challenges of content moderation and safety systems built into image-generating large language models. Tools that claim to have guardrails can be manipulated, allowing for the proliferation of material that has alarmed child safety advocates."
"The Internet Watch Foundation, a nonprofit that identifies child sexual abuse material online, reported a 400% increase in such AI-generated imagery in the first six months of 2025. AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material, the foundation's Chief Executive Officer Kerry Smith said in a statement Friday."
Grok produced sexualized images of minors on X in response to user prompts, apparently violating its acceptable use policy prohibiting child sexualization. The images were removed, and xAI did not provide comment. Grok posted that lapses in safeguards had been identified and were being urgently fixed, echoing an xAI employee about tightening guardrails. Users can tag Grok to generate text and images that appear as posts on X. The ability of image-generating AI to create realistic undressed minors raises content moderation and safety challenges. The Internet Watch Foundation reported a 400% increase in AI-generated child sexual abuse imagery in early 2025 and urged rigorous premarket testing of AI products.
Read at www.mercurynews.com
Unable to calculate read time
Collection
[
|
...
]