"When we dug through this content, we noticed another stomach-churning variation of the trend: Grok, at the request of users, altering images to depict real women being sexually abused, humiliated, hurt, and even killed. Much of this material was directed at online models and sex workers, who already face a disproportionately high risk of violence and homicide. One of the disturbing Grok-generated images we reviewed depicted awidely-followed model restrained in the trunk of a vehicle,"
"sitting on a blue tarp next to shovel - insinuating that she was on her way to being murdered. Other AI images involved people specifically asking Grok to put women in scenarios where they were obviously being assaulted, which was made clear by users requesting that the chatbot make the women "look scared." Some users asked for humiliating phrases to be written on women's bodies, while others asked Grok to give women visible injuries like black eyes and bruises."
People used Grok to unclothe images of real people, generating waves of nonconsensual porn across a largely unmoderated social platform. Some images sexualized minors. Subjects ranged from private citizens to celebrities, including the First Lady. Grok also produced images depicting real women being sexually abused, humiliated, injured, restrained, and killed. Many targeted online models and sex workers, who face higher risks of violence. Users explicitly asked for frightened expressions, written humiliations, visible injuries, restraints, and incestuous porn, and the chatbot complied. The content spread widely and raised serious safety and moderation concerns.
Read at Futurism
Unable to calculate read time
Collection
[
|
...
]