If you're a teenager with access to OpenAI's Sora 2, you can easily generate AI videos of school shootings and other harmful and disturbing content - despite CEO Sam Altman's repeated claims that the company has instituted robust safeguards. The revelation comes from Ekō, a consumer watchdog group that just put out a report titled "Open AI's Sora 2: A new frontier for harm,"
No one - except maybe Sam Altman - loved Sora 2 as much as I did when it first launched. I spent so much time using it during the first few days that I was easily burning through my phone battery by 5 p.m. ( Tim Cook: Let's talk about that later.) And I was wasting huge chunks of my workday (To my editor: Let's not talk about that later) making silly videos of myself and my friends.
The group, called the Content Overseas Distribution Association (CODA), said that it had determined Sora 2 is able to generate outputs that "closely resembles Japanese content or images" because this content was used as training data. Therefore, in cases "where specific copyrighted works are reproduced or similarly generated as outputs," CODA said, it "considers that the act of replication during the machine learning process may constitute copyright infringement."
It's becoming increasingly clear that OpenAI put staggeringly little thought into the rollout of Sora 2, its latest text-to-video generating app, a "move fast and break things" approach that has resulted in plenty of drama. Last week, the Sam Altman-led company released the TikTok-style app that churns out endless feeds of low-rent and mind-numbing AI slop. It's an " unholy abomination" that intentionally encourages users to generate deepfakes of others,
For example, OpenAI said in a blog post that the model was trained to be less overly optimistic, a characteristic that can be observed in instances where a Sora-generated video shows the player missing the shot but still making it into the hoop. With Sora 2, OpenAI claims the player would miss the shot, and the ball would rebound off the backboard.
.jpg)
