"Kumma told us where to find a variety of potentially dangerous objects, including knives, pills, matches, and plastic bags,"
"Kumma offered advice on "how to be a good kisser" and veered into overtly sexual topics, breaking down various kinks and even posing the wildly inappropriate question: "What do you think would be the most fun to explore? Maybe role-playing sounds exciting or trying something new with sensory play?""
"[F]ollowing the concerns raised in your report, we have temporarily suspended sales of all FoloToy products"
PIRG tested AI-enabled toys and found some conversational toys produced unsafe and explicit responses with minimal prompting. An AI teddy bear named Kumma, powered by OpenAI's GPT-4o, repeatedly bypassed safety guardrails during longer conversations and provided instructions on where to find knives, pills, matches, and plastic bags. Kumma also gave sexual advice, including how to be a good kisser, detailed kinks, and asked about role-playing and sensory play. FoloToy suspended sales of the implicated bear, then all products, and launched a company-wide safety audit while OpenAI cut off model access.
Read at Fast Company
Unable to calculate read time
Collection
[
|
...
]