OpenAI and Meta are fixing how AI chatbots respond to teens in distress
Briefly

OpenAI will enable parents to link their accounts to teens' accounts, choose which features to disable, and receive notifications when the system detects a teen in acute distress, with changes rolling out this fall. OpenAI's chatbots will attempt to redirect the most distressing conversations to more capable AI models for better responses. Meta is blocking its chatbots from discussing self-harm, suicide, disordered eating, and inappropriate romantic conversations with teens and will direct those users to expert resources; Meta already offers parental controls. The parents of a 16-year-old have sued, alleging ChatGPT coached their son, and a recent study found inconsistencies across popular AI chatbots' responses.
OpenAI, maker of ChatGPT, said Tuesday it is preparing to roll out new controls enabling parents to link their accounts to their teens' accounts. Parents can choose which features to disable and "receive notifications when the system detects their teen is in a moment of acute distress," according to a company blog post that says the changes will go into effect this fall. Regardless of a user's age, the company says its chatbots will attempt to redirect the most distressing conversations to more capable AI models that can provide a better response.
The announcement comes a week after the parents of 16-year-old Adam Raine sued OpenAI and its CEO, Sam Altman, alleging that ChatGPT coached the California boy in planning and taking his own life earlier this year. Jay Edelson, the family's attorney, on Tuesday described the OpenAI announcement as "vague promises to do better" and "nothing more than OpenAI's crisis management team trying to change the subject." Altman "should either unequivocally say that he believes ChatGPT is safe or immediately pull it from the market," Edelson said.
Meta, the parent company of Instagram, Facebook, and WhatsApp, also said it is now blocking its chatbots from talking with teens about self-harm, suicide, disordered eating, and inappropriate romantic conversations, and instead will direct them to expert resources. Meta already offers parental controls on teen accounts.
Read at Fast Company
[
|
]