Pope Leo XIV issued his first encyclical, Magnifica Humanitas, urging AI to be disarmed and regulated for humanity. Christopher Olah, co-founder of Anthropic, said AI firms operate under incentives and constraints that can conflict with doing the right thing. Dario Amodei stated that the next tier of risk is AI companies themselves and that AI leaders should not decide the technology’s future. Industry risks named include labor disruption, autonomous weapons, child safety, mass surveillance, loss of human oversight, and recursive self-improvement. Anthropic’s Constitutional AI and Responsible Scaling Policy and OpenAI’s Preparedness Framework with structured red-teaming are internal and limited by company-set thresholds and transparency. Competitive dynamics and state incentives make unilateral restraint ineffective, especially if major powers like China are not similarly bound.
"On Monday, Pope Leo XIV published his first encyclical, Magnifica Humanitas, calling for AI to be disarmed and regulated in the service of humanity. Standing beside him at the Vatican was Christopher Olah, co-founder of Anthropic, who acknowledged that AI companies operate "inside a set of incentives and constraints that can sometimes conflict with doing the right thing.""
Read at Fortune
Unable to calculate read time
Collection
[
|
...
]