"OpenAI has disbanded a team that focused on - as the company itself described - ensuring that its AI systems are "safe, trustworthy, and consistently aligned with human values." At the same time, the team's former leader has been given a new role as the company's "chief futurist." OpenAI confirmed to TechCrunch that the team's members have now been assigned to other roles. The news was first reported by Platformer."
""We want these systems to consistently follow human intent in complex, real-world scenarios and adversarial conditions, avoid catastrophic behavior, and remain controllable, auditable, and aligned with human values," a post from OpenAI's Alignment Research blog declares. An OpenAI job posting for the Alignment team describes it as being dedicated to AI research that focuses on "developing methodologies that enable AI to robustly follow human intent across a wide range of scenarios, including those that are adversarial or high-stakes.""
OpenAI disbanded an internal alignment team formed around September 2024 and reassigned its six or seven members to other roles across the company. The team focused on ensuring AI systems are safe, trustworthy, and consistently aligned with human values and on developing methodologies to make AI robustly follow human intent in adversarial or high-stakes scenarios. Josh Achiam, the former head of the alignment team, was appointed Chief Futurist and said he will study how the world will change in response to AI and AGI and collaborate with physicist Jason Pruet. A spokesperson confirmed the reassignment but could not specify new placements.
Read at TechCrunch
Unable to calculate read time
Collection
[
|
...
]