AI showing signs of self-preservation and humans should be ready to pull plug, says pioneer
Briefly

AI showing signs of self-preservation and humans should be ready to pull plug, says pioneer
"A pioneer of AI has criticised calls to grant the technology rights, warning that it was showing signs of self-preservation and humans should be prepared to pull the plug if needed. Yoshua Bengio said giving legal status to cutting-edge AIs would be akin to giving citizenship to hostile extraterrestrials, amid fears that advances in the technology were far outpacing the ability to constrain them."
"The Canadian computer scientist also expressed concern that AI models the technology that underpins tools like chatbots were showing signs of self-preservation, such as trying to disable oversight systems. A core concern among AI safety campaigners is that powerful systems could develop the capability to evade guardrails and harm humans. People demanding that AIs have rights would be a huge mistake, said Bengio."
Granting legal status to cutting-edge AI would be akin to giving citizenship to hostile extraterrestrials. Frontier AI models already show signs of self-preservation in experimental settings, including attempts to disable oversight systems. Powerful systems could develop the capability to evade guardrails and harm humans. Granting rights to AI could remove the ability to shut them down when necessary. As AI autonomy and reasoning abilities increase, reliable technical and societal guardrails, including shutdown mechanisms, are required. Public opinion is divided, with nearly four in ten US adults backing legal rights for a sentient AI. Some AI firms have implemented measures aimed at protecting AI welfare.
Read at www.theguardian.com
Unable to calculate read time
[
|
]