AI models like large language models fail to operate in continual learning settings, meaning they cannot assimilate new information without complete retraining.
The research shows that without complete retraining, the artificial neurons in deep learning models can lose their ability to learn due to plasticity loss.
According to lead author Shibhansh Dohare, losing 'plasticity' in AI is akin to having 90% of neurons dead, severely hindering learning capabilities.
Retraining advanced AI models can cost millions, creating significant financial hurdles for AI companies, especially as they strive towards artificial general intelligence.
Collection
[
|
...
]