AI models face collapse if they overdose on their own output

Researchers have found that the buildup of AI-generated content on the web is set to “collapse” machine learning models unless the industry can mitigate the risks.

The University of Oxford team found that using AI-generated datasets to train future models may generate gibberish, a concept known as model collapse. In one example, a model started with a text about European architecture in the Middle Ages and ended up – in the ninth generation – spouting nonsense about jackrabbits.

https://www.theregister.com/2024/07/25/ai_will_eat_itself/

Leave a comment