I think the snake will eat its tail because it will be harder and harder to train on the new data, as they are already AI generated, and the model will collapse.

You already cannot train on YouTube data, for example, because it's now overwhelmed by AI slop.

We are not there yet though and we are still getting better at mining the pre-AI data.