While LLMs continue to devour web-scraped data, they’ll increasingly consume their own digital progeny as AI-generated content continues to flood the internet. This recursive loop, experimentally confirmed, erodes the true data landscape. Rare events vanish first. Models churn out likely sequences from the original pool while injecting their own un... See more

As the internet evolves, especially for us “very online people,” there’s a deepening sense that we are, together, becoming something beyond the scope of our original intentions. We are rapidly approaching a sum far greater and more mysterious than what we often perceive as its cold, mechanistic parts.

While we conventionally think of ourselves as “u... See more