
Superintelligence: Paths, Dangers, Strategies

The difficulty lies in trying to glimpse a future consciousness that far transcends our own, one that is not just cleverer than us but wiser too.
Geoff Mulgan • Another World Is Possible: How to Reignite Social and Political Imagination
We’re not even on the agency curve. It’s a different curve.
Look, I’m using knowledge and agency a little loosely. LLMs can do more than just regurgitate knowledge; even if you grant them reasoning, though, it still doesn’t feel like humanity emerges from LLM scaleup. They have no curiosity, and don’t ask their own questions.
Look, I’m using knowledge and agency a little loosely. LLMs can do more than just regurgitate knowledge; even if you grant them reasoning, though, it still doesn’t feel like humanity emerges from LLM scaleup. They have no curiosity, and don’t ask their own questions.
The Goldilocks Zone
The Myth of a Superhuman AI | Backchannel
wired.com
The more principled path forward, Samuel reasoned, was for the computer itself to somehow generate strategic considerations on its own.