Sublime
An inspiration engine for ideas
The stages in this sequence correspond to whole brain emulations of successively more neurologically sophisticated model organisms—for example, C. elegans → honeybee → mouse → rhesus monkey → human. Because the gaps between these rungs—at least after the first step—are mostly quantitative in nature and due mainly (though not entirely) to the differ
... See moreNick Bostrom • Superintelligence: Paths, Dangers, Strategies
Could they use this model—they would dub it the “pseudo-count”—to motivate an agent to seek these novel states?
Brian Christian • The Alignment Problem
This is how I see the story of life and intelligence—as a story of improbably good designs being produced by optimization processes. The “improbability” here is improbability relative to a random selection from the design space, not improbability in an absolute sense—if you have an optimization process around, then “improbably” good designs become
... See moreEliezer Yudkowsky • Rationality
A superintelligent system could have disastrous effects even if it had a neutral goal and lacked self-awareness. “We cannot blithely assume,” Bostrom wrote, “that a superintelligence will necessarily share any of the final values stereotypically associated with wisdom and intellectual development in humans—scientific curiosity, benevolent concern f
... See moreMeghan O'Gieblyn • God, Human, Animal, Machine: Technology, Metaphor, and the Search for Meaning
By powerful AI, I have in mind an AI model—likely similar to today’s LLM’s in form, though it might be based on a different architecture, might involve several interacting models, and might be trained differently—with the following properties:
In terms of pure intelligence4, it is smarter than a Nobel Prize winner across most relevant fields – biolo
Nietzsche wrote (before he went mad). If you can identify a delusional popular belief, you can find what lies hidden behind it: the contrarian truth.
Peter Thiel, Blake Masters • Zero to One
A lot of the narratives seem to assume that a superintelligence will somehow free itself from constraints like „cost of compute“, „cost of stori... See more
halvar.flake • Someone is wrong on the internet (AGI Doom edition)
Yes, GPT-4 might be a stochastic parrot, but if so, perhaps the Biggest Question is to prove that humans are more than that.
Peter Lee • The AI Revolution in Medicine: GPT-4 and Beyond
Information retrieval systems also make extensive use of machine learning. The Google search engine is, arguably, the greatest AI system that has yet been built.