Someone is wrong on the internet (AGI Doom edition)
It's becoming increasingly evident that in many circles, AI is not perceived as merely a technology, but as "something else" entirely. This misconception is exemplified by the recurring debate: "Humans vs AI." To illustrate the absurdity of this framing, let's replace "AI" with "technology":
"Humans vs Technology"
This reframing immediately highl... See more
How much can you optimize for generality? To what extent can you simultaneously optimize a system for every possible situation, including situations never encountered before? Presumably, some improvement is possible, but the idea of an intelligence explosion implies that there is essentially no limit to the extent of optimization that can be achiev... See more
newyorker.com • Why Computers Won’t Make Themselves Smarter
A maximally efficient bug-free reasoner in the real world, in fact, would still need to rely on heuristics and approximations. The optimal computationally tractable algorithms for changing beliefs fall short of probability theory’s consistency.
Eliezer Yudkowsky • Rationality
God isn’t the only being that people have tried to argue into existence. “Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever,” the mathematician Irving John Good wrote, in 1965: