Muddles about Models
Classical computer science, of the sort practiced by Turing and von Neumann and everyone after, manipulates symbols in a fashion that we think of as algebraic, and that’s what’s really at stake.
Gary Marcus • Deep Learning Is Hitting a Wall
There is so much more structure in the world than we tend to believe. And LLMs and other AI models are structure discovery machines.
It is very important to bear in mind that this is what large language models really do. Suppose we give an LLM the prompt “The first person to walk on the Moon was ”, and suppose it responds with “Neil Armstrong”. What are we really asking here? In an important sense, we are not really asking who was the first person to walk on the Moon. What we ar
... See moreMurray Shanahan • Talking about large language models
