AI and the Limits of Language

Saved by Josh and

RelatedInsightsCollectionsHighlights

What can LLMs never do?

Deep-learning systems are outstanding at interpolating between specific examples they have seen before, but frequently stumble when confronted with novelty.

Gary Marcus • Deep Learning Is Hitting a Wall

World knowledge, as Bar-Hillel pointed out, couldn’t really be supplied to computers—at least not in any straightforward, engineering manner—because the “number of facts we human beings know is, in a certain very pregnant sense, infinite.

Erik Larson • The Myth of Artificial Intelligence: Why Computers Can’t Think the Way We Do

LLMs are extremely good at a type of knowledge called tacit knowledge (knowledge about something as it pertains to something else) but are extremely poor at pretty much any other type as far as I can see. It just so happens that tacit knowledge also happens to be the type of knowledge that drives natural language so it makes them looks super smart,... See more

Column: These Apple researchers just showed that AI bots can't think, and possibly never will — Apple’s AI researchers gave these AI systems a simple arithmetic problem that schoolkids can solve. The bots flunked.