LEARNING IS EXPLOITING A COMBINATORIAL EXPLOSION

Learning means trying to select the simplest model that fits the data. Suppose I show you the top card and tell you that the three objects surrounded by thick lines are “tufas.” With so little data, how do you find the other tufas? Your brain makes a model of how these forms were generated, a hierarchical tree of their properties, and then selects

supervised learning techniques, and a few have used reinforcement learning (for

Learning, in both brains and machines, thus requires searching for an optimal combination of parameters that, together, define the mental model in every detail.