How to Grow a Mind: Statistics, Structure and Abstraction

VideoLectures.Net
View the talk in context: videolectures.net/nips2010_tenenbaum_hgm/
View the complete 24th Annual Conference on Neural Information Processing Systems (NIPS): videolectures.net/nips2010_vancouver/
Speaker: Joshua B. Tenenbaum, Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, MIT

License: Creative Commons CC BY-NC-ND 3.0
More information at videolectures.net/site/about/
More talks at videolectures.net/

How do humans come to know so much about the world from so little data? Even young children can infer the meanings of words, the hidden properties of objects, or the existence of causal relations from just one or a few relevant observations -- far outstripping the capabilities of conventional learning machines. How do they do it -- and how can we bring machines closer to these human-like learning abilities? I will argue that people's everyday inductive leaps can be understood in terms of (approximations to) probabilistic inference over generative models of the world. These models can have rich latent structure based on abstract knowledge representations, what cognitive psychologists have sometimes called "intuitive theories", "mental models", or "schemas". They also typically have a hierarchical structure supporting inference at multiple levels, or "learning to learn", where abstract knowledge may itself be learned from experience at the same time as it guides more specific generalizations from sparse data. This talk will focus on models of learning and "learning to learn" about categories, word meanings and causal relations. I will show in each of these settings how human learners can balance the need for strongly constraining inductive biases -- necessary for rapid generalization -- with the flexibility to adapt to the structure of new environments, learning new inductive biases for which our minds could not have been pre-programmed. I will also discuss briefly how this approach extends to richer forms of knowledge, such as intuitive psychology and social inferences, or physical reasoning. Finally, I will raise some challenges for our current state of understanding about learning in the brain, and neurally inspired computational models.

0:00 How to Grow a Mind: Statistics, Structure and Abstraction
0:10 MIT Department of Brain and Cognitive Sciences
0:31 The goal
0:58 The big question (1)
1:37 Learning words for objects (1)
2:16 Learning words for objects (2)
2:59 The big question (2)
4:20 Demo (1)
5:22 The approach: learning with knowledge
6:51 Perception as Bayesian inference (1)
7:40 Perception as Bayesian inference (2)
8:22 Everyday prediction problems
9:01 Priors P(t total)
9:24 Learning words for objects (3)
9:38 Learning words for objects (4)
10:01 Learning words for objects (5)
11:45 Learning to learn words