An integrative computational architecture for object-driven cortex.

Journal: Current opinion in neurobiology
Published Date:

Abstract

Computational architecture for object-driven cortex Objects in motion activate multiple cortical regions in every lobe of the human brain. Do these regions represent a collection of independent systems, or is there an overarching functional architecture spanning all of object-driven cortex? Inspired by recent work in artificial intelligence (AI), machine learning, and cognitive science, we consider the hypothesis that these regions can be understood as a coherent network implementing an integrative computational system that unifies the functions needed to perceive, predict, reason about, and plan with physical objects-as in the paradigmatic case of using or making tools. Our proposal draws on a modeling framework that combines multiple AI methods, including causal generative models, hybrid symbolic-continuous planning algorithms, and neural recognition networks, with object-centric, physics-based representations. We review evidence relating specific components of our proposal to the specific regions that comprise object-driven cortex, and lay out future research directions with the goal of building a complete functional and mechanistic account of this system.

Authors

  • Ilker Yildirim
    Center for Brains, Minds, and Machines, MIT, Cambridge, MA 02138, United States; Department of Brain & Cognitive Science, MIT, Cambridge, MA 02138, United States. Electronic address: ilkery@mit.edu.
  • Jiajun Wu
    Center for Brains, Minds, and Machines, MIT, Cambridge, MA 02138, United States; Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA 02138, United States.
  • Nancy Kanwisher
    Center for Brains, Minds, and Machines, MIT, Cambridge, MA 02138, United States; McGovern Institute for Brain Research, MIT, Cambridge, MA 02138, United States; Department of Brain & Cognitive Science, MIT, Cambridge, MA 02138, United States.
  • Joshua Tenenbaum
    Center for Brains, Minds, and Machines, MIT, Cambridge, MA 02138, United States; McGovern Institute for Brain Research, MIT, Cambridge, MA 02138, United States; Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA 02138, United States; Department of Brain & Cognitive Science, MIT, Cambridge, MA 02138, United States.