Automated measurement of mouse social behaviors using depth sensing, video tracking, and machine learning.

Journal: Proceedings of the National Academy of Sciences of the United States of America
PMID:

Abstract

A lack of automated, quantitative, and accurate assessment of social behaviors in mammalian animal models has limited progress toward understanding mechanisms underlying social interactions and their disorders such as autism. Here we present a new integrated hardware and software system that combines video tracking, depth sensing, and machine learning for automatic detection and quantification of social behaviors involving close and dynamic interactions between two mice of different coat colors in their home cage. We designed a hardware setup that integrates traditional video cameras with a depth camera, developed computer vision tools to extract the body "pose" of individual animals in a social context, and used a supervised learning algorithm to classify several well-described social behaviors. We validated the robustness of the automated classifiers in various experimental settings and used them to examine how genetic background, such as that of Black and Tan Brachyury (BTBR) mice (a previously reported autism model), influences social behavior. Our integrated approach allows for rapid, automated measurement of social behaviors across diverse experimental designs and also affords the ability to develop new, objective behavioral metrics.

Authors

  • Weizhe Hong
    Division of Biology and Biological Engineering 156-29, Howard Hughes Medical Institute, California Institute of Technology, Pasadena, CA 91125; whong@caltech.edu perona@caltech.edu wuwei@caltech.edu.
  • Ann Kennedy
    Division of Biology and Biological Engineering 156-29, Howard Hughes Medical Institute, California Institute of Technology, Pasadena, CA 91125;
  • Xavier P Burgos-Artizzu
    Division of Engineering and Applied Sciences 136-93, California Institute of Technology, Pasadena, CA 91125.
  • Moriel Zelikowsky
    Division of Biology and Biological Engineering 156-29, Howard Hughes Medical Institute, California Institute of Technology, Pasadena, CA 91125;
  • Santiago G Navonne
    Division of Engineering and Applied Sciences 136-93, California Institute of Technology, Pasadena, CA 91125.
  • Pietro Perona
    Division of Engineering and Applied Sciences 136-93, California Institute of Technology, Pasadena, CA 91125 whong@caltech.edu perona@caltech.edu wuwei@caltech.edu.
  • David J Anderson
    Division of Biology and Biological Engineering 156-29, Howard Hughes Medical Institute, California Institute of Technology, Pasadena, CA 91125; whong@caltech.edu perona@caltech.edu wuwei@caltech.edu.