Robust mouse tracking in complex environments using neural networks.

Journal: Communications biology
PMID:

Abstract

The ability to track animals accurately is critical for behavioral experiments. For video-based assays, this is often accomplished by manipulating environmental conditions to increase contrast between the animal and the background in order to achieve proper foreground/background detection (segmentation). Modifying environmental conditions for experimental scalability opposes ethological relevance. The biobehavioral research community needs methods to monitor behaviors over long periods of time, under dynamic environmental conditions, and in animals that are genetically and behaviorally heterogeneous. To address this need, we applied a state-of-the-art neural network-based tracker for single mice. We compare three different neural network architectures across visually diverse mice and different environmental conditions. We find that an encoder-decoder segmentation neural network achieves high accuracy and speed with minimal training data. Furthermore, we provide a labeling interface, labeled training data, tuned hyperparameters, and a pretrained network for the behavior and neuroscience communities.

Authors

  • Brian Q Geuther
    The Jackson Laboratory, 600 Main Street, Bar Harbor, ME 04609 USA.
  • Sean P Deats
    The Jackson Laboratory, 600 Main Street, Bar Harbor, ME 04609 USA.
  • Kai J Fox
    The Jackson Laboratory, 600 Main Street, Bar Harbor, ME 04609 USA.
  • Steve A Murray
    The Jackson Laboratory, 600 Main Street, Bar Harbor, ME 04609 USA.
  • Robert E Braun
    The Jackson Laboratory, 600 Main Street, Bar Harbor, ME 04609 USA.
  • Jacqueline K White
    Mouse Genetics Project, Wellcome Trust Sanger Institute, Hinxton, Cambridgeshire UK.
  • Elissa J Chesler
    The Jackson Laboratory, 600 Main Street, Bar Harbor, ME 04609 USA.
  • Cathleen M Lutz
    The Jackson Laboratory, 600 Main Street, Bar Harbor, ME 04609 USA.
  • Vivek Kumar
    University of Cagliari, Cagliari, Sardinia, Italy.