Convolutional neural networks automate detection for tracking of submicron-scale particles in 2D and 3D.

Journal: Proceedings of the National Academy of Sciences of the United States of America
Published Date:

Abstract

Particle tracking is a powerful biophysical tool that requires conversion of large video files into position time series, i.e., traces of the species of interest for data analysis. Current tracking methods, based on a limited set of input parameters to identify bright objects, are ill-equipped to handle the spectrum of spatiotemporal heterogeneity and poor signal-to-noise ratios typically presented by submicron species in complex biological environments. Extensive user involvement is frequently necessary to optimize and execute tracking methods, which is not only inefficient but introduces user bias. To develop a fully automated tracking method, we developed a convolutional neural network for particle localization from image data, comprising over 6,000 parameters, and used machine learning techniques to train the network on a diverse portfolio of video conditions. The neural network tracker provides unprecedented automation and accuracy, with exceptionally low false positive and false negative rates on both 2D and 3D simulated videos and 2D experimental videos of difficult-to-track species.

Authors

  • Jay M Newby
    Department of Mathematics, University of Alberta, Edmonton, AB, Canada T6G 2R3.
  • Alison M Schaefer
    Division of Pharmacoengineering and Molecular Pharmaceutics, Eshelman School of Pharmacy, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599.
  • Phoebe T Lee
    Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599.
  • M Gregory Forest
    Dept. of Mathematics, University of North Carolina at Chapel Hill.
  • Samuel K Lai
    Division of Pharmacoengineering and Molecular Pharmaceutics, Eshelman School of Pharmacy, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599; lai@unc.edu forest@unc.edu.