Robust deep learning optical autofocus system applied to automated multiwell plate single molecule localization microscopy.

Journal: Journal of microscopy
Published Date:

Abstract

We presenta robust, long-range optical autofocus system for microscopy utilizing machine learning. This can be useful for experiments with long image data acquisition times that may be impacted by defocusing resulting from drift of components, for example due to changes in temperature or mechanical drift. It is also useful for automated slide scanning or multiwell plate imaging where the sample(s) to be imaged may not be in the same horizontal plane throughout the image data acquisition. To address the impact of (thermal or mechanical) fluctuations over time in the optical autofocus system itself, we utilize a convolutional neural network (CNN) that is trained over multiple days to account for such fluctuations. To address the trade-off between axial precision and range of the autofocus, we implement orthogonal optical readouts with separate CNN training data, thereby achieving an accuracy well within the 600 nm depth of field of our 1.3 numerical aperture objective lens over a defocus range of up to approximately +/-100 μm. We characterize the performance of this autofocus system and demonstrate its application to automated multiwell plate single molecule localization microscopy.

Authors

  • Jonathan Lightley
    Photonics Group, Physics Department, Imperial College London, London, UK.
  • Frederik Görlitz
    Photonics Group, Physics Department, Imperial College London, London, UK.
  • Sunil Kumar
    School of Computer Science, University of Petroleum and Energy Studies, Dehradun, India.
  • Ranjan Kalita
    Photonics Group, Physics Department, Imperial College London, London, UK.
  • Arinbjorn Kolbeinsson
    Department of Epidemiology and Biostatistics, Imperial College London, London, UK.
  • Edwin Garcia
    Department of Physics, Imperial College, London, UK.
  • Yuriy Alexandrov
    Department of Physics, Imperial College London, London, UK.
  • Vicky Bousgouni
    Institute of Cancer Research, Chester Beatty Laboratories, London, UK.
  • Riccardo Wysoczanski
    Photonics Group, Physics Department, Imperial College London, London, UK.
  • Peter Barnes
    National Heart and Lung Institute, Imperial College London, London, UK.
  • Louise Donnelly
    National Heart and Lung Institute, Imperial College London, London, UK.
  • Chris Bakal
    Institute of Cancer Research, Chester Beatty Laboratories, London, UK.
  • Christopher Dunsby
    Photonics Group, Physics Department, Imperial College London, London, UK.
  • Mark A A Neil
    Department of Physics, Imperial College, London, UK.
  • Seth Flaxman
    Department of Mathematics and Data Science Institute, Imperial College London, London, SW7 2AZ, UK.
  • Paul M W French
    Department of Physics, Imperial College, London, UK.