Deep learning segmentation of orbital fat to calibrate conventional MRI for longitudinal studies.

Journal: NeuroImage
Published Date:

Abstract

In conventional non-quantitative magnetic resonance imaging, image contrast is consistent within images, but absolute intensity can vary arbitrarily between scans. For quantitative analysis of intensity data, images are typically normalized to a consistent reference. The most convenient reference is a tissue that is always present in the image, and is unlikely to be affected by pathological processes. In multiple sclerosis neuroimaging, both the white and gray matter are affected, so normalization techniques that depend on brain tissue may introduce bias or remove biological changes of interest. We introduce a complementary procedure, image "calibration," the goal of which is to remove technical intensity artifacts while preserving biological differences. We demonstrate a deep learning approach to segmenting fat from within the orbit of the eyes on T-weighted images at 1.5 and 3 ​T to use as a reference tissue, and use it to calibrate 1018 scans from 256 participants in a study of pediatric-onset multiple sclerosis. The machine segmentations agreed with the adjudicating expert (DF) segmentations better than did those of other expert humans, and calibration resulted in better agreement with semi-quantitative magnetization transfer ratio imaging than did normalization with the WhiteStripe algorithm. We suggest that our method addresses two key priorities in the field: (1) it provides a robust option for serial calibration of conventional scans, allowing comparison of disease change in persons imaged at multiple time points in their disease; and (ii) the technique is fast, as the deep learning segmentation takes only 0.5 ​s/scan, which is feasible for both large and small datasets.

Authors

  • Robert A Brown
    McGill Program in Neuroengineering, Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, H3A 2B4 Montreal, QC Canada.
  • Dumitru Fetco
    McConnell Brain Imaging Centre, Montreal Neurological Institute and Hospital, 3801 Rue University, Montreal, QC, H3A 2B4, Canada. Electronic address: dumitru.fetco@mcgill.ca.
  • Robert Fratila
    McConnell Brain Imaging Centre, Montreal Neurological Institute and Hospital, 3801 Rue University, Montreal, QC, H3A 2B4, Canada. Electronic address: robert.fratila@mail.mcgill.ca.
  • Giulia Fadda
    McConnell Brain Imaging Centre, Montreal Neurological Institute and Hospital, 3801 Rue University, Montreal, QC, H3A 2B4, Canada; Department of Neurology, Perelman Center for Advanced Medicine, University of Pennsylvania, 3400 Civic Center Drive, Philadelphia, PA, USA, 19104. Electronic address: gfadda@pennmedicine.upenn.edu.
  • Shangge Jiang
    McConnell Brain Imaging Centre, Montreal Neurological Institute and Hospital, 3801 Rue University, Montreal, QC, H3A 2B4, Canada. Electronic address: shangge.jiang@mail.mcgill.ca.
  • Nuha M Alkhawajah
    College of Medicine, King Saud University, P.O. Box 2454, Riyadh, 11451, Saudi Arabia. Electronic address: nalkhawajah@ksu.edu.sa.
  • E Ann Yeh
    Department of Pediatrics, University of Toronto, Division of Neurology, The Hospital for Sick Children, Neurosciences and Metnal Health, SickKids Research Institute, Toronto, ON, Canada. Electronic address: ann.yeh@sickkids.ca.
  • Brenda Banwell
    Department of Pediatrics, University of Toronto, Division of Neurology, The Hospital for Sick Children, Neurosciences and Metnal Health, SickKids Research Institute, Toronto, ON, Canada; Division of Neurology, The Children's Hospital of Philadelphia, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA. Electronic address: banwellb@email.chop.edu.
  • Amit Bar-Or
    McConnell Brain Imaging Centre, Montreal Neurological Institute and Hospital, 3801 Rue University, Montreal, QC, H3A 2B4, Canada; Department of Neurology, Perelman Center for Advanced Medicine, University of Pennsylvania, 3400 Civic Center Drive, Philadelphia, PA, USA, 19104. Electronic address: amitbar@pennmedicine.upenn.edu.
  • Douglas L Arnold
    Montreal Neurological Institute, McGill University, Montréal, Canada; NeuroRx Research, Montréal, Canada.