A Hybrid Multishape Learning Framework for Longitudinal Prediction of Cortical Surfaces and Fiber Tracts Using Neonatal Data.

Journal: Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention
Published Date:

Abstract

Dramatic changes of the human brain during the first year of postnatal development are poorly understood due to their multifold complexity. In this paper, we present the first attempt to jointly predict, using neonatal data, the dynamic growth pattern of brain cortical surfaces (collection of 3D triangular faces) and fiber tracts (collection of 3D lines). These two entities are modeled jointly as a (a set of interlinked shapes). We propose a learning-based multishape prediction framework that captures both the evolution of the cortical surfaces and the growth of fiber tracts. In particular, we learn a set of geometric and dynamic cortical features and fiber connectivity features that characterize the relationships between cortical surfaces and fibers at different timepoints (0, 3, 6, and 9 months of age). Given a new neonatal multishape at 0 month of age, we hierarchically predict, at 3, 6 and 9 months, the postnatal cortical surfaces vertex-by-vertex along with fibers connected to adjacent faces to these vertices. This is achieved using a new fiber-to-face metric that quantifies the similarity between multishapes. For validation, we propose several evaluation metrics to thoroughly assess the performance of our framework. The results confirm that our framework yields good prediction accuracy of complex neonatal multishape development within a few seconds.

Authors

  • Islem Rekik
    Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA.
  • Gang Li
    The Centre for Cyber Resilience and Trust, Deakin University, Australia.
  • Pew-Thian Yap
    Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
  • Geng Chen
    Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
  • Weili Lin
    Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA.
  • Dinggang Shen
    School of Biomedical Engineering, ShanghaiTech University, Shanghai, China.