DeepPartitioning: Deep Learning of Graph Partitioning for Neuron Segmentation from Electron Microscopy Volume via Graph Neural Network.

Journal: IEEE transactions on medical imaging
Published Date:

Abstract

Superpixel aggregation represents a highly effective approach for automated neuron segmentation from electron microscopy (EM) volumes, which can be considered as a graph partitioning task on the region adjacency graph (RAG) of extracted superpixels. However, existing graph partitioning models for superpixel aggregation suffer from the modeling error due to insufficient model capacity. More specifically, the modeling error is caused by the simplification in formulating the real-world graph partitioning task (i.e., superpixel aggregation) into a mathematically well-defined optimization problem. To address this issue, we sidestep the explicit formulation and propose a fully end-to-end superpixel aggregation method based on deep learning of the graph partitioning task, called Deep-Partitioning. The central challenge lies in characterizing the partitioning task involving combinatorial complexity. Hence, our method incorporates a line graph neural network (LGNN) to capture higher-order relational structures in RAGs. Specifically, the LGNN enables the propagation of second-order superpixel-pair features among adjacent edges in RAGs. In this way, the partitioning task can be implicitly transformed into the vanilla second-order multicut problem while maintaining higher-order structural information. Overall, our method integrates a second-order feature extractor, a higher-order feature integrator (i.e., the LGNN), and a differentiable approximation to a multicut solver into a unified, learnable framework. Extensive experiments on three public EM datasets demonstrate the effectiveness of the proposed DeepPartitioning within the neuron segmentation pipeline.

Authors

  • Zhenchen Li
    National Laboratory of Pattern Recognition, Research Center for Brain-inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; School of Artificial Intelligence, School of Future Technology, University of the Chinese Academy of Sciences, Beijing 101408, China.
  • Xu Yang
    Department of Food Science and Technology, The Ohio State University, Columbus, OH, United States.
  • Jiazheng Liu
  • Yanchao Zhang
  • Jing Liu
    Department of Ophthalmology, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing, China.
  • Bing Liu
    Department of Cardiovascular Surgery, the Sixth Medical Centre of Chinese PLA General Hospital, 100048 Beijing, China.
  • Zhiyong Liu
    State Key Laboratory of Respiratory Disease , Guangzhou Institutes of Biomedicine and Health (GIBH) , Chinese Academy of Sciences (CAS) , Guangzhou-510530 , China . Email: zhang_tianyu@gibh.ac.cn ; ; Tel: (+86)20 3201 5270.
  • Hua Han
    Department of Orthopaedic Surgery, the Second Hospital &Clinical Medical School, Lanzhou University, Lanzhou, Gansu Province, China.

Keywords

No keywords available for this article.