Three-Dimensional Reconstruction of Serial Block-Face Scanning Electron Microscopy Using Semantic Segmentation based on Semi-Supervised Deep Learning.

Journal: Microscopy and microanalysis : the official journal of Microscopy Society of America, Microbeam Analysis Society, Microscopical Society of Canada
Published Date:

Abstract

Serial block-face scanning electron microscopy (SBF-SEM) is employed to achieve high-resolution volume reconstructions and detailed ultrastructural analyses of complex organelles. The performance of SBF-SEM is evaluated according to the accuracy of segmentation. Our study introduces a semi-supervised learning approach using a segment interpolation method to mitigate the costs of manual segmentation. The shapes and locations of individual segments between sparsely annotated label images are estimated using the proposed method. The proposed method is particularly well suited for SBF-SEM, where alignment and fine cutting of samples allow for accurate predictions with a minimal amount of labelled data. To validate the deep neural networks trained using the proposed method, the F-1 score metric and the K-fold technique were utilized. The results achieved an F-1 score of 0.89 for mouse brain cells and 0.84 for inverted images during the validation process for semi-supervised learning. Testing on an independently separated test dataset yielded scores of 0.84 for mouse brain cells and 0.80 for inverted cases. The automatically segmented results were then reconstructed in volume images using the marching cube algorithm. This allows for a three-dimensional (3-D) analysis of complex organelles, with potential applications in the fields of biology and medicine.

Authors

  • Dal-Jae Yun
    Emerging Research Instruments Group, Strategic Technology Research Institute, Korea Research Institute of Standards and Science (KRISS), 267 Gajeong-ro, Yuseong-gu, Daejeon 34113, Republic of Korea.
  • Junhyeong Park
    Emerging Research Instruments Group, Strategic Technology Research Institute, Korea Research Institute of Standards and Science (KRISS), 267 Gajeong-ro, Yuseong-gu, Daejeon 34113, Republic of Korea.
  • Youngkwon Haam
    Graduate School of Analytical Science and Technology, Chungnam National University, 99 Daehak-ro, Yuseong-gu, Daejeon 34134, Rebublic of  Korea.
  • Hee-Seok Kweon
    Center for Research Equipment, Korea Basic Science Institute, 162 Yeongudanji-ro, Ochang-eup, Cheongwon-gu, Cheongju 28119, Republic of Korea.
  • Hwan Hur
    Center for Scientific Instrumentation, Korea Basic Science Institute, 169-148 Gwahak-ro, Yuseong-gu, Daejeon 34133, Republic of Korea.
  • Jisoo Kim
    School of Electrical and Computer Engineering, Ulsan National Institute of Science and Technology, Ulsan, South Korea.
  • In-Yong Park
    Emerging Research Instruments Group, Strategic Technology Research Institute, Korea Research Institute of Standards and Science (KRISS), 267 Gajeong-ro, Yuseong-gu, Daejeon 34113, Republic of Korea.
  • Ha Rim Lee
    Emerging Research Instruments Group, Strategic Technology Research Institute, Korea Research Institute of Standards and Science (KRISS), 267 Gajeong-ro, Yuseong-gu, Daejeon 34113, Republic of Korea.
  • Haewon Jung
    Emerging Research Instruments Group, Strategic Technology Research Institute, Korea Research Institute of Standards and Science (KRISS), 267 Gajeong-ro, Yuseong-gu, Daejeon 34113, Republic of Korea.