Stacked dilated convolutions and asymmetric architecture for U-Net-based medical image segmentation.

Journal: Computers in biology and medicine
Published Date:

Abstract

Deep learning has been widely utilized for medical image segmentation. The most commonly used U-Net and its variants often share two common characteristics but lack solid evidence for the effectiveness. First, each block (i.e., consecutive convolutions of feature maps of the same resolution) outputs feature maps from the last convolution, limiting the variety of the receptive fields. Second, the network has a symmetric structure where the encoder and the decoder paths have similar numbers of channels. We explored two novel revisions: a stacked dilated operation that outputs feature maps from multi-scale receptive fields to replace the consecutive convolutions; an asymmetric architecture with fewer channels in the decoder path. Two novel models were developed: U-Net using the stacked dilated operation (SDU-Net) and asymmetric SDU-Net (ASDU-Net). We used both publicly available and private datasets to assess the efficacy of the proposed models. Extensive experiments confirmed SDU-Net outperformed or achieved performance similar to the state-of-the-art while using fewer parameters (40% of U-Net). ASDU-Net further reduced the model parameters to 20% of U-Net with performance comparable to SDU-Net. In conclusion, the stacked dilated operation and the asymmetric structure are promising for improving the performance of U-Net and its variants.

Authors

  • Shuhang Wang
  • Vivek Kumar Singh
    Information Systems and Decision Sciences, MUMA College of Business, University of South Florida, Tampa, Florida, USA.
  • Eugene Cheah
    Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, 02114, MA, USA.
  • Xiaohong Wang
    School of Reliability and Systems Engineering, Beihang University, Beijing 100191, China. wxhong@buaa.edu.cn.
  • Qian Li
    Emergency and Critical Care Center, Department of Emergency Medicine, Zhejiang Provincial People's Hospital, People's Hospital of Hangzhou Medical College, Hangzhou, Zhejiang, China.
  • Shinn-Huey Chou
    Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, 02114, MA, USA.
  • Constance D Lehman
    From the Division of Breast Imaging, Department of Radiology, Massachusetts General Hospital/Harvard Medical School, 55 Fruit St, WAC 240, Boston, MA 02114 (M.B., C.D.L.); and Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, Mass (R.B., A.B.Y., N.J.L., L.Y.).
  • Viksit Kumar
    Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, Minnesota, United States of America.
  • Anthony E Samir
    Division of Ultrasound, Department of Radiology, Center for Ultrasound Research & Translation, Massachusetts General Hospital, Boston, MA, 02114, USA.