CTformer: convolution-free Token2Token dilated vision transformer for low-dose CT denoising.

Journal: Physics in medicine and biology
Published Date:

Abstract

. Low-dose computed tomography (LDCT) denoising is an important problem in CT research. Compared to the normal dose CT, LDCT images are subjected to severe noise and artifacts. Recently in many studies, vision transformers have shown superior feature representation ability over the convolutional neural networks (CNNs). However, unlike CNNs, the potential of vision transformers in LDCT denoising was little explored so far. Our paper aims to further explore the power of transformer for the LDCT denoising problem.. In this paper, we propose a Convolution-free Token2Token Dilated Vision Transformer (CTformer) for LDCT denoising. The CTformer uses a more powerful token rearrangement to encompass local contextual information and thus avoids convolution. It also dilates and shifts feature maps to capture longer-range interaction. We interpret the CTformer by statically inspecting patterns of its internal attention maps and dynamically tracing the hierarchical attention flow with an explanatory graph. Furthermore, overlapped inference mechanism is employed to effectively eliminate the boundary artifacts that are common for encoder-decoder-based denoising models.. Experimental results on Mayo dataset suggest that the CTformer outperforms the state-of-the-art denoising methods with a low computational overhead.. The proposed model delivers excellent denoising performance on LDCT. Moreover, low computational cost and interpretability make the CTformer promising for clinical applications.

Authors

  • Dayang Wang
    Department of Food Science and Human Nutrition, University of Florida, 572 Newell Dr., Gainesville, FL 32611, United States.
  • Fenglei Fan
    Biomedical Imaging Center, BME/CBIS, Rensselaer Polytechnic Institute, Troy, New York, USA.
  • Zhan Wu
    School of Cyberspace Security, Southeast University, Nanjing, Jiangsu, China.
  • Rui Liu
    School of Education, China West Normal University, Nanchong, Sichuan, China.
  • Fei Wang
    Department of Population Health Sciences, Weill Cornell Medicine, Cornell University, New York, NY, United States.
  • Hengyong Yu
    Department of Electrical and Computer Engineering, University of Masachusetts Lowell, Lowell, MA 01854, USA.