A Defect Detection Method for Rail Surface and Fasteners Based on Deep Convolutional Neural Network.

Journal: Computational intelligence and neuroscience
Published Date:

Abstract

As a result of long-term pressure from train operations and direct exposure to the natural environment, rails, fasteners, and other components of railway track lines inevitably produce defects, which have a direct impact on the safety of train operations. In this study, a multiobject detection method based on deep convolutional neural network that can achieve nondestructive detection of rail surface and fastener defects is proposed. First, rails and fasteners on the railway track image are localized by the improved YOLOv5 framework. Then, the defect detection model based on Mask R-CNN is utilized to detect the surface defects of the rail and segment the defect area. Finally, the model based on ResNet framework is used to classify the state of the fasteners. To verify the robustness and effectiveness of our proposed method, we conduct experimental tests using the ballast and ballastless railway track images collected from Shijiazhuang-Taiyuan high-speed railway line. Through a variety of evaluation indexes to compare with other methods using deep learning algorithms, experimental results show that our method outperforms others in all stages and enables effective detection of rail surface and fasteners.

Authors

  • Danyang Zheng
    School of Urban Railway Transportation, Shanghai University of Engineering Science, Shanghai 201620, China.
  • Liming Li
    Department of Mechanical Engineering, Stony Brook University, NY, USA.
  • Shubin Zheng
    School of Urban Railway Transportation, Shanghai University of Engineering Science, Shanghai 201620, China.
  • Xiaodong Chai
    School of Urban Railway Transportation, Shanghai University of Engineering Science, Shanghai 201620, China.
  • Shuguang Zhao
    School of Information Science and Technology, Donghua University, Shanghai 201620, China.
  • Qianqian Tong
    School of Computer Science, Wuhan University, Wuhan, 430072, China; Guangdong Provincial Key Laboratory of Machine Vision and Virtual Reality Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China.
  • Ji Wang
    Department of Toxicology and Hygienic Chemistry, School of Public Health, Capital Medical University, Beijing 100069, China; Beijing Key Laboratory of Environmental Toxicology, Capital Medical University, Beijing 100069, China.
  • Lizheng Guo
    School of Computer and Data Science, Henan University of Urban Construction, Pingdingshan 467036, Henan, China.