Mulberry leaf disease detection by CNN-ViT with XAI integration.

Journal: PloS one
Published Date:

Abstract

Mulberry leaf disease detection is vital for maintaining the health and productivity of mulberry crops. In this paper, a novel approach was proposed by integrating explainable artificial intelligence (XAI) techniques with a convolutional neural network (CNN) and vision transformer (ViT) for effective mulberry leaf disease classification with three disease classes. Initially, in this proposed CNN-ViT model, features are extracted using a customized CNN architecture, and then the extracted features are fed into ViT for leaf disease classification in a more streamlined approach. The CNN-ViT model achieved promising results with a projection dimension of 64, utilizing 8 heads and 8 transformer layers, yielding an accuracy of 95.60% with notable precision of 94.75%, recalls of 92.40%, and F1-scores of 93.45%. The proposed method also took 0.0017 seconds to predict an individual image. The accuracy of the proposed method was comparable to that of other state-of-the-art (SOTA) methods reported in the literature. Finally, Grad-CAM was utilized for detecting precise region of interest for diseased leaves, leaf spots, and leaf rust, providing interpretability and insights into the model's decision-making process. This comprehensive approach demonstrates the effectiveness of explainable artificial intelligence (XAI) integration in the CNN-ViT model for mulberry leaf disease detection, paving the way for improved agricultural disease management strategies.

Authors

  • Mohammad Asif Hasan
    Department of Electronics & Telecommunication Engineering, Rajshahi University of Engineering & Technology, Rajshahi, Bangladesh. Electronic address: 1804054@student.ruet.ac.bd.
  • Fariha Haque
    Department of Electronics & Telecommunication Engineering, Rajshahi University of Engineering & Technology, Rajshahi, Bangladesh. Electronic address: 1804043@student.ruet.ac.bd.
  • Hasan Sarker
    Department of Electronics & Telecommunication Engineering, Rajshahi University of Engineering & Technology, Rajshahi, Bangladesh.
  • Rafae Abdullah
    Department of Business Analytics and Data Science, Oklahoma State University, Stillwater, Oklahoma, United States of America.
  • Tonmoy Roy
    Department of Data Analytics & Information Systems, Utah State University, Old Main Hill, Logan, UT, 84322 (435) 797-1000, USA. Electronic address: tonmoy.roy@usu.edu.
  • Nishat Taaha
    Department of Electronics and Communication Engineering, Khulna University of Engineering & Technology, Khulna, Bangladesh.
  • Yeasin Arafat
    School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China.
  • Abdul Karim Patwary
    School of Electronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China.
  • Mominul Ahsan
    Department of Computer Science, University of York, Deramore Lane, Heslington, York YO10 5GH, UK.
  • Julfikar Haider
    Department of Engineering, Manchester Metropolitan University, Chester St, Manchester M1 5GD, UK.