Leaf Recognition Based on Joint Learning Multiloss of Multimodel Convolutional Neural Networks: A Testing for Vietnamese Herb.

Journal: Computational intelligence and neuroscience
PMID:

Abstract

A new modification of multi-CNN ensemble training is investigated by combining multiloss functions from state-of-the-art deep CNN architectures for leaf image recognition. We first apply the U-Net model to segment leaf images from the background to improve the performance of the recognition system. Then, we introduce a multimodel approach based on a combination of loss functions from the EfficientNet and MobileNet (called as multimodel CNN (MMCNN)) to generalize a multiloss function. The joint learning multiloss model designed for leaf recognition allows each network to perform its task and cooperate with the others simultaneously, where knowledge from various trained deep networks is shared. This cooperation-proposed multimodel is forced to deal with more complicated problems rather than a simple classification. Therefore, the network can learn much rich information and improve its generalization capability. Furthermore, a multiloss trade-off strategy between two deep learning models can reduce the effect of redundancy problems in ensemble classifiers. The performance of our approach is evaluated by our custom Vietnamese herbal leaf species dataset, and public datasets such as Flavia, Leafsnap, and Folio are used to build test cases. The results confirm that our approach enhances the leaf recognition performance and outperforms the current standard single networks while having less low computation cost.

Authors

  • Trinh Tan Dat
    Information Science Faculty, Sai Gon University, Ho Chi Minh City, Vietnam.
  • Pham Cung Le Thien Vu
    Information Science Faculty, Sai Gon University, Ho Chi Minh City, Vietnam.
  • Nguyen Nhat Truong
    Information Science Faculty, Sai Gon University, Ho Chi Minh City, Vietnam.
  • Le Tran Anh Dang
    Information Science Faculty, Sai Gon University, Ho Chi Minh City, Vietnam.
  • Vu Ngoc Thanh Sang
    Information Science Faculty, Sai Gon University, Ho Chi Minh City, Vietnam.
  • Pham The Bao
    Faculty of Mathematics and Computer Science, University of Science, 227 Nguyen Van Cu, District 5, Ho Chi Minh City, Vietnam.