Explainable few-shot learning workflow for detecting invasive and exotic tree species.

Journal: Scientific reports
Published Date:

Abstract

Deep Learning methods are notorious for relying on extensive labeled datasets to train and assess their performance. This can cause difficulties in practical situations where models should be trained for new applications for which very little data is available. While few-shot learning algorithms can address the first problem, they still lack sufficient explanations for the results. This research presents a workflow that tackles both challenges by proposing an explainable few-shot learning workflow for detecting invasive and exotic tree species in the Atlantic Forest of Brazil using Unmanned Aerial Vehicle (UAV) images. By integrating a Siamese network with explainable AI (XAI), the workflow enables the classification of tree species with minimal labeled data while providing visual, case-based explanations for the predictions. Results demonstrate the effectiveness of the proposed workflow in identifying new tree species, even in data-scarce conditions. With a lightweight backbone, e.g., MobileNet, it achieves an F1-score of 0.86 in 3-shot learning, outperforming a shallow CNN. A set of explanation metrics, i.e., correctness, continuity, and contrastivity, accompanied by visual cases, provide further insights about the prediction results. This approach opens new avenues for using AI and UAVs in forest management and biodiversity conservation, particularly concerning rare or understudied species.

Authors

  • Caroline M Gevaert
    Faculty ITC, University of Twente, 7500 AE, Enschede, The Netherlands. c.m.gevaert@utwente.nl.
  • Alexandra Aguiar Pedro
    São Paulo Municipal Green and Environment Secretariat, São Paulo, 04103-000, Brazil.
  • Ou Ku
    Netherlands eScience Center, 1098 XH, Amsterdam, The Netherlands.
  • Hao Cheng
    Department of Forensic Pathology, School of Forensic Medicine, China Medical University, Shenyang 110122, China.
  • Pranav Chandramouli
    Netherlands eScience Center, 1098 XH, Amsterdam, The Netherlands.
  • Farzaneh Dadrass Javan
    Faculty ITC, University of Twente, 7500 AE, Enschede, The Netherlands.
  • Francesco Nattino
    Netherlands eScience Center, 1098 XH, Amsterdam, The Netherlands.
  • Sonja Georgievska
    Netherlands eScience Center, Science Park 140, 1098 XG, Amsterdam, The Netherlands.