Beyond human perception: challenges in AI interpretability of orangutan artwork.

Journal: Primates; journal of primatology
PMID:

Abstract

Drawings serve as a profound medium of expression for both humans and apes, offering unique insights into the cognitive and emotional landscapes of the artists, regardless of their species. This study employs artificial intelligence (AI), specifically Convolutional Neural Networks (CNNs) and the interpretability tool Captum, to analyse non-figurative drawings by Molly, an orangutan. The research utilizes VGG19 and ResNet18 models to decode seasonal nuances in the drawings, achieving notable accuracy in seasonal classification and revealing complex influences beyond human-centric methods. Techniques, such as occlusion, integrated gradients, PCA, t-SNE, and Louvain clustering, highlight critical areas and elements influencing seasonal recognition, providing deeper insights into the drawings. This approach not only advances the analysis of non-human art but also demonstrates the potential of AI to enrich our understanding of non-human cognitive and emotional expressions, with significant implications for fields like evolutionary anthropology and comparative psychology.

Authors

  • Cédric Sueur
    Institut Pluridisciplinaire Hubert Curien (IPHC) UMR 7178 Centre National de la Recherche Scientifique (CNRS), Université de Strasbourg, 67000 Strasbourg, France.
  • Elliot Maitre
    Université de Toulouse - IRIT UMR5505, 31400, Toulouse, France.
  • Jimmy Falck
    Laboratoire Lorrain de Recherche en Informatique et ses Applications, (Loria - CNRS/Université de Lorraine/Inria), Nancy, France.
  • Masaki Shimada
    Department of Animal Sciences, Teikyo University of Science, Uenohara Yamanashi, Yatsusawa, 2525409-0193, Japan.
  • Marie Pelé
    ANTHROPO-LAB, ETHICS EA7446, Université Catholique de Lille, Lille, France marie.pele@univ-catholille.fr www.ethobiosciences.com.