Masked attribution-based probing of strategies as a computational framework to align human, non-human primate, and model explanations.

Journal: Communications psychology
Published Date:

Abstract

What visual information do primate brains use to recognize objects, and can explanations from artificial neural networks (ANNs) help reveal these biological recognition strategies? Answering this question is important because humans and macaques both perform rapid, robust object recognition, yet the diagnostic image features guiding their behavior are difficult to measure at scale. Behavioral methods such as Bubbles can estimate these features but require extensive psychophysical data, whereas ANN explanation methods, including saliency and guided backpropagation, are efficient but often disagree with one another and lack direct biological validation. Here, we introduce MAPS, Masked Attribution-based Probing of Strategies, a framework that makes ANN-derived explanations testable in biological systems by linking them to neurobehavioral consequences. MAPS converts explanation maps into minimal explanation-masked images and asks whether these images preserve the original image-by-image recognition behavior. In silico, EMI-based behavioral similarity reliably recovers ground-truth similarity between model strategies. Applied to humans (n = 56) and macaques (n = 2), MAPS identifies explanation methods that best align with biological vision, achieving validity comparable to Bubbles without exhaustive psychophysics. MAPS provides a scalable, behaviorally grounded approach to evaluate and compare ANN explanations across brains and machines.

Authors

Keywords

No keywords available for this article.