Sharing Rewards Undermines Coordinated Hunting.

Journal: Journal of computational biology : a journal of computational molecular cell biology
Published Date:

Abstract

Coordinated hunting is widely observed in animals, and sharing rewards is often considered a major incentive for its success. While current theories about the role played by sharing in coordinated hunting are based on correlational evidence, we reveal the causal roles of sharing rewards through computational modeling with a state-of-the-art Multi-agent Reinforcement Learning (MARL) algorithm. We show that counterintuitively, while selfish agents reach robust coordination, sharing rewards undermines coordination. Hunting coordination modeled through sharing rewards (1) suffers from the free-rider problem, (2) plateaus at a small group size, and (3) is not a Nash equilibrium. Moreover, individually rewarded predators outperform predators that share rewards, especially when the hunting is difficult, the group size is large, and the action cost is high. Our results shed new light on the actual importance of prosocial motives for successful coordination in nonhuman animals and suggest that sharing rewards might simply be a byproduct of hunting, instead of a design strategy aimed at facilitating group coordination. This also highlights that current artificial intelligence modeling of human-like coordination in a group setting that assumes rewards sharing as a motivator (e.g., MARL) might not be adequately capturing what is truly necessary for successful coordination.

Authors

  • Minglu Zhao
    Department of Statistics, University of California Los Angeles, Los Angeles, California, USA.
  • Ning Tang
    Shanghai Veterinary Research Institute, Chinese Academy of Agricultural Sciences, Shanghai, China.
  • Annya L Dahmani
    Department of Psychology, University of California Los Angeles, Los Angeles, California, USA.
  • Yixin Zhu
    Department of Statistics, UCLA, Los Angeles, CA 90095, USA. markedmonds@ucla.edu yixin.zhu@ucla.edu sczhu@stat.ucla.edu.
  • Federico Rossano
    Department of Cognitive Science, University of California San Diego, La Jolla, California, USA.
  • Tao Gao
    Department of Critical Care Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, Jiangsu, China.