Cooperating with machines.

Journal: Nature communications
Published Date:

Abstract

Since Alan Turing envisioned artificial intelligence, technical progress has often been measured by the ability to defeat humans in zero-sum encounters (e.g., Chess, Poker, or Go). Less attention has been given to scenarios in which human-machine cooperation is beneficial but non-trivial, such as scenarios in which human and machine preferences are neither fully aligned nor fully in conflict. Cooperation does not require sheer computational power, but instead is facilitated by intuition, cultural norms, emotions, signals, and pre-evolved dispositions. Here, we develop an algorithm that combines a state-of-the-art reinforcement-learning algorithm with mechanisms for signaling. We show that this algorithm can cooperate with people and other algorithms at levels that rival human cooperation in a variety of two-player repeated stochastic games. These results indicate that general human-machine cooperation is achievable using a non-trivial, but ultimately simple, set of algorithmic mechanisms.

Authors

  • Jacob W Crandall
    Computer Science Department, Brigham Young University, 3361 TMCB, Provo, UT, 84602, USA. crandall@cs.byu.edu.
  • Mayada Oudah
    Khalifa University of Science and Technology, Masdar Institute, P.O. Box 54224, Abu Dhabi, United Arab Emirates.
  • Tennom
    UVA Digital Himalaya Project, University of Virginia, Charlottesville, VA, 22904, USA.
  • Fatimah Ishowo-Oloko
    Khalifa University of Science and Technology, Masdar Institute, P.O. Box 54224, Abu Dhabi, United Arab Emirates.
  • Sherief Abdallah
    British University in Dubai, Dubai, United Arab Emirates.
  • Jean-François Bonnefon
    Toulouse School of Economics (TSM-Research), Centre National de la Recherche Scientifique, University of Toulouse Capitole, Toulouse, 31015, France.
  • Manuel Cebrian
    The Media Lab, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.
  • Azim Shariff
    Department of Psychology and Social Behavior, University of California, Irvine, CA, 92697, USA.
  • Michael A Goodrich
    Computer Science Department, Brigham Young University, 3361 TMCB, Provo, UT, 84602, USA.
  • Iyad Rahwan
    The Media Lab, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA. irahwan@mit.edu.