Deep mechanism design: Learning social and economic policies for human benefit.

Journal: Proceedings of the National Academy of Sciences of the United States of America
Published Date:

Abstract

Human society is coordinated by mechanisms that control how prices are agreed, taxes are set, and electoral votes are tallied. The design of robust and effective mechanisms for human benefit is a core problem in the social, economic, and political sciences. Here, we discuss the recent application of modern tools from AI research, including deep neural networks trained with reinforcement learning (RL), to create more desirable mechanisms for people. We review the application of machine learning to design effective auctions, learn optimal tax policies, and discover redistribution policies that win the popular vote among human users. We discuss the challenge of accurately modeling human preferences and the problem of aligning a mechanism to the wishes of a potentially diverse group. We highlight the importance of ensuring that research into "deep mechanism design" is conducted safely and ethically.

Authors

  • Andrea Tacchetti
    Deepmind, London, UK.
  • Raphael Koster
    Deepmind, London, UK.
  • Jan Balaguer
    Deepmind, London, UK.
  • Liu Leqi
    Princeton Language and Intelligence, Princeton University, Princeton, NJ 08544.
  • Miruna Pîslar
    Google DeepMind, London, UK. mirunapislar@google.com.
  • Matthew M Botvinick
    Google DeepMind, London EC4A 3TW, UK.
  • Karl Tuyls
    DeepMind Technologies Ltd., London, UK.
  • David C Parkes
    Harvard John A. Paulson School of Engineering and Applied Sciences, Harvard University, 33 Oxford Street, Cambridge MA 02138, USA. parkes@eecs.harvard.edu wellman@umich.edu.
  • Christopher Summerfield
    DeepMind, 5 New Street Square, London, UK; Department of Experimental Psychology, University of Oxford, Oxford, UK.