Simulation of human-vehicle interaction at right-turn unsignalized intersections: A game-theoretic deep maximum entropy inverse reinforcement learning method.

Journal: Accident; analysis and prevention
PMID:

Abstract

The safety of pedestrians in urban transportation systems has emerged as a significant research topic. As a vulnerable group within this transportation framework, pedestrians encounter heightened safety risks in complex urban road environments. Protecting this group and safeguarding their rights and interests in urban transportation has garnered attention from academia and industry. The objective of this study is to develop a reliable simulation model that represents pedestrian crossing behavior at unsignalized crosswalks. A data-driven human-vehicle interaction behavior modeling framework is proposed, describing the human-vehicle interaction process at right-turning unsignalized intersections as a standard Markov decision-making process. In this framework, pedestrians are treated as the primary agents, and human-vehicle interactions are described using game theory. The Deep Maximum Entropy Inverse Reinforcement Learning (DMIRL) approach, combined with game theory, is employed to identify a reward function that encapsulates these interactions. The Deep Q-network (DQN) algorithm is then designed to simulate pedestrian crossing behavior based on the derived reward function. Finally, a comparison with a baseline algorithm that does not account for the game dynamics validates the proposed framework's effectiveness and feasibility.

Authors

  • Wenli Li
    Institute of Karst Geology, CAGS/Key Laboratory of Karst Dynamics, MNR & GZAR/International Research Center on Karst Under the Auspices of UNESCO, Guilin, 541004, Guangxi, People's Republic of China.
  • Xianglong Li
    The Key Laboratory of Advanced Manufacturing Technology for Automobile Parts, Ministry of Education, Chongqing University of Technology, No. 69, Hongguang Avenue, Chongqing 400054, China.
  • Lingxi Li
    Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA. Electronic address: lingxili@purdue.edu.
  • Yuanhang Tang
    The Key Laboratory of Advanced Manufacturing Technology for Automobile Parts, Ministry of Education, Chongqing University of Technology, No. 69, Hongguang Avenue, Chongqing 400054, China.
  • Yuanzhi Hu
    The Key Laboratory of Advanced Manufacturing Technology for Automobile Parts, Ministry of Education, Chongqing University of Technology, No. 69, Hongguang Avenue, Chongqing 400054, China.