Neurophysiological mental fatigue assessment for developing user-centered Artificial Intelligence as a solution for autonomous driving.

Journal: Frontiers in neurorobotics
Published Date:

Abstract

The human factor plays a key role in the automotive field since most accidents are due to drivers' unsafe and risky behaviors. The industry is now pursuing two main solutions to deal with this concern: in the short term, there is the development of systems monitoring drivers' psychophysical states, such as inattention and fatigue, and in the medium-long term, there is the development of fully autonomous driving. This second solution is promoted by recent technological progress in terms of Artificial Intelligence and sensing systems aimed at making vehicles more and more accurately aware of their "surroundings." However, even with an autonomous vehicle, the driver should be able to take control of the vehicle when needed, especially during the current transition from the lower (SAE < 3) to the highest level (SAE = 5) of autonomous driving. In this scenario, the vehicle has to be aware not only of its "surroundings" but also of the driver's psychophysical state, i.e., a user-centered Artificial Intelligence. The neurophysiological approach is one the most effective in detecting improper mental states. This is particularly true if considering that the more automatic the driving will be, the less available the vehicular data related to the driver's driving style. The present study aimed at employing a holistic approach, considering simultaneously several neurophysiological parameters, in particular, electroencephalographic, electrooculographic, photopletismographic, and electrodermal activity data to assess the driver's mental fatigue in real time and to detect the onset of fatigue increasing. This would ideally work as an information/trigger channel for the vehicle AI. In all, 26 professional drivers were engaged in a 45-min-lasting realistic driving task in simulated conditions, during which the previously listed biosignals were recorded. Behavioral (reaction times) and subjective measures were also collected to validate the experimental design and to support the neurophysiological results discussion. Results showed that the most sensitive and timely parameters were those related to brain activity. To a lesser extent, those related to ocular parameters were also sensitive to the onset of mental fatigue, but with a delayed effect. The other investigated parameters did not significantly change during the experimental session.

Authors

  • Andrea Giorgi
    Department of Anatomical, Histological, Forensic and Orthopaedic Sciences, Sapienza University of Rome, Rome, Italy.
  • Vincenzo Ronca
    BrainSigns SRL, Rome, Italy.
  • Alessia Vozzi
    Department of Anatomical, Histological, Forensic and Orthopaedic Sciences, Sapienza University of Rome, Rome, Italy.
  • Pietro Aricò
    BrainSigns SRL, Rome, Italy.
  • Gianluca Borghini
    BrainSigns SRL, Rome, Italy.
  • Rossella Capotorto
    Department of Computer, Control, and Management Engineering, Sapienza University of Rome, Rome, Italy.
  • Luca Tamborra
    BrainSigns SRL, Rome, Italy.
  • Ilaria Simonetti
    BrainSigns SRL, Rome, Italy.
  • Simone Sportiello
    Department of Civil Engineering, Computer Science and Aeronautical Technologies, Roma Tre University, Rome, Italy.
  • Marco Petrelli
    Department of Civil Engineering, Computer Science and Aeronautical Technologies, Roma Tre University, Rome, Italy.
  • Carlo Polidori
    Italian Association of Road Safety Professionals (AIPSS), Rome, Italy.
  • Rodrigo Varga
    Instituto Tecnologico de Castilla y Leon, Burgos, Spain.
  • Marteyn van Gasteren
    Instituto Tecnologico de Castilla y Leon, Burgos, Spain.
  • Arnab Barua
    Academy for Innovation, Design and Technology, Mälardalens University, Västerås, Sweden.
  • Mobyen Uddin Ahmed
    Academy for Innovation, Design and Technology, Mälardalens University, Västerås, Sweden.
  • Fabio Babiloni
    BrainSigns SRL, Rome, Italy.
  • Gianluca Di Flumeri
    BrainSigns SRL, Rome, Italy.

Keywords

No keywords available for this article.