Research on fatigue detection of flight trainees based on face EMF feature model combination with PSO-CNN algorithm.

Journal: Scientific reports
PMID:

Abstract

Even though the capability of aircraft manufacturing has improved, human factors still play a pivotal role in flight accidents. For example, fatigue-related accidents are a common factor in human-led accidents. Hence, pilots' precise fatigue detections could help increase the flight safety of airplanes. The article suggests a model to recognize fatigue by implementing the convolutional neural network (CNN) by implementing flight trainees' face attributions. First, the flight trainees' face attributions are derived by a method called the land-air call process when the flight simulation is run. Then, sixty-eight points of face attributions are detected by employing the Dlib package. Fatigue attribution points were derived based on the face attribution points to construct a model called EMF to detect face fatigue. Finally, the proposed PSO-CNN algorithm is implemented to learn and train the dataset, and the network algorithm achieves a recognition ratio of 93.9% on the test set, which can efficiently pinpoint the flight trainees' fatigue level. Also, the reliability of the proposed algorithm is validated by comparing two machine learning models.

Authors

  • Lei Shang
    Department of Health Statistics, School of Preventive Medicine, Fourth Military Medical University, Xi'an, China.
  • Haiqing Si
    College of General Aviation and Flight, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, People's Republic of China.
  • Haibo Wang
    Institute of Cardiovascular Diseases, Shanghai Jiao Tong University School of Medicine, 197 Ruijin 2nd Road, Shanghai, 200025, PR China.
  • Ting Pan
    College of Engineering, Huaqiao University, Quanzhou 362021, China.
  • Haibo Liu
    Department of Thoracic Surgery, Peking University First Hospital, Beijing, China.
  • Yixuan Li
    College of Information, Shanxi University of Fiance and Economics, China.
  • Jingxuan Qiu
    School of Medical Instrument and Food Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China.
  • Mengyue Xu
    University of Toronto, Ontario, Mississauga L5L1C6, Canada.