Research Progress on the Effectiveness of Deep Learning-Based Driver Fatigue Fusion Features

Authors

  • Bite Qiu

DOI:

https://doi.org/10.61173/zaa78294

Keywords:

Deep Learning, fatigue driving, feature fusion

Abstract

In modern society, automobiles are more popular around the world, and people pay more attention to the safety of automobiles According to the information provided by the National Transportation Safety Administration in 2024, there are many traffic accidents caused by fatigue driving. This paper introduces two fatigue recognition methods, and studies the fusion of the two types of features. Aiming at the problem that the existing facial recognition methods are sensitive to environmental interference, this study systematically reviews the application of deep learning models such as YOLO, RNN and ResNet3D in this field from the perspective of facial feature analysis, and proposes targeted optimization strategies. For the problem of strong invasiveness and limited comfort in traditional physiological monitoring methods, this study innovatively constructs a multi-modal feature fusion framework. By collaboratively analyzing facial features and physiological signals, it can effectively balance the accuracy and comfort of monitoring while maintaining the advantages of non-contact detection. At the end of the article, the fusion mechanism of facial information recognition and physiological information recognition is further discussed. The fusion mechanism gives full play to the complementary advantages of the two types of information, and effectively reduces the adverse effects of single information recognition on driving behavior. As mentioned above, this paper analyzes a fatigue recognition method that combines facial information recognition with physiological information recognition. In other literatures, it is also mentioned that this scheme has the advantages of portability and accuracy compared with the traditional fatigue identification method.

References

[1] Zhang Zhenli, Li Liang, Song Jingjing, et al. Research on Driver Fatigue Detection Based on Deep Learning. Mechanical & Electrical Engineering Technology, 2024, 53(01): 193-197.

[2] Hu H N, Cai Q Z, Wang D Q, et al. Joint Monocular 3D Vehicle Detection and Tracking. Computing Research Repository, 2019: 5389-5398.

[3] Kyushu U,Tanaka K, Yamamoto T, et al. Efficient vehicle detection and tracking strategy in aerial videos by employing morphological operations and feature points motion analysis. Multimedia Tools and Applications, 2020, 79(35): 26023-26043.

[4] Chen Peng, Wang Tong, Zheng Nan. Reconstructing Vehicle Trajectories on Freeways Based on Motion Detection Data of Connected and Automated Vehicles. Journal of Intelligent Transportation Systems, 2021, 26: 639-654.

[5] Shu Liangjun, Ding Fei, Wang Bingkun, et al. Mobile Target Detection with an Integrated Attention Mechanism and Lightweight Feature Fusion Network. Flight Control & Detection, Aarly access, Oct. 2025.

[6] Yao Yining. Research on Driver Fatigue Recognition Based on Mouth and Eye Movement. Xi’an: Xi’an Technological University, 2022.

[7] Zhou You. Research and Implementation of a Cognitive Fatigue Recognition System Based on Multimodal Feature Fusion. Nanjing: Nanjing Forestry University, 2024.

[8] Xue Huixia. Research on Driver Steering Intention Recognition by Integrating Internal and External Cockpit Features. Chongqing: Chongqing University of Technology, 2025.

[9] Dong Yan-jiao, Han Yuan-jie, Liu Jie-li. A Target Identification Method Based on Information Fusion of GNN-DS. Guilin University of Electronic Technology, 2009, 25(22): 193- 194+172.

[10] Han Xiangyu. Research on Fatigue Recognition of Operators Based on Fusion of Multiple Eyelid Features. Hengyang: University of South China, 2023.

Downloads

Published

2025-12-19