Progress in Driver Fatigue Detection Technology Based on Image and State Fusion

Authors

  • Boxiang Jia

DOI:

https://doi.org/10.61173/gf7wz259

Keywords:

Driver fatigue detection, multi-modal fusion, deep learning, autonomous driving safety

Abstract

Driver fatigue state detection represents one of the key technologies for enhancing road traffic safety. This paper systematically reviews the research progress, technical challenges, and development trends of driver fatigue detection methods based on the fusion of visual images and vehicle state information. First, it provides a detailed analysis of the theoretical foundations, implementation mechanisms, and performance characteristics of three categories of methods: those based on visual physiological features, driving behavior features, and multi-modal information fusion, tracing the technological evolution from traditional methods to deep learning models. Second, it delves into three core challenges currently faced by these systems in practical applications: environmental robustness, real-time constraints, and individual generalization ability. On this basis, the paper critically reviews the effectiveness and limitations of cutting-edge technical solutions such as lightweight network architectures, selfsupervised learning, and personalized federated learning. Finally, it outlines future research directions including multi-modal large models, vehicle-road cooperative perception, and neuromorphic computing, while also discussing opportunities and challenges related to technical standardization and system integration. This review aims to provide researchers and engineering practitioners with a systematic technical reference and insights for further development.

References

[1] Clark M. Multimodal fusion-based analysis and detection [14] Zhou Yuxiao, Guo Zhishan, Dong Zheng, et al. TensorRT of fatigue driving. Journal of Computer Science and Software implementations of model quantization on edge SoC. In: Applications, 2024, 4(4): 34-40. Proceedings of the 2023 IEEE 16th International Symposium on

[2] Guo Hanying, Zhang Yuhao, Cai Shanshan, Chen Xin. Embedded Multicore/Many-core Systems-on-Chip (MCSoC). Effects of Level 3 Automated Vehicle Drivers’ Fatigue on Their IEEE, 2023: 486-493. Take-Over Behaviour: A Literature Review. Journal of Advanced [15] Qin Yiwen, Lai xing, Gao Guiqing, et al. Failure analysis Transportation, 2021, 2021(1): 8632685. and countermeasures of a tunnel constructed in loose granular

[3] Ye Ziheng. A joint improved DETR network face recognition stratum by shallow tunnelling method. Engineering Failure algorithm based on TSM module and DANN. In: Proceedings of Analysis, 2022, 141: 106667. the 2023 4th International Conference on Computing, Networks [16] Barcellos P, Gomes V, Scharcanski J. Shadow detection in and Internet of Things. 2023: 759-764. camera-based vehicle detection: survey and analysis. Journal of

[4] Park S, Schöps T, Pollefeys M. Illumination change Electronic Imaging, 2016, 25(5): 051205-051205. robustness in direct visual slam. In: Proceedings of the 2017 [17] Karumbunathan L S. Nvidia jetson agx orin series: a giant IEEE International Conference on Robotics and Automation leap forward for robotics and edge AI applications. Technical (ICRA). IEEE, 2017: 4523-4530. Brief, 2022.

[5] Tatler B W, Vincent B T. The prominence of behavioural [18] Netzer G, Johnsson L, Ahlin D, et al. Instrumentation biases in eye guidance. Visual Cognition, 2009, 17(6-7): 1029- for accurate energy-to-solution measurements of a Texas 1054. Instruments TMS320C6678 digital signal processor and its

[6] Reuther A, Michaleas P, Jones M, Gadepally V, Samsi S, DDR3 memory. In: Proceedings of the 2014 Energy Efficient Kepner J. AI accelerator survey and trends. In: Proceedings Supercomputing Workshop. IEEE, 2014: 89-98. of the 2021 IEEE High Performance Extreme Computing [19] Gallego G, Delbrück T, Orchard G, et al. Event-based Conference (HPEC). IEEE, 2021: 1-9. vision: a survey. IEEE Transactions on Pattern Analysis and

[7] Zhao Rui, Li Yun, Gao Fei, Gao Zhenhai, Zhang Tianyao. Machine Intelligence, 2020, 44(1): 154-180. Multi-agent constrained policy optimization for conflict-free [20] Flamme G A, Deiters K, Needham T. Distributions of puremanagement of connected autonomous vehicles at unsignalized tone hearing threshold levels among adolescents and adults in intersections. IEEE Transactions on Intelligent Transportation the United States by gender, ethnicity, and age: Results from Systems, 2023, 25(6): 5374-5388. the US National Health and Nutrition Examination Survey.

[8] Ouyang Zhenchao, Niu Jianwei, Guizani Mohsen. Improved International Journal of Audiology, 2011, 50(1): S11-S20. vehicle steering pattern recognition by using selected sensor [21] Mileti I, Taborri J, Rossi S, et al. Reactive postural data. IEEE Transactions on Mobile Computing, 2017, 17(6): responses to continuous yaw perturbations in healthy humans: 1383-1396. the effect of aging. Sensors, 2019, 20(1): 63.

[9] Skorucak J, Hertig-Godeschalk A, Schreier D R, Malafeev

Downloads

Published

2026-04-24