A Deep Neural Framework for Continuous Sign Language Recognition via Iterative Training

Authors

  • YITONG CAI

DOI:

https://doi.org/10.61173/2hpmfy05

Keywords:

Gesture Recognition, Similarity Fusion, Relevant Feature Recognition, Cross-language gesture, Continuous Sign Language Recognition

Abstract

Sign language is a visual language that uses a variety of hand gesture combinations to express distinct ideas. It acts as a bridge to communicate with the outside world and is a vital communication tool for the deaf and mute community. Recent years have seen a fast increase in computer technology, opening up new avenues for research on sign language recognition through developments in computer graphics, computer vision, neural networks, and associated hardware. However, many sign language movements are still hard to tell apart because of the intrinsic constraints of visual component combinations. Natural language can be incorporated to help with the recognition process in order to overcome this difficulty. This review study highlights the benefits and drawbacks of modern approaches to sign language recognition in terms of recording, identifying, translating, and depicting motions. The primary difficulties in the field of sign language technology are also covered, along with the introduction of a number of useful applications. In order to encourage and support additional achievements in this field, future research directions and possible developments are finally suggested.

References

[1] Joksimoski B, Zdravevski E, Lameski P, et al. Technological [12] Papastratis I, Chatzikonstantinou C, Konstantinidis D, et al. solutions for sign language recognition: a scoping review of Artificial intelligence technologies for sign language. Sensors, research trends, challenges, and opportunities. IEEE Access, 2021, 21(17): 5843. 2022, 10: 40979-40998. [13] Abduljabbar M, et al. A cloud-based 3D digital twin for

[2] Lee C K M, Ng K K H, Chen C H, et al. American sign Arabic sign language alphabet using machine learning object language recognition and training method with recurrent neural detection model. 2023 15th International Conference on network. Expert Systems with Applications, 2021, 167: 114403. Innovations in Information Technology (IIT). IEEE, 2023.

[3] Aloysius N, Geetha M. Understanding vision-based [14] Patil A, Kulkarni A, Yesane H, et al. Literature survey: continuous sign language recognition. Multimedia Tools and sign language recognition using gesture recognition and Applications, 2020, 79(31): 22177-22209. natural language processing. Data Management, Analytics and

[4] WHO, 26 February 2025, Deafness and hearing loss. https:// Innovation: Proceedings of ICDMAI 2021, Volume 1, 2021: www.who.int/news-room/fact-sheets/detail/deafness-and- 197-210. hearing-loss [15] Okelo B K, Mbuguah S M. Discoverability: a new

[5] Madhiarasan M, Roy P P. A comprehensive review of sign learnability principle for children’s application software. 2016. language recognition: Different types, modalities, and datasets. [16] Zuo R, Wei F, Mak B. Natural language-assisted sign arXiv preprint arXiv:2204.03328, 2022. language recognition. Proceedings of the IEEE/CVF Conference

[6] Wadhawan A, Kumar P. Sign language recognition on Computer Vision and Pattern Recognition, 2023: 14890- systems: A decade systematic literature review. Archives of 14900. Computational Methods in Engineering, 2021, 28(3): 785-813. [17] Hu L, Gao L, Liu Z, et al. Continuous sign language

[7] Adaloglou N, Chatzis T, Papastratis I, et al. A comprehensive recognition with correlation network. Proceedings of the IEEE/ study on deep learning-based methods for sign language CVF Conference on Computer Vision and Pattern Recognition, recognition. IEEE Transactions on Multimedia, 2021, 24: 1750- 2023: 2529-2539. 1762. [18] Wei F, Chen Y. Improving continuous sign language

[8] Al-Qurishi M, Khalid T, Souissi R. Deep learning for sign recognition with cross-lingual signs. Proceedings of the IEEE/ language recognition: Current techniques, benchmarks, and open CVF International Conference on Computer Vision, 2023: issues. IEEE Access, 2021, 9: 126917-126951. 23612-23621.

[9] Hao A, Min Y, Chen X. Self-mutual distillation learning [19] Min Y, Hao A, Chai X, et al. Visual alignment constraint for continuous sign language recognition. Proceedings of the for continuous sign language recognition. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021: IEEE/CVF International Conference on Computer Vision, 2021: 11303-11312. 11542-11551.

Downloads

Published

2025-12-19