4-санға «Автоматтандыру және ақпараттық технологиялар», «Азық-түлік инженериясы және биотехнология», сондай-ақ «Химиялық технология» бағыттары бойынша мақалалар қабылдау жабылды.

Приём статей в четвёртый номер по направлениям «Автоматизация и информационные технологии», «Пищевая инженерия и биотехнология», а также «Химическая технология» закрыт.

Submissions for the fourth issue in the fields of Automation and Information Technology, Food Engineering and Biotechnology, as well as Chemical Technology, are now closed.

Preview

Bulletin of Shakarim University. Technical Sciences

Bulletin of Shakarim University. Technical Sciences

Advanced search

DEVELOPMENT OF A MODEL OF KAZAKH SIGN LANGUAGE FOR CLOSED-SET PHRASE RECOGNITION AND TRAINING

https://doi.org/10.53360/2788-7995-2026-3(23)-8

Abstract

Kazakh Sign Language (KSL) remains underrepresented in current sign language processing research due to a lack of large, annotated datasets and specialized computational tools. This paper presents a deep learning-based framework for phrase-level recognition of sign language using visual keypoint sequences, in which each recognized phrase is mapped to its gloss label and a verified reference translation in Russian. The approach employs the FluentSigners-50 dataset as a benchmark corpus and extracts pose and hand landmarks from video data using the MediaPipe Holistic model. A two-layer bidirectional long shortterm memory (BiLSTM) network is trained on the resulting spatiotemporal sequences to classify forty distinct KSL phrases. The model takes as input a fixed-length sequence of 150 frames, each containing 225 keypoint features, and outputs a predicted phrase class through a multilayer perceptron. Experimental results demonstrate strong performance in phrase classification, with accurate mappings from video to gloss labels and their corresponding Russian translations, achieving an accuracy of 94.73%. Rather than performing openvocabulary machine translation, the system addresses closed-set phrase classification with gloss and reference-translation lookup, making it suitable for structured assistive and training applications in sign language learning environments.

About the Authors

A. Zhakanova
Astana IT University
Kazakhstan

Assem Zhakanova – first year master’s student

010000, Republic of Kazakhstan, Astana, 55/11 Mangilik El avenue, C1 block



Zh. Oralbekova
Astana IT University
Kazakhstan

Zhanar Oralbekova – PhD, associate professor, acting Professor of the School of AI and Data Science

010000, Republic of Kazakhstan, Astana, 55/11 Mangilik El avenue, C1 block



D. Oralbekova
Institute of Information and Computational Technologies
Kazakhstan

Dina Oralbekova – PhD, associate professor, Senior Researcher

050010, Republic of Kazakhstan, Almaty, 28 Shevchenko street



References

1. Aitim A. A systematic review on translating Kazakh sign language to speech using dynamic gesture recognition / A. Aitim, D. Sattarkhuzhayeva, A. Khairullayeva // The Bulletin of KazATC. – 2025. – Т. 138, № 3. – Р. 122-133. https://doi.org/10.52167/1609-1817-2025-138-3-122-133.

2. Creating a Parallel Corpus for the Kazakh Sign Language and Learning / A. Yerimbetova et al // Applied Sciences. – 2025. – Т. 15, № 5. – Р. 2808. https://doi.org/10.3390/app15052808.

3. Advancements in Machine Learning Techniques for Hand Gesture-Based Sign Language Recognition: A Comprehensive Review / U. Rastogi et al // Archives of Computational Methods in Engineering. – 2025. – Т. 32, № 7. – Р. 4265-4302. https://doi.org/10.1007/s11831-025-10258-z.

4. Almjally A., Almukadi W.S. Deep computer vision with artificial intelligence based sign language recognition to assist hearing and speech-impaired individuals / A. Almjally, W.S. Almukadi // Scientific Reports. – 2025. – Т. 15, № 1. – Р. 32268. https://doi.org/10.1038/s41598-025-09106-8.

5. Deep learning pathways for automatic sign language processing / M. Toshpulatov et al // Pattern Recognition. – 2025. – Т. 164. – Р. 111475. https://doi.org/10.1016/j.patcog.2025.111475.

6. Luqman H. SignVLM: a pre-trained large video model for sign language recognition / H. Luqman // PeerJ Computer Science. – 2025. – Т. 11. – Р. e3112. https://doi.org/10.7717/peerj-cs.3112.

7. Enhancing Kazakh Sign Language Recognition with BiLSTM Using YOLO Keypoints and Optical Flow / Z. Buribayev et al // Applied Sciences. – 2025. – Т. 15, № 10. – Р. 5685. https://doi.org/10.3390/app15105685.

8. Application of neural networks ensemble method for the Kazakh sign language recognition / Y. Amirgaliyev et al // Bulletin of Electrical Engineering and Informatics. – 2024. – Т. 13, № 5. – Р. 3275-3287. https://doi.org/10.11591/eei.v13i5.7803.

9. Real-time Kazakh sign language recognition using Mediapipe and SVM / L. Zholshiyeva et al // Academic Scientific Journal of Computer Science. – 2023. – № 1. – Р. 82-93. https://doi.org/10.32014/2023.2518-1726.170.

10. FluentSigners-50: A signer independent benchmark dataset for sign language processing / M. Mukushev et al // PloS ONE. – 2022. – Т. 17, № 9. – Р. e0273649. https://doi.org/10.1371/journal.pone.0273649.

11. Continuous sign language recognition and its translation into intonation-colored speech / N. Amangeldy et al // Sensors. – 2023. – Т. 23, № 14. – Р. 6383. https://doi.org/10.3390/s23146383.

12. Neural Sign Language Translation / N.C. Camgoz et al // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). – Salt Lake City, USA, 2018. – Р. 7784-7793. https://doi.org/10.1109/CVPR.2018.00812.


Review

For citations:


Zhakanova A., Oralbekova Zh., Oralbekova D. DEVELOPMENT OF A MODEL OF KAZAKH SIGN LANGUAGE FOR CLOSED-SET PHRASE RECOGNITION AND TRAINING. Bulletin of Shakarim University. Technical Sciences. 2026;(3(23)):73-82. https://doi.org/10.53360/2788-7995-2026-3(23)-8

Views: 23

JATS XML


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.


ISSN 2788-7995 (Print)
ISSN 3006-0524 (Online)
X