Preview

Bulletin of Shakarim University. Technical Sciences

Advanced search

NEURAL NETWORK METHODS FOR ANALYZING TEXT FEEDBACK FROM STUDENTS: ARCHITECTURE, LEARNING, AND INTERPRETATION OF RESULTS

https://doi.org/10.53360/2788-7995-2025-4(20)-3

Abstract

This article presents a comparative analysis of neural network architectures LSTM, BiLSTM, and RuBERT applied to the automatic classification of student feedback. Particular attention is paid to data preprocessing, manual annotation with consideration of sentiment and thematic aspects, as well as corpus reliability assessment using Cohen’s kappa coefficient (0.82). The experimental results show that RuBERT achieves the highest Accuracy (0.87) and F1-score (0.85), which is statistically confirmed by t-test results. At the same time, BiLSTM demonstrates higher efficiency compared to LSTM due to its ability to capture bidirectional context. Error analysis revealed that recurrent models most often confuse neutral and negative feedback, while the transformer-based architecture performs better in handling ambiguous expressions and subtle emotional nuances. The practical significance of the study lies in the possibility of integrating the proposed approach into LMS and digital educational platforms to automate the analysis of student feedback. Future research directions include expanding the corpus with Kazakh-language texts and applying advanced Transformer-based models (RoBERTa, DeBERTa, ChatGLM).

About the Authors

O. S. Saltykova
Kostanay Regional University named after Akhmet Baitursynuly
Kazakhstan

Olga Salykova – сandidate of technical sciences, associate professor of the Department of Software Engineering

110000, Republic of Kazakhstan, Kostanay, 47 A. Baitursynova street 



A. A. Artykbayeva
Kostanay Regional University named after Akhmet Baitursynuly
Kazakhstan

Assel Artykbayeva – doctoral student of the department of Software Engineering

110000, Republic of Kazakhstan, Kostanay, 47 A. Baitursynova street 


Competing Interests:

.



A. M. Iskakova
Kostanay Regional University named after Akhmet Baitursynuly
Kazakhstan

Almira Iskakova – doctoral student of the department of Software Engineering

110000, Republic of Kazakhstan, Kostanay, 47 A. Baitursynova street



L. I. Nurmagambetova
Kostanay Engineering and Economics University named after Myrzhakyp Dulatov
Kazakhstan

Lyailya Nurmagambetova – сandidate of еconomic sciences, associate professor, associate professor of the Department of Socio-economic disciplines

110000, Republic of Kazakhstan, Kostanay, 59 Chernyshevsky street 



References

1. Vasnetsova E.L. Primenenie metodov analiza tonal'nosti v obrazovatel'noi srede / E.L. Vasnetsova, D.A. Semenov // Obrazovatel'nye tekhnologii i obshchestvo. – 2021. – № 24(1). – S.105-116. (In Russian).

2. Efficient estimation of word representations in vector space / T. Mikolov et al // arXiv preprint arXiv:1301.3781, 2013. (In English).

3. Cortes C. Support-vector networks / C. Cortes, V. Vapnik // Machine Learning. – 1995. – № 20(3). – R. 273-297. (In English).

4. Schuster M.K. Bidirectional recurrent neural networks / M. Schuster, K.K. Paliwal // IEEE Transactions on Signal Processing. – 1997. – № 45(11). – R. 2673-2681. (In English).

5. Hochreiter S. Long short-term memory / S. Hochreiter, J. Schmidhuber // Neural Computation. – 1997. – № 9(8). – R. 1735-1780. (In English).

6. RoBERTa – BiLSTM: A Context – Aware Hybri Model for Sentiment Analysis / Rahman M.M. et al // arXiv preprint arXiv:2406.00367. – 2024. https://doi.org/10.48550/arXiv.2406.00367. (In English).

7. BERT: Pre-training of deep bidirectional transformers for language understanding / J. Devlin et al // Proceedings of NAACL-HLT. – 2019. – R. 4171-4186. (In English).

8. RoBERTa: A robustly optimized BERT pretraining approach / Y. Liu et al // arXiv preprint arXiv:1907. – 2019. – R. 11692. (In English).

9. Lin F. Sentiment analysis in online education: An analytical approach and application / F. Lin // Proceedings of the International Conference on Machine Learning and Automation. – 2024. (In English).

10. An improved neural network model for sentiment analysis in online education / V. Xu et al // Journal of Intelligent & Fuzzy Systems. – 2020. – № 38(3). – R. 3651-3662. (In English).

11. Elevating educational insights: Sentiment analysis of faculty feedback using advanced machine learning models / S.B. Deshpande et al // Advances in Continuous and Discrete Models. – 2025. (In English).

12. Zhang W. Comparative evaluation of Transformer-based models for multilingual sentiment analysis / W. Zhang, L. Xu, J. Wang // Journal of Artificial Intelligence Research. – 2024. – № 71. – R. 55-72. (In English).

13. Xu R. Advances in DeBERTa for educational text mining / R. Xu, H. Chen, Z. Huang // Computers & Education. – 2025. – № 198. – R. 104719. (In English).

14. Li X. Sentiment analysis in educational contexts: Comparing LSTM and BiLSTM approaches / X. Li, Y. Zhang, H. Zhao // Education and Information Technologies. – 2023. – № 28(2). – R. 213-229. (In English).


Review

For citations:


Saltykova O.S., Artykbayeva A.A., Iskakova A.M., Nurmagambetova L.I. NEURAL NETWORK METHODS FOR ANALYZING TEXT FEEDBACK FROM STUDENTS: ARCHITECTURE, LEARNING, AND INTERPRETATION OF RESULTS. Bulletin of Shakarim University. Technical Sciences. 2025;1(4(20)):24-31. (In Russ.) https://doi.org/10.53360/2788-7995-2025-4(20)-3

Views: 147

JATS XML


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.


ISSN 2788-7995 (Print)
ISSN 3006-0524 (Online)
X