AN INFORMATION-ANALYTICAL METHODOLOGY FOR EVALUATING THE EFFECTIVENESS OF DIGITAL TOOL INTEGRATION INTO TEACHERS’ PROFESSIONAL PRACTICE
https://doi.org/10.53360/2788-7995-2026-3(23)-25
Abstract
The article presents a developed information-analytical methodology for the comprehensive evaluation of the effectiveness of integrating digital tools into teachers’ professional practice. The relevance of the study is determined by the need to move from descriptive self-assessment of digital competencies to formalized data analysis that enables the measurement of the practical application of recommendations and changes in professional practice over time. The methodological framework is based on the developed DTDC model, which comprises four levels: Awareness, Application, Integration and Visualization, and Design and Innovation. The initial dataset was generated from the results of a baseline survey involving 916 teachers. Based on these results, a set of differentiated recommendations was developed to enhance teachers’ skills in selecting, applying, integrating, and creating digital educational solutions. The recommendations were distributed to teachers for a 12-week practical pilot implementation. For subsequent evaluation, a system of normalized indicators was developed, covering familiarity with the recommendations, their practical application, regularity of use, changes in the DTDC level, and the perceived impact of digital tools on the quality of professional practice. The proposed algorithm involves collecting final survey data, coding responses, normalizing values, calculating component-specific DTDC indices, determining an integral index and implementation coefficients, and statistically testing the identified relationships. Scale reliability will be assessed using Cronbach’s 𝛼, while associations between categorical variables will be evaluated using Pearson’s chi-square test 𝜒2. The current outcome of the study is the development of a formalized methodology, a final survey instrument, and a procedure for information-analytical data processing. Final conclusions regarding the effectiveness of the recommendations will be formulated after the pilot implementation has been completed. The proposed approach ensures the reproducibility of the evaluation and provides a basis for automating the monitoring of digital tool integration into the educational process. The practical significance of the methodology lies in its potential use by educational organizations to compare the results of different groups of teachers, identify problematic components of digital practice, support managerial decision-making, and adjust professional development programmes based on quantitatively measurable longitudinal data.
About the Authors
A. K. ShaikhanovaKazakhstan
Aigul Shaikhanova – PhD, Professor of the Department of Information Security
10000 Kazakhstan, Astana city, 2 Satbaev st.
G. A. Shangytbayeva
Kazakhstan
Gulmira Shangytbayeva – PhD, Associate Professor of the Department of Informatics and Information Technologies
030000, Aktobe Region, the city of Aktobe, Astana district, Aliya Moldagulova Avenue, building 34
Competing Interests:
нет
G. B. Bekeshova
Kazakhstan
Gulvira Bekeshova – Master of Technical Sciences, Senior Lecturer at the Department of Information Security
10000 Kazakhstan, Astana city, 2 Satbaev st.
Competing Interests:
нет
Lili Nurliyana Abdullah
Malaysia
Lily Nurliana Abdullah – PhD, Associate Professor, Department of Multimedia, Faculty of Computer Science and Information Technology
Serdang, Selangor, Malaysia
Competing Interests:
нет
References
1. Teacher digital competence development in higher education: Overview of systematic reviews / M. Peters et al // Australasian Journal of Educational Technology. – 2022. – Vol. 38, № 3. – P. 122-139. https://doi.org/10.14742/ajet.7543.
2. Heine S. Digital resources as an aspect of teacher professional digital competence: One term, different definitions – a systematic review / S. Heine, M. Krepf, J. König // Education and Information Technologies. – 2023. – Vol. 28. – P. 3711-3738. https://doi.org/10.1007/s10639-022-11321-z.
3. Mattar J. DigComp-based digital competence assessment tools: Literature review and instrument analysis / J. Mattar, D.K. Ramos, M.R. Lucas // Education and Information Technologies. – 2022. – Vol. 27. – P. 10843-10867. https://doi.org/10.1007/s10639-022-11034-3.
4. Tzafilkou K. Assessing teachers’ digital competence in primary and secondary education: Applying a new instrument to integrate pedagogical and professional elements for digital education / K. Tzafilkou, M. Perifanou, A.A. Economides // Education and Information Technologies. – 2023. – Vol. 28. – P. 16017-16040. https://doi.org/10.1007/s10639-023-11848-9.
5. Cattaneo A.A.P. How digitalised are vocational teachers? Assessing digital competence in vocational education and looking at its underlying factors / A.A.P. Cattaneo, C. Antonietti, M. Rauseo // Computers & Education. – 2022. – Vol. 176. – Article 104358. https://doi.org/10.1016/j.compedu.2021.104358.
6. Systematic review of quantitative research on digital competences of in-service school teachers / M. Claro et al // Computers & Education. – 2024. – Vol. 215. – Article 105030. https://doi.org/10.1016/j.compedu.2024.105030.
7. Teachers’ AI digital competencies and twenty-first century skills in the post-pandemic world / D.T.K. Ng et al // Educational Technology Research and Development. – 2023. – Vol. 71. – P. 137-161. https://doi.org/10.1007/s11423-023-10203-6.
8. Artificial intelligence in K–12 education: Eliciting and reflecting on Swedish teachers’ understanding of AI and its implications for teaching and learning / J. Velander et al // Education and Information Technologies. – 2024. – Vol. 29. – P. 4085-4105. https://doi.org/10.1007/s10639-023-11990-4.
9. Tan X. Artificial intelligence in teaching and teacher professional development: A systematic review / X. Tan, G. Cheng, M.H. Ling // Computers and Education: Artificial Intelligence. – 2025. – Vol. 8. – Article 100355. https://doi.org/10.1016/j.caeai.2024.100355.
10. Peng R. Exploring the role of attitudes, self-efficacy, and digital competence in influencing teachers’ integration of ICT: A partial least squares structural equation modeling study / R. Peng, R.A. Razak, S.H. Halili // Heliyon. – 2024. – Vol. 10. – Article e34234. https://doi.org/10.1016/j.heliyon.2024.e34234.
11. Fostering Teachers’ Digital Competence in AI-Supported Learning Environments: Implications for Interactive Teaching and Student Achievement / G. Aimicheva et al // Appl. Sci. – 2025. – № 15. – 12597. https://doi.org/10.3390/app152312597.
12. Nguyen L.A.T. Tools for assessing teacher digital literacy: A review / L.A.T. Nguyen, A. Habók // Journal of Computers in Education. – 2024. – Vol. 11. – P. 305-346. https://doi.org/10.1007/s40692-022-00257-5.
Review
For citations:
Shaikhanova A.K., Shangytbayeva G.A., Bekeshova G.B., Abdullah L. AN INFORMATION-ANALYTICAL METHODOLOGY FOR EVALUATING THE EFFECTIVENESS OF DIGITAL TOOL INTEGRATION INTO TEACHERS’ PROFESSIONAL PRACTICE. Bulletin of Shakarim University. Technical Sciences. 2026;(3(23)):248-260. (In Russ.) https://doi.org/10.53360/2788-7995-2026-3(23)-25
JATS XML















