HYBRID RELIABILITY ASSESSMENT OF INFORMATION SYSTEMS USING ISO/IEC 25010:2023, MCDM, AND MACHINE LEARNING

The reliability of information systems is a key prerequisite for the stable operation of modern digital services, especially under high-load conditions and rapidly evolving digitalization processes. Most traditional approaches rely on individual indicators or subjective expert judgments, which limits the transparency of the results obtained. This paper proposes a hybrid methodology that integrates the ISO/IEC 25010:2023 quality model, multicriteria decision-making methods (ARAS, CoCoSo, TOPSIS), and machine learning techniques for imputing missing data. The ISO/IEC 25010:2023 standard is used to define the structure of reliability-related quality attributes and to select appropriate indicators. The AHP method enables a systematic determination of criterion weights based on expert judgments. Missing values in the dataset are restored using a machine learning algorithm, resulting in a complete and consistent data matrix. After data preparation, the reliability of alternative information systems is evaluated using three multicriteria methods. This increases the robustness of the final ranking and reduces its sensitivity to changes in weighting coefficients. The proposed methodology was tested on four real-world information systems with different architectures. A high degree of consistency was observed among the applied methods; the rankings remained stable even when weights were varied by ±10%, and the feasibility of expressing reliability as a percentage was confirmed. This approach enables objective system comparison, identification of weaknesses, and informed decision-making for system improvement and modernization.

1. Advanced risk management software for multi-criteria decision-making in uncertain scenarios / S. Carpitella et al // Computational and Applied Mathematics. – 2025. – vol. 44, art. № 379. https://doi.org/10.1007/s40314-025-03338-0.

2. Tworek K. Reliability of information systems in organization in the context of banking sector: Empirical study from Poland / K. Tworek // Cogent Business & Management. – 2018. – vol. 5, № 1. https://doi.org/10.1080/23311975.2018.1522752.

3. Dubey S. Reliability assessment of component-based software systems using fuzzy and ANFIS techniques / S. Dubey, J. Bhat // International Journal of Systems Assurance Engineering and Management. – 2017. – vol. 8, № 6. https://doi.org/10.1007/s13198-017-0602-z.

4. Foidl H. Integrating software quality models into risk-based testing / H. Foidl, M. Felderer // Software Quality Journal. – 2018. – vol. 26, № 2. https://doi.org/10.1007/s11219-016-9345-3.

5. Thakkar N. Data driven MCDM models for reliability-economic-environmental analysis of energy storage based autonomous micro-grid / N. Thakkar, P. Paliwal // Journal of Energy Storage. – 2024. – vol. 81, art. № 110408. https://doi.org/10.1016/j.est.2023.110408.

6. ISO/IEC, ISO/IEC 25010:2023 – Systems and Software Engineering – Systems and Software Quality Requirements and Evaluation (SQuaRE) – Product Quality Model. Geneva, Switzerland: International Organization for Standardization, 2023.

7. Tamura Y. Reliability modeling and analysis for open source cloud computing / Y. Tamura, M. Kawakami, S. Yamada // Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability. – 2013. – vol. 227, № 2. – Р. 179-186. https://doi.org/10.1177/1748006X12475110.

8. ISO/IEC 9126 quality model for evaluation of student academic portal / Е. Budiman et al // Proceeding of the Electrical Engineering Computer Science and Informatics. – 2018. – vol. 5, № 5. https://doi.org/10.11591/eecsi.v5i5.1670.

9. Sun L. A hybrid MCDM approach for evaluating financial performance based on a set of business companies / L. Sun, H. Zheng // Neutrosophic Sets and Systems. – 2025. – vol. 79. Р. 1-12. https://digitalrepository.unm.edu/nss_journal/vol79/iss1/46.

10. Büyüközkan G. Spherical fuzzy sets based integrated DEMATEL, ANP, VIKOR approach and its application for renewable energy selection in Turkey / G. Büyüközkan, Y. Karabulut, F. Göçer // Applied Soft Computing. – 2024. – vol. 158, art. № 111465. https://doi.org/10.1016/j.asoc.2024.111465.

11. Etraj P. An integrated DEMATEL and AHP approach for multi-criteria green supplier selection process in public procurement / P. Etraj, J. Jayaprakash // International Journal of Engineering and Technology. – 2017. – vol. 9, № 1. – Р. 113-124. https://doi.org/10.21817/ijet/2017/v9i1/170901414.

12. An integrated fuzzy-AHP and TOPSIS approach for maintenance policy selection / N. Hemmati et al // International Journal of Quality & Reliability Management, 2019. https://doi.org/10.1108/IJQRM-10-2018-0283.

13. Ortíz M.A. A contrast between DEMATEL-ANP and ANP methods for Six Sigma project selection: A case study in the healthcare industry / M.A. Ortíz, H.A. Felizzola, I.S. Nieto // Multidimensional, Multidiscipline and Shared Decision Making in Healthcare and eHealth. – 2021. – vol. 15, suppl. 3. – Р. 1-10. https://doi.org/10.1186/1472-6947-15-S3-S3.

14. Mardani A. Fuzzy multiple criteria decision-making techniques and applications – two decades review from 1994 to 2014 / A. Mardani, A. Jusoh, E.K. Zavadskas // Expert Systems with Applications. – 2015. – vol. 42, № 8. – Р. 4126-4148. https://doi.org/10.1016/j.eswa.2015.01.003.

15. Hybrid multiple-criteria decision-making methods: A review of applications in engineering / E.K. Zavadskas et al // Scientia Iranica. – 2016. – vol. 23, № 1. – Р. 1-20. https://doi.org/10.24200/sci.2016.2093.

16. Grote T. Reliability in machine learning / T. Grote, K. Genin, E. Sullivan // Philosophy Compass. – 2024. – vol. 19, № 5. https://doi.org/10.1111/phc3.12974.

17. Kumar N. Vehicle accident sub-classification modeling using stacked generalization: A multisensor fusion approach / N. Kumar, D. Lohani, D. Acharya // Future Generation Computer Systems. – 2022. – vol. 133. – Р. 39-52. https://doi.org/10.1016/j.future.2022.03.005.

18. Shaik N.B. XGBoost based enhanced predictive model for handling missing input parameters: A case study on gas turbine / N.B. Shaik, K. Jongkittinarukorn, K. Bingi // Case Studies in Chemical and Environmental Engineering. – 2024. – vol. 10, art. № 100775. https://doi.org/10.1016/j.cscee.2024.100775.

19. Vinodh S. Lean Six Sigma project selection using hybrid approach based on fuzzy DEMATEL– ANP–TOPSIS / S. Vinodh, V. Swarnakar // International Journal of Lean Six Sigma. – 2015. – vol. 6, № 4. – Р. 313-338. https://doi.org/10.1108/IJLSS-12-2014-0041.

20. Beheshtinia M.A., Omidi S. A hybrid MCDM approach for performance evaluation in the banking industry / Beheshtinia M.A., Omidi S. // Kybernetes. – 2017. – vol. 46, № 8. – Р. 1386-1400. https://doi.org/10.1108/K-03-2017-0105.