Multi-criteria ranking of organizational factors affecting the learning quality outcomes in elementary education in Serbia


The research within this paper is motivated by the opinion that different organizational factors in primary education can have a stronger or weaker impact on the quality of the learning outcome. Organizational factors, criteria analyzed in this paper, are school management, school infrastructure, students’ foreknowledge, teacher competencies, curriculum content, student motivation, and the quality of the teaching process. Using SWARA (Step-wise Weight Assessment Ratio Analysis) method of multi-criteria decision-making, the answers of elementary school principals, members of the panel of experts, were processed. The calculation within this method was performed using fuzzy numbers to ensure the reliability of expert evaluations. The results of the applied method, in the form of weighting coefficients of the criteria, indicate that school management has an influence on the selection and building of teachers’ competencies while the given competence can indirectly affect the overall success of students through the establishment of an adequate school infrastructure, which affects the knowledge quality. Knowing the factor that has the highest impact enables principals to manage this factor and contribute to enhancing the knowledge quality. This research contributes to raising awareness of the importance of particular organizational factors in elementary education and the need to improve them.

First published online 28 October 2020

Keyword : SWARA method, fuzzy number, organizational factors, quality of learning outcomes, elementary education, school management, teacher competencies

How to Cite
Epifanić, V., Urošević, S., Dobrosavljević, A., Kokeza, G., & Radivojević, N. (2021). Multi-criteria ranking of organizational factors affecting the learning quality outcomes in elementary education in Serbia. Journal of Business Economics and Management, 22(1), 1-20.
Published in Issue
Jan 27, 2021
Abstract Views
PDF Downloads
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.


Abdi, K., Mardani, A., Senin, A., Tupenaite, L., Naimaviciene, J., Kanapeckiene, L., & Kutut, V. (2018). The effect of knowledge management, organizational culture and organizational learning on innovation in automotive industry. Journal of Business Economics and Management, 19(1), 1–19.

Aghdaie, M. H., Hashemkhani Zolfani, S., & Zavadskas, E. K. (2014). Synergies of data mining and multiple attribute decision making. Procedia – Social and Behavioral Sciences, 110, 767–776.

Alibabić, Š. (2009). Profesionalizacijamenadžmenta u obrazovanju. Obrazovanje odraslih, IX(2), 9–20.

Allan, J. (1996). Learning outcomes in Higher Education. Studies in Higher Education, 21(1), 93–108.

Araujo, M. C., Carneiro, P., Cruz-Aguayo, Y., & Schady, N. (2016). Teacher quality and learning outcomes in kindergarten. The Quarterly Journal of Economics, 131(3), 1415–1453.

Arsić, M., Urošević, S., Nikolić, Đ., & Voza, D. (2011, May 26-28). Ispitivanje zadovoljstva zaposlenih u obrazovnim institucijama. In VII Majska konferencija o strategijskom menadžmentu (pp. 390–400). Technical Faculty in Bor, Zaječar, Srbija.

Asfani, K., Suswanto, H., & Wibawa, A. P. (2016). Influential factors of students’ competence. World Transactions on Engineering and Technology Education, 14(3), 416–420.

Atteberry, A., Loeb S., & Wyckoff, J. (2015). Do first impressions matter? Predicting early career teacher effectiveness. AERA Open, 1(4), 1–23.

Banihabib, M. E., Chitsaz, N., & Randhir, T. O. (2020). Non-compensatory decision model for incorporating the sustainable development criteria in flood risk management plans. SN Applied Sciences, 2(1), 6.

Barrett, P., Treves, A., Shmis, T., Ambasz, D., & Ustinova, M. (2019). The impact of school infrastructure on learning: A synthesis of the evidence. The World Bank.

Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010). Transfer of training: A meta-analytic review. Journal of Management, 36(4), 1065–1105.

Brinson, J. R. (2015). Learning outcome achievement in non-traditional (virtual and remote) versus traditional (hands-on) laboratories: A review of the empirical research. Computers & Education, 87, 218–237.

Brown, J. G. (1971). A note on fuzzy sets. Information and Control, 18(1), 32–39.

Chang, Y., Leach, N., & Anderman, E. M. (2015). The role of perceived autonomy support in principals’ affective organizational commitment and job satisfaction. Social Psychology of Education, 18(2), 315–336.

Chen, J., Wang, M., Kirschner, P. A., & Tsai, C. C. (2018). The role of collaboration, computer use, learning environments, and supporting strategies in CSCL: A meta-analysis. Review of Educational Research, 88(6), 799–843.

Cheng, Y. C. (1994). Principal’s leadership as a critical factor for school performance: Evidence from multi‐levels of primary schools. School Effectiveness and School Improvement, 5(3), 299–317.

Cheng, Y. C., & Mok, M. M. C. (2007). School‐based management and paradigm shift in education: An empirical study. International Journal of Educational Management, 21(6), 517–542.

Cruickshank, V. (2017). The influence of school leadership on student outcomes. Open Journal of Social Sciences, 5(9), 115–123.

Darling-Hammond, L. (2010). Teacher education and the American future. Journal of Teacher Education, 61(1–2), 35–47.

Dihovični, Dj., & Krunić, V. (2018). Creating and encrypting e-commerce database for selling mechanical elements. Applied Engineering Letters, 3(3), 85–89.

Ďurišová, M., Kucharčíková, A., & Tokarčíková, E. (2015). Assessment of higher education teaching outcomes (Quality of higher education). Procedia-Social and Behavioral Sciences, 174, 2497–2502.

Fauth, B., Decristan, J., Rieser, S., Klieme, E., & Büttner, G. (2014). Student ratings of teaching quality in primary school: Dimensions and prediction of student outcomes. Learning and Instruction, 29, 1–9.

Gani, A. N., & Assarudeen, S. M. (2012). A new operation on triangular fuzzy number for solving fuzzy linear programming problem. Applied Mathematical Sciences, 6(11), 525–532.

Gerasymchuk, V. H. (2018). Factors of successful management of organization. Tekstilnaindustrija, 66(2), 52–60.

Ghorabaee, M. K., Amiri, M., Zavadskas, E. K., & Antucheviciene, J. (2018). A new hybrid fuzzy MCDM approach for evaluation of construction equipment with sustainability considerations. Archives of Civil and Mechanical Engineering, 18(1), 32–49.

Gil-Flores, J., Rodríguez-Santero, J., & Torres-Gordillo, J. J. (2017). Factors that explain the use of ICT in secondary-education classrooms: The role of teacher characteristics and school infrastructure. Computers in Human Behavior, 68, 441–449.

Haapakorpi, A. (2011). Quality assurance processes in Finnish universities: Direct and indirect outcomes and organisational conditions. Quality in Higher Education, 17(1), 69–81.

Hashemkhani Z. S., & Saparauskas, J. (2013). New application of SWARA method in prioritizing sustainability assessment indicators of energy system. Inzinerine Ekonomika-Engineering Economics, 24(5), 408–414.

Hashemkhani, Z. S. H., Yazdani, M., & Zavadskas, E. K. (2018). An extended stepwise weight assessment ratio analysis (SWARA) method for improving criteria prioritization process. Soft Computing, 22(22), 7399–7405.

Hitka, M., Kozubikova, L., & Potkany, M. (2017). Education and gender-Based differences in employee motivation. Journal of Business Economics and Management, 19(1), 80–95.

Jackson, C. K., Rockoff, J. E., & Staiger, D. O. (2014). Teacher effects and teacher-related policies. Annual Review of Economics, 6(1), 801–825.

Jahnke, I., & Liebscher, J. (2020). Three types of integrated course designs for using mobile technologies to support creativity in higher education. Computers & Education, 146, 103782.

Jeong, H., Hmelo-Silver, C. E., & Jo, K. (2019). Ten years of computer-supported collaborative learning: A meta-analysis of CSCL in STEM education during 2005–2014. Educational Research Review, 28, 100284.

Keršulienė, V., Zavadskas, E. K., & Turskis, Z. (2010). Selection of rational dispute resolution method by applying new step-wise weight assessment ratio analysis (SWARA). Journal of Business Economics and Management, 11(2), 243–258.

Klassen, R., & Kim, L. (2019). Selecting teachers and prospective teachers: A meta-analysis. Educational Research Review Journal, 26, 32–51.

Kokeza, G., Urošević S., & Radosavljević, D. (2016). Razvoj kompetencija zaposlenihkao element menadžmentaljudskih resursa – saposebnimosvrtomna tekstilnu industriju. Tekstilna industrija, 64(4), 72–83.

Kunter, M., Klusmann, U., Baumert, J., Richter, D., Voss, T., & Hachfeld, A. (2013). Professional competence of teachers: Effects on instructional quality and student development. Journal of Educational Psychology, 105(3), 805.

Leon, J., Medina-Garrido, E., & Núñez, J. L. (2017). Teaching quality in math class: The development of a scale and the analysis of its relationship with engagement and achievement. Frontiers in Psychology, 8, 895.

Lin, J. W., Yen, M. H., Liang, J., Chiu, M. H., & Guo, C. J. (2016). Examining the factors that influence students’ science learning processes and their learning outcomes: 30 years of conceptual change research. Eurasia Journal of Mathematics, Science and Technology Education, 12(9), 2617–2646.

Long, C. S., Ibrahim, Z., & Kowang, T. O. (2014). An analysis on the relationship between lecturers’ competencies and students’ satisfaction. International Education Studies, 7(1), 37–46.

Määttä, K., & Uusiautti, S. (2012). How to enhance the smoothness of university students’ study paths. International Journal of Research Studies in Education, 1(1), 47–60.

Mardani, A., Nilashi, M., Zakuan, N., Loganathan, N., Soheilirad, S., Saman, M. Z. M., & Ibrahim, O. (2017). A systematic review and meta-Analysis of SWARA and WASPAS methods: Theory and applications with recent fuzzy developments. Applied Soft Computing, 57, 265–292.

Marks, A. B., & Moss, S. A. (2016). What predicts law student success? A longitudinal study correlating law student applicant data and law school outcomes. Journal of Empirical Legal Studies, 13(2), 205–265.

Murillo, F. J., & Román, M. (2011). School infrastructure and resources do matter: analysis of the incidence of school resources on the performance of Latin American students. School Effectiveness and School Improvement, 22(1), 29–50.

Narayanan, A. K., & Jinesh, N. (2018). Application of SWARA and TOPSIS methods for supplier selection in a casting unit. International Journal of Engineering Research & Technology, 7(5), 456–458.

Nawi, A., Hamzah, M. I., Ren, C. C., & Tamuri, A. H. (2015). Adoption of mobile technology for teaching preparation in improving teaching quality of teachers. International Journal of Instruction, 8(2), 113–124.

Panahi, S., Khakzad, A., & Afzal, P. (2017). Application of stepwise weight assessment ratio analysis (SWARA) for copper prospectivity mapping in the Anarak region, central Iran. Arabian Journal of Geosciences, 10(22), 484.

Patterson, F., Knight, A., Dowell, J., Nicholson, S., Cousans, F., & Cleland, J. (2016). How effective are selection methods in medical education? A systematic review. Medical Education, 50(1), 36–60.

Petrović, G., Mihajlović, J., Ćojbašić, Ž., Madić, M., & Marinković, D. (2019). Comparison of three fuzzy MCDM methods for solving the supplier selection problem. Facta Universitatis, Series: Mechanical Engineering, 17(3), 455–469.

Radianti, J., Majchrzak, T. A., Fromm, J., & Wohlgenannt, I. (2020). A sistematic review of immersive virtual reality applications forhigher education: Design elements, lessons learned, and research agenda. Computers & Education, 147, 103778.

Radionovs, A., & Užga-Rebrovs, O. (2017). Software tool implementing the fuzzy AHP method in ecological risk assessment. Information Technology and Management Science, 20(1), 34–39.

Robinson, V. M., Lloyd, C. A., & Rowe, K. J. (2008). The impact of leadership on student outcomes: An analysis of the differential effects of leadership types. Educational Administration Quarterly, 44(5), 635–674.

Rubio-Alcala, F. D., Arco-Tirado, J. L., Fernandez-Martin, F. D., López-Lechuga, R., Barrios, E., & Pavon-Vazquez, V. (2019). A systematic review on evidences supporting quality indicators of bilingual, plurilingual and multilingual programs in higher education. Educational Research Review, 27, 191–204.

Rulebook on Quality Standards for Institutions. (2012). Official Gazette of the Republic of Serbia, Nos. 7/2011 and 68/2012.

Rulebook on the Evaluation of the Quality of Work of Institutions. (2012). Official Gazette of the Republic of Serbia, No. 9/2012.

Sammons, P., Gu, Q., Day, C., & Ko, J. (2011). Exploring the impact of school leadership on pupil outcomes: Results from a study of academically improved and effective schools in England. International Journal of Educational Management, 25(1), 83–101.

Shahjahan, R. A., & Torres, L. E. (2013). A “global eye” for teaching and learning in higher education: A critical policy analysis of the OECD’s AHELO study. Policy Futures in Education, 11(5), 606–620.

Singh, R., & Sarkar, S. (2015). Does teaching quality matter? Students learning outcome related to teaching quality in public and private primary schools in India. International Journal of Educational Development, 41, 153–163.

Smiljanić, V. (2013). Razvojna psihologija. Faculty of Philosophy, Belgrade.

Stahl, G., Koschmann, T., & Suthers, D. D. (2014). Computer-supported collaborative learning. In R. K. Sawyer (Ed.), Cambridge handbook of the learning sciences (2nd ed., pp. 479–500). Cambridge University Press.

Teddlie, C., & Reynolds, D. (2000). The international handbook of school effectiveness research. Falmer Press.

Trebješanin, B. (2014). Promene u shvatanjudeteta. Journal of Applied Psychology, 7(4), 549–563.

Tsaur, S. H., Chang, T. Y., & Yen, C. H. (2002). The evaluation of airline service quality by fuzzy MCDM. Tourism Management, 23(2), 107–115.

Vaiciukevičiute, A., Stankevičiene, J., & Bratčikoviene, N. (2019). Higher education institutions impact on the economy. Journal of Business Economics and Management, 20(3), 507–525.

Vatansever, K., & Akgül, Y. (2019). Multicriteria decision making models for website evaluation. IGI Global.

Velazquez, M. A., Claudio, D., & Ravindran, A. R. (2010). Experiments in multiple criteria selection problems with multiple decision makers. International Journal of Operational Research, 7(4), 413– 428.

Vesić, D. (2003). Menadžment ljudskih resursa i kvalitet. Center for Applied Psychology, Belgrade.

Wahyono, I. (2015). Kompetensi Manajerial Kepala Sekolah Dalam Peningkatan Profesionalisme Guru di SMK Bustanul Falah Kembiritan Genteng Banyuwangi. Jurnal Ar-Risalah, 11(1), 50–64.

Won, S., Anderman, E. M., & Zimmerman, R. S. (2020). Longitudinal relations of classroom goal structures to students’ motivation and learning outcomes in health education. Journal of Educational Psychology, 112(5), 1003–1019.

Yadegaridehkordi, E., Binti Mohd Noor, N. F., Bin Ayub, M. N., Binti Affal, H., & Binti Hussin, N. (2019). Affective computing in education: A systematic review and future research. Computers & Education, 142, 103649.

Yurdakul, M., & İç, Y. T. (2009). Analysis of the benefit generated by using fuzzy numbers in a TOPSIS model developed for machine tool selection problems. Journal of Materials Processing Technology, 209(1), 310–317.

Živković, Ž., & Nikolić, Đ. (2016). Osnove matematičke škole strategijs kogmenadžmenta. Technical Faculty in Bor, Serbia.