Assessing the Relative Impact of Colombian Higher Education Institutions Using Fuzzy Data Envelopment Analysis (Fuzzy-DEA) in State Evaluations

Authors

DOI:

https://doi.org/10.7160/eriesj.2023.160404

Keywords:

Efficiency, Higher education, Machine learning, Predictive evaluation

Abstract

This research aims to design a helpful methodology for estimating universities' relative impact on students as a sustainability factor in higher education. To this end, the research methodology implemented a two-stage approach. The first stage involves the relative efficiency analysis of the study units using Fuzzy Data Envelopment Analysis. The second stage consists of a predictive evaluation of the efficiency of the study units. Consequently, among the most relevant results of the research, it is observed that the methodology identifies the institutions that need to strengthen the academic competencies of the industrial engineering program. Additionally, we developed a benchmark analysis called Efficient Route to help inefficient units achieve efficiency, associating efficiency, and sustainability as pillars of higher education processes.

 

 

Author Biographies

Rohemi Zuluaga, Universidad del Sinú

Has a master’s degree in engineering from the Universidad Tecnológica de Bolívar (UTB), and an Industrial Engineer from the Universidad Tecnológica de Bolívar (UTB). He is currently a professor at the University of Sinú. His areas of research are efficiency and learning analytics. 

 

Alicia Camelo-Guarín, Escuela Militar de Cadetes General José María Córdova,. Bogotá, Colombia

Alicia has a Ph.D. in Social Sciences, Social Communicator and Master in Communication Management from the Universidad del Norte. With experience in research of educational, Military Sciences, entertainment and communication strategies for social change. University professor and methodological consultant in the design of experiments, conducting scientific studies, validation and dissemination of results

 

References

Abelson, J., Forest, P.-G., Eyles, J., Smith, P., Martin, E. and Gauvin, F.-P. (2003) ‘Deliberations about deliberative methods: issues in the design and evaluation of public participation processes’, Social Science & Medicine, Vol. 57, No. 2, pp. 239–251. https://doi.org/10.1016/S0277-9536(02)00343-X

Acosta, O. and Celis, J. (2014) ‘The emergence of doctoral programmes in the Colombian higher education system: Trends and challenges’, PROSPECTS, Vol. 44, No. 3, pp. 463–481. https://doi.org/10.1007/s11125-014-9310-5

Agasisti, T., Munda, G. and Hippe, R. (2019) ‘Measuring the efficiency of European education systems by combining Data Envelopment Analysis and Multiple-Criteria Evaluation’, Journal of Productivity Analysis, Vol. 51, No. 2, pp. 105–124. https://doi.org/10.1007/s11123-019-00549-6

Alabdulmenem, F. M. (2016) ‘Measuring the Efficiency of Public Universities: Using Data Envelopment Analysis (DEA) to Examine Public Universities in Saudi Arabia’, International Education Studies, Vol. 10, No. 1, pp. 137–143. https://doi.org/10.5539/ies.v10n1p137

Altbach, P. G., Reisberg, L. and Rumbley, L. E. (2009) Trends in Global Higher Education: Tracking an Academic Revolution, Trends in global higher education: tracking an academic revolution; a report prepared for the UNESCO 2009 World Conference on Higher Education, Paris, [Online], Available: https://unesdoc.unesco.org/ark:/48223/pf0000183219 [16 Oct 2023]

Aparicio, J., Cordero, J. M. and Ortiz, L. (2021) ‘Efficiency Analysis with Educational Data: How to Deal with Plausible Values from International Large-Scale Assessments’, Mathematics, Vol. 9, No. 13, 1579. https://doi.org/10.3390/math9131579

Aparicio, J., Cordero, J. M. and Ortiz, L. (2019) ‘Measuring efficiency in education: The influence of imprecision and variability in data on DEA estimates’, Socio-Economic Planning Sciences, Vol. 68, 100698. https://doi.org/10.1016/j.seps.2019.03.004

Avelar, A. B. A., da Silva-Oliveira, K. D. and da Silva Pereira, R. (2019) ‘Education for advancing the implementation of the Sustainable Development Goals: A systematic approach’, The International Journal of Management Education, Vol. 17, No. 3, 100322. https://doi.org/10.1016/j.ijme.2019.100322

Barr, A. and Turner, S. E. (2013) ‘Expanding Enrollments and Contracting State Budgets: The Effect of the Great Recession on Higher Education’, The ANNALS of the American Academy of Political and Social Science, Vol. 650, No. 1, pp. 168–193. https://doi.org/10.1177/0002716213500035

Bianchi, N. and Giorcelli, M. (2020) ‘Scientific Education and Innovation: From Technical Diplomas to University Stem Degrees’, Journal of the European Economic Association, Vol. 18, No. 5, pp. 2608–2646. https://doi.org/10.1093/jeea/jvz049

Cars, M. and West, E. E. (2015) ‘Education for sustainable society: attainments and good practices in Sweden during the United Nations Decade for Education for Sustainable Development (UNDESD)’, Environment, Development and Sustainability, Vol. 17, No. 1, pp. 1–21. https://doi.org/10.1007/s10668-014-9537-6

Castro, R. (2019) ‘Blended learning in higher education: Trends and capabilities’, Education and Information Technologies, Vol. 24, No. 4, pp. 2523–2546. https://doi.org/10.1007/s10639-019-09886-3

Chankseliani, M. and McCowan, T. (2021) ‘Higher education and the Sustainable Development Goals’, Higher Education, Vol. 81, No. 1, pp. 1–8. https://doi.org/10.1007/s10734-020-00652-w

Charnes, A., Cooper, W. W. and Rhodes, E. (1978) ‘Measuring the efficiency of decision making units’, European Journal of Operational Research, Vol. 2, No. 6, pp. 429–444. https://doi.org/10.1016/0377-2217(78)90138-8

Chen, T. and Guestrin, C. (2016) XGBoost: A Scalable Tree Boosting System, In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD '16 (pp. 785–794), San Francisco, California, USA: ACM Press. https://doi.org/10.1145/2939672.2939785

Coll-Serrano, V., Bolos, V. and Benitez Suarez, R. (2018) deaR: Conventional and Fuzzy Data Envelopment Analysis, (Version 1.4.1), España: Universidad de Valencia, [Software], available: https://CRAN.R-project.org/package=deaR [15 April 2023]

Contreras, L. E., Fuentes, H. J. and Rodríguez, J. I. (2020) ‘Predicción del rendimiento académico como indicador de éxito/fracaso de los estudiantes de ingeniería, mediante aprendizaje automático’, Formación Universitaria, Vol. 13, No. 5, pp. 233–246. https://doi.org/10.4067/S0718-50062020000500233

Corlu, M. A and Aydin, E. (2016) ‘Evaluation of Learning Gains Through Integrated STEM Projects’, International Journal of Education in Mathematics, Science and Technology, Vol. 4, No. 1, pp. 20–29. https://dx.doi.org/10.18404/ijemst.35021

De La Hoz, E., Zuluaga, R. and Mendoza, A. (2021) ‘Assessing and Classification of Academic Efficiency in Engineering Teaching Programs’, Journal on Efficiency and Responsibility in Education and Science, Vol. 14, No. 1, pp. 41–52. https://doi.org/10.7160/eriesj.2021.140104

Delahoz-Dominguez, E., Zuluaga, R. and Fontalvo-Herrera, T. (2020) ‘Dataset of academic performance evolution for engineering students’, Data in Brief, Vol. 30, 105537. https://doi.org/10.1016/j.dib.2020.105537

Do, Q. H. and Chen, J.-F. (2014) ‘A hybrid fuzzy AHP-DEA approach for assessing university performance’, WSEAS Transactions on Business and Economics, Vol. 11, pp. 386–397.

Duque Oliva, E. J. and Chaparro Pinzón, C. R. (2012) ‘Medición de la percepción de la calidad del servicio de educación por parte de los estudiantes de la uptc duitama’, Criterio Libre, Vol. 10, No. 16, pp. 159–192. https://doi.org/10.18041/1900-0642/criteriolibre.2012v10n16.1168

Ferrer-Estévez, M. and Chalmeta, R. (2021) ‘Integrating Sustainable Development Goals in educational institutions’, The International Journal of Management Education, Vol. 19, No. 2, 100494. https://doi.org/10.1016/j.ijme.2021.100494

Font, X. (2002) ‘Environmental certification in tourism and hospitality: progress, process and prospects’, Tourism Management, Vol. 23, No. 3, pp. 197–205. https://doi.org/10.1016/S0261-5177(01)00084-X

Galbraith, C. S. and Merrill, G. B. (2015) ‘Academic performance and burnout: an efficient frontier analysis of resource use efficiency among employed university students’, Journal of Further and Higher Education, Vol. 39, No. 2, pp. 255–277. https://doi.org/10.1080/0309877X.2013.858673

Gamboa, L. F., Casas, A. F. and Piñeros, L. J. (2003) ‘La teoría del valor agregado: una aproximación a la calidad de la educación en Colombia’, Revista de Economía del Rosario, Vol. 6, No. 2, pp. 95–116.

Hoeg, D. G. and Bencze, J. L. (2017) ‘Values Underpinning STEM Education in the USA: An Analysis of the Next Generation Science Standards: VALUES UNDERPINNING STEM EDUCATION’, Science Education, Vol. 101, No. 2, pp. 278–301. https://doi.org/10.1002/sce.21260

ICFES (2022) Resultados de la evaluación Saber PRO [Results of the Saber PRO evaluation], Instituto Colombiano para la Evaluación de la Educación, [Online], Available: https://www.icfes.gov.co/web/guest/acerca-del-examen-saber-pro [26 Oct 2023]

Johnes, J. (2006) ‘Data envelopment analysis and its application to the measurement of efficiency in higher education’, Economics of Education Review, Vol. 25, No. 3, pp. 273–288. https://doi.org/10.1016/j.econedurev.2005.02.005

Kalapouti, K., Petridis, K., Malesios, C. and Dey, P. K. (2020) ‘Measuring efficiency of innovation using combined Data Envelopment Analysis and Structural Equation Modeling: empirical study in EU regions’, Annals of Operations Research, Vol. 294, pp. 297–320. https://doi.org/10.1007/s10479-017-2728-4

Kopnina, H. (2020) ‘Education for the future? Critical evaluation of education for sustainable development goals’, The Journal of Environmental Education, Vol. 51, No. 4, pp. 280–291. https://doi.org/10.1080/00958964.2019.1710444

Lee, T.-S., Wang, C.-H. and Yu, C.-M. (2019) ‘Fuzzy Evaluation Model for Enhancing E-Learning Systems’, Mathematics, Vol. 7, No. 10, 918. https://doi.org/10.3390/math7100918

León, T., Liern, V., Ruiz, J. L. and Sirvent, I. (2003) ‘A fuzzy mathematical programming approach to the assessment of efficiency with DEA models’, Fuzzy Sets and Systems, Vol. 139, No. 2, pp. 407–419. https://doi.org/10.1016/S0165-0114(02)00608-5

Liu, S.-T. and Chuang, M. (2009) ‘Fuzzy efficiency measures in fuzzy DEA/AR with application to university libraries’, Expert Systems with Applications, Vol. 36, No. 2 (Part 1), pp. 1105–1113. https://doi.org/10.1016/j.eswa.2007.10.013

Louppe, G. (2014) Understanding Random Forests: From Theory to Practice, [PhD thesis], Ithaca, NY: Cornell University. https://doi.org/10.48550/arXiv.1407.7502

Mirasol-Cavero, D. B. and Ocampo, L. (2021) ‘Fuzzy preference programming formulation in data envelopment analysis for university department evaluation’, Journal of Modelling in Management, Vol. 18, No. 1, pp. 212–238. https://doi.org/10.1108/JM2-08-2020-0205

Navas, L. P., Montes, F., Abolghasem, S., Salas, R. J., Toloo, M. and Zarama, R. (2020) ‘Colombian higher education institutions evaluation’, Socio-Economic Planning Sciences, Vol. 71, 100801. https://doi.org/10.1016/j.seps.2020.100801

Nazari-Shirkouhi, S., Mousakhani, S., Tavakoli, M., Dalvand, M. R., Šaparauskas, J. and Antuchevičienė, J. (2020) ‘Importance-performance analysis based balanced scorecard for performance evaluation in higher education institutions: an integrated fuzzy approach’, Journal of Business Economics and Management, Vol. 21, No. 3, pp. 647–678. https://doi.org/10.3846/jbem.2020.11940

Nazarko, J. and Šaparauskas, J. (2014) ‘Application of DEA method in efficiency evaluation of public Higher Education Institutions’, Technological and Economic Development of Economy, Vol. 20, No. 1, pp. 25–44. https://doi.org/10.3846/20294913.2014.837116

Nojavan, M., Heidari, A. and Mohammaditabar, D. (2021) ‘A fuzzy service quality based approach for performance evaluation of educational units’, Socio-Economic Planning Sciences, Vol. 73, 100816. https://doi.org/10.1016/j.seps.2020.100816

Ntshoe, I. and Letseka, M. (2010) Quality Assurance and Global Competitiveness in Higher Education, In L. M. Portnoi, V. D. Rust, & S. S. Bagley (Eds.), Higher Education, Policy, and the Global Competition Phenomenon (pp. 59–71), New York: Palgrave Macmillan US. https://doi.org/10.1057/9780230106130_5

OECD (2019) Publications - PISA, Organisation for Economic Co-operation and Development [Online], Available: https://www.oecd.org/pisa/publications/pisa-2018-results.htm [4 Dec 2019].

Pérez, Á. (2019) ¿Por qué la calidad de la educación en Colombia no es buena?, Semana, [Online], Available: https://www.dinero.com/opinion/columnistas/articulo/por-que-la-calidad-de-la-educacion-en-colombia-no-es-buena-por-angel-perez-martinez/268998 [19 Nov 2019].

Quintero Caro, O. L. (2018) Efectos de la acreditación de alta calidad en el valor agregado de la educación superior, [Master tesis], Bogotá: Facultad de Ciencias Económicas y Administrativas, Pontificia Universidad Javeriana. https://doi.org/10.11144/Javeriana.10554.38960

R Core Team (2013) R: A language and environment for statistical computing, R Foundation for Statistical Computing, Vienna, Austria, [Software], available: https://www.r-project.org/ [15 Jul 2023]

Rodríguez, M. and Huertas, Y. (2016) ‘Metodología para el Diseño de Conjuntos Difusos Tipo-2 a partir de Opiniones de Expertos’, Ingeniería, Vol. 21, No. 2, pp. 121–137. https://doi.org/10.14483/udistrital.jour.reving.2016.2.a01

Santos, G., Marques, C. S., Justino, E. and Mendes, L. (2020) ‘Understanding social responsibility's influence on service quality and student satisfaction in higher education’, Journal of Cleaner Production, Vol. 256, 120597. https://doi.org/10.1016/j.jclepro.2020.120597

Sharma, P. N., Shmueli, G., Sarstedt, M., Danks, N. and Ray, S. (2018) ‘Prediction-Oriented Model Selection in Partial Least Squares Path Modeling’, Decision Sciences, Vol. 52, No. 3, pp. 567–607. https://doi.org/10.1111/deci.12329

Shriberg, M. (2002) ‘Institutional assessment tools for sustainability in higher education: strengths, weaknesses, and implications for practice and theory’, Higher Education Policy, Vol. 15, No. 2, pp. 153–167. https://doi.org/10.1016/S0952-8733(02)00006-5

Singh, A. P., Yadav, S. P. and Singh, S. K. (2022) ‘A multi-objective optimisation approach for DEA models in a fuzzy environment’, Soft Computing, Vol. 26, No. 6, pp. 2901–2912. https://doi.org/10.1007/s00500-021-06627-y

Valdés Pasarón, S., Ocegueda Hernández, J. M. and Romero Gómez, A. (2018) ‘La calidad de la educación y su relación con los niveles de crecimiento económico en México’, Economía y Desarrollo, Vol. 159, No. 1, pp. 61–79.

Visbal-Cadavid, D., Martínez-Gómez, M. and Guijarro, F. (2017) ‘Assessing the Efficiency of Public Universities through DEA. A Case Study’, Sustainability, Vol. 9, No. 8, 1416. https://doi.org/10.3390/su9081416

Wolszczak-Derlacz, J. (2017) ‘An evaluation and explanation of (in)efficiency in higher education institutions in Europe and the U.S. with the application of two-stage semi-parametric DEA’, Research Policy, Vol. 46, No. 9, pp. 1595–1605. https://doi.org/10.1016/j.respol.2017.07.010

Additional Files

Published

2023-12-31

How to Cite

Zuluaga, R., Camelo-Guarín, A. and De La Hoz, E. (2023) ’Assessing the Relative Impact of Colombian Higher Education Institutions Using Fuzzy Data Envelopment Analysis (Fuzzy-DEA) in State Evaluations’, Journal on Efficiency and Responsibility in Education and Science, vol. 16, no. 4, pp. 299–312. https://doi.org/10.7160/eriesj.2023.160404

Issue

Vol. 16 No. 4 (2023): Special Issue on Education as a factor of regional, economic, and social development: The Data Envelopment Analysis approach

Section

Research Paper

Categories

License

Copyright (c) 2023 Rohemi Zuluaga, Alicia Camelo-Guarín, Enrique De La Hoz

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors declare with this manuscript intended for publication to ERIES Journal that:

  • all co-authors agree with the publication of the manuscript even after amendments arising from peer review;
  • all co-authors agree with the posting of the full text of this work on the web page of ERIES Journal and to the inclusion of references in databases accessible on the internet;
  • no results of other researchers were used in the submitted manuscript without their consent, proper citation, or acknowledgement of their cooperation or material provided;
  • the results (or any part of them) used in the manuscript have not been sent for publication to any other journal nor have they already been published (or if so, that the relevant works are cited in this manuscript);
  • submission of the manuscript for publication was completed in accordance with the publishing regulations pertaining to place of work;
  • experiments performed comply with current laws and written consent of the Scientific Ethics Committee / National Animal Care Authority (as is mentioned in the manuscript submitted);
  • grant holders confirm that they have been informed of the submitted manuscript and they agree to its publication.

Authors retain copyright and grant ERIES Journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the published work with an acknowledgement of its initial publication in ERIES Journal. Moreover, authors are able to post the published work in an institutional repository with an acknowledgement of its initial publication in ERIES Journal. In addition, authors are permitted and encouraged to post the published work online (e.g. institutional repositories or on their website) as it can lead to productive exchanges, as well as earlier and greater citation of published work.