Assessing the Relative Impact of Colombian Higher Education Institutions Using Fuzzy Data Envelopment Analysis (Fuzzy-DEA) in State Evaluations




Efficiency, Higher education, Machine learning, Predictive evaluation


This research aims to design a helpful methodology for estimating universities' relative impact on students as a sustainability factor in higher education. To this end, the research methodology implemented a two-stage approach. The first stage involves the relative efficiency analysis of the study units using Fuzzy Data Envelopment Analysis. The second stage consists of a predictive evaluation of the efficiency of the study units. Consequently, among the most relevant results of the research, it is observed that the methodology identifies the institutions that need to strengthen the academic competencies of the industrial engineering program. Additionally, we developed a benchmark analysis called Efficient Route to help inefficient units achieve efficiency, associating efficiency, and sustainability as pillars of higher education processes.



Author Biographies

Rohemi Zuluaga, Universidad del Sinú

Has a master’s degree in engineering from the Universidad Tecnológica de Bolívar (UTB), and an Industrial Engineer from the Universidad Tecnológica de Bolívar (UTB). He is currently a professor at the University of Sinú. His areas of research are efficiency and learning analytics. 


Alicia Camelo-Guarín, Escuela Militar de Cadetes General José María Córdova,. Bogotá, Colombia

Alicia has a Ph.D. in Social Sciences, Social Communicator and Master in Communication Management from the Universidad del Norte. With experience in research of educational, Military Sciences, entertainment and communication strategies for social change. University professor and methodological consultant in the design of experiments, conducting scientific studies, validation and dissemination of results



Abelson, J., Forest, P.-G., Eyles, J., Smith, P., Martin, E. and Gauvin, F.-P. (2003) ‘Deliberations about deliberative methods: issues in the design and evaluation of public participation processes’, Social Science & Medicine, Vol. 57, No. 2, pp. 239–251.

Acosta, O. and Celis, J. (2014) ‘The emergence of doctoral programmes in the Colombian higher education system: Trends and challenges’, PROSPECTS, Vol. 44, No. 3, pp. 463–481.

Agasisti, T., Munda, G. and Hippe, R. (2019) ‘Measuring the efficiency of European education systems by combining Data Envelopment Analysis and Multiple-Criteria Evaluation’, Journal of Productivity Analysis, Vol. 51, No. 2, pp. 105–124.

Alabdulmenem, F. M. (2016) ‘Measuring the Efficiency of Public Universities: Using Data Envelopment Analysis (DEA) to Examine Public Universities in Saudi Arabia’, International Education Studies, Vol. 10, No. 1, pp. 137–143.

Altbach, P. G., Reisberg, L. and Rumbley, L. E. (2009) Trends in Global Higher Education: Tracking an Academic Revolution, Trends in global higher education: tracking an academic revolution; a report prepared for the UNESCO 2009 World Conference on Higher Education, Paris, [Online], Available: [16 Oct 2023]

Aparicio, J., Cordero, J. M. and Ortiz, L. (2021) ‘Efficiency Analysis with Educational Data: How to Deal with Plausible Values from International Large-Scale Assessments’, Mathematics, Vol. 9, No. 13, 1579.

Aparicio, J., Cordero, J. M. and Ortiz, L. (2019) ‘Measuring efficiency in education: The influence of imprecision and variability in data on DEA estimates’, Socio-Economic Planning Sciences, Vol. 68, 100698.

Avelar, A. B. A., da Silva-Oliveira, K. D. and da Silva Pereira, R. (2019) ‘Education for advancing the implementation of the Sustainable Development Goals: A systematic approach’, The International Journal of Management Education, Vol. 17, No. 3, 100322.

Barr, A. and Turner, S. E. (2013) ‘Expanding Enrollments and Contracting State Budgets: The Effect of the Great Recession on Higher Education’, The ANNALS of the American Academy of Political and Social Science, Vol. 650, No. 1, pp. 168–193.

Bianchi, N. and Giorcelli, M. (2020) ‘Scientific Education and Innovation: From Technical Diplomas to University Stem Degrees’, Journal of the European Economic Association, Vol. 18, No. 5, pp. 2608–2646.

Cars, M. and West, E. E. (2015) ‘Education for sustainable society: attainments and good practices in Sweden during the United Nations Decade for Education for Sustainable Development (UNDESD)’, Environment, Development and Sustainability, Vol. 17, No. 1, pp. 1–21.

Castro, R. (2019) ‘Blended learning in higher education: Trends and capabilities’, Education and Information Technologies, Vol. 24, No. 4, pp. 2523–2546.

Chankseliani, M. and McCowan, T. (2021) ‘Higher education and the Sustainable Development Goals’, Higher Education, Vol. 81, No. 1, pp. 1–8.

Charnes, A., Cooper, W. W. and Rhodes, E. (1978) ‘Measuring the efficiency of decision making units’, European Journal of Operational Research, Vol. 2, No. 6, pp. 429–444.

Chen, T. and Guestrin, C. (2016) XGBoost: A Scalable Tree Boosting System, In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD '16 (pp. 785–794), San Francisco, California, USA: ACM Press.

Coll-Serrano, V., Bolos, V. and Benitez Suarez, R. (2018) deaR: Conventional and Fuzzy Data Envelopment Analysis, (Version 1.4.1), España: Universidad de Valencia, [Software], available: [15 April 2023]

Contreras, L. E., Fuentes, H. J. and Rodríguez, J. I. (2020) ‘Predicción del rendimiento académico como indicador de éxito/fracaso de los estudiantes de ingeniería, mediante aprendizaje automático’, Formación Universitaria, Vol. 13, No. 5, pp. 233–246.

Corlu, M. A and Aydin, E. (2016) ‘Evaluation of Learning Gains Through Integrated STEM Projects’, International Journal of Education in Mathematics, Science and Technology, Vol. 4, No. 1, pp. 20–29.

De La Hoz, E., Zuluaga, R. and Mendoza, A. (2021) ‘Assessing and Classification of Academic Efficiency in Engineering Teaching Programs’, Journal on Efficiency and Responsibility in Education and Science, Vol. 14, No. 1, pp. 41–52.

Delahoz-Dominguez, E., Zuluaga, R. and Fontalvo-Herrera, T. (2020) ‘Dataset of academic performance evolution for engineering students’, Data in Brief, Vol. 30, 105537.

Do, Q. H. and Chen, J.-F. (2014) ‘A hybrid fuzzy AHP-DEA approach for assessing university performance’, WSEAS Transactions on Business and Economics, Vol. 11, pp. 386–397.

Duque Oliva, E. J. and Chaparro Pinzón, C. R. (2012) ‘Medición de la percepción de la calidad del servicio de educación por parte de los estudiantes de la uptc duitama’, Criterio Libre, Vol. 10, No. 16, pp. 159–192.

Ferrer-Estévez, M. and Chalmeta, R. (2021) ‘Integrating Sustainable Development Goals in educational institutions’, The International Journal of Management Education, Vol. 19, No. 2, 100494.

Font, X. (2002) ‘Environmental certification in tourism and hospitality: progress, process and prospects’, Tourism Management, Vol. 23, No. 3, pp. 197–205.

Galbraith, C. S. and Merrill, G. B. (2015) ‘Academic performance and burnout: an efficient frontier analysis of resource use efficiency among employed university students’, Journal of Further and Higher Education, Vol. 39, No. 2, pp. 255–277.

Gamboa, L. F., Casas, A. F. and Piñeros, L. J. (2003) ‘La teoría del valor agregado: una aproximación a la calidad de la educación en Colombia’, Revista de Economía del Rosario, Vol. 6, No. 2, pp. 95–116.

Hoeg, D. G. and Bencze, J. L. (2017) ‘Values Underpinning STEM Education in the USA: An Analysis of the Next Generation Science Standards: VALUES UNDERPINNING STEM EDUCATION’, Science Education, Vol. 101, No. 2, pp. 278–301.

ICFES (2022) Resultados de la evaluación Saber PRO [Results of the Saber PRO evaluation], Instituto Colombiano para la Evaluación de la Educación, [Online], Available: [26 Oct 2023]

Johnes, J. (2006) ‘Data envelopment analysis and its application to the measurement of efficiency in higher education’, Economics of Education Review, Vol. 25, No. 3, pp. 273–288.

Kalapouti, K., Petridis, K., Malesios, C. and Dey, P. K. (2020) ‘Measuring efficiency of innovation using combined Data Envelopment Analysis and Structural Equation Modeling: empirical study in EU regions’, Annals of Operations Research, Vol. 294, pp. 297–320.

Kopnina, H. (2020) ‘Education for the future? Critical evaluation of education for sustainable development goals’, The Journal of Environmental Education, Vol. 51, No. 4, pp. 280–291.

Lee, T.-S., Wang, C.-H. and Yu, C.-M. (2019) ‘Fuzzy Evaluation Model for Enhancing E-Learning Systems’, Mathematics, Vol. 7, No. 10, 918.

León, T., Liern, V., Ruiz, J. L. and Sirvent, I. (2003) ‘A fuzzy mathematical programming approach to the assessment of efficiency with DEA models’, Fuzzy Sets and Systems, Vol. 139, No. 2, pp. 407–419.

Liu, S.-T. and Chuang, M. (2009) ‘Fuzzy efficiency measures in fuzzy DEA/AR with application to university libraries’, Expert Systems with Applications, Vol. 36, No. 2 (Part 1), pp. 1105–1113.

Louppe, G. (2014) Understanding Random Forests: From Theory to Practice, [PhD thesis], Ithaca, NY: Cornell University.

Mirasol-Cavero, D. B. and Ocampo, L. (2021) ‘Fuzzy preference programming formulation in data envelopment analysis for university department evaluation’, Journal of Modelling in Management, Vol. 18, No. 1, pp. 212–238.

Navas, L. P., Montes, F., Abolghasem, S., Salas, R. J., Toloo, M. and Zarama, R. (2020) ‘Colombian higher education institutions evaluation’, Socio-Economic Planning Sciences, Vol. 71, 100801.

Nazari-Shirkouhi, S., Mousakhani, S., Tavakoli, M., Dalvand, M. R., Šaparauskas, J. and Antuchevičienė, J. (2020) ‘Importance-performance analysis based balanced scorecard for performance evaluation in higher education institutions: an integrated fuzzy approach’, Journal of Business Economics and Management, Vol. 21, No. 3, pp. 647–678.

Nazarko, J. and Šaparauskas, J. (2014) ‘Application of DEA method in efficiency evaluation of public Higher Education Institutions’, Technological and Economic Development of Economy, Vol. 20, No. 1, pp. 25–44.

Nojavan, M., Heidari, A. and Mohammaditabar, D. (2021) ‘A fuzzy service quality based approach for performance evaluation of educational units’, Socio-Economic Planning Sciences, Vol. 73, 100816.

Ntshoe, I. and Letseka, M. (2010) Quality Assurance and Global Competitiveness in Higher Education, In L. M. Portnoi, V. D. Rust, & S. S. Bagley (Eds.), Higher Education, Policy, and the Global Competition Phenomenon (pp. 59–71), New York: Palgrave Macmillan US.

OECD (2019) Publications - PISA, Organisation for Economic Co-operation and Development [Online], Available: [4 Dec 2019].

Pérez, Á. (2019) ¿Por qué la calidad de la educación en Colombia no es buena?, Semana, [Online], Available: [19 Nov 2019].

Quintero Caro, O. L. (2018) Efectos de la acreditación de alta calidad en el valor agregado de la educación superior, [Master tesis], Bogotá: Facultad de Ciencias Económicas y Administrativas, Pontificia Universidad Javeriana.

R Core Team (2013) R: A language and environment for statistical computing, R Foundation for Statistical Computing, Vienna, Austria, [Software], available: [15 Jul 2023]

Rodríguez, M. and Huertas, Y. (2016) ‘Metodología para el Diseño de Conjuntos Difusos Tipo-2 a partir de Opiniones de Expertos’, Ingeniería, Vol. 21, No. 2, pp. 121–137.

Santos, G., Marques, C. S., Justino, E. and Mendes, L. (2020) ‘Understanding social responsibility's influence on service quality and student satisfaction in higher education’, Journal of Cleaner Production, Vol. 256, 120597.

Sharma, P. N., Shmueli, G., Sarstedt, M., Danks, N. and Ray, S. (2018) ‘Prediction-Oriented Model Selection in Partial Least Squares Path Modeling’, Decision Sciences, Vol. 52, No. 3, pp. 567–607.

Shriberg, M. (2002) ‘Institutional assessment tools for sustainability in higher education: strengths, weaknesses, and implications for practice and theory’, Higher Education Policy, Vol. 15, No. 2, pp. 153–167.

Singh, A. P., Yadav, S. P. and Singh, S. K. (2022) ‘A multi-objective optimisation approach for DEA models in a fuzzy environment’, Soft Computing, Vol. 26, No. 6, pp. 2901–2912.

Valdés Pasarón, S., Ocegueda Hernández, J. M. and Romero Gómez, A. (2018) ‘La calidad de la educación y su relación con los niveles de crecimiento económico en México’, Economía y Desarrollo, Vol. 159, No. 1, pp. 61–79.

Visbal-Cadavid, D., Martínez-Gómez, M. and Guijarro, F. (2017) ‘Assessing the Efficiency of Public Universities through DEA. A Case Study’, Sustainability, Vol. 9, No. 8, 1416.

Wolszczak-Derlacz, J. (2017) ‘An evaluation and explanation of (in)efficiency in higher education institutions in Europe and the U.S. with the application of two-stage semi-parametric DEA’, Research Policy, Vol. 46, No. 9, pp. 1595–1605.

Additional Files



How to Cite

Zuluaga, R., Camelo-Guarín, A. and De La Hoz, E. (2023) ’Assessing the Relative Impact of Colombian Higher Education Institutions Using Fuzzy Data Envelopment Analysis (Fuzzy-DEA) in State Evaluations’, Journal on Efficiency and Responsibility in Education and Science, vol. 16, no. 4, pp. 299–312.