Ranking of European Universities by DEA-Based Sustainability Indicator
DOI:
https://doi.org/10.7160/eriesj.2023.160403Keywords:
Composite Index, Data Envelopment Analysis, Sustainability Goals, University RankingAbstract
The paper introduces a novel approach to university rankings that considers a university's contribution to sustainable development. It addresses the usual controversies surrounding the construction of rankings using composite indicators. The conventional approach typically involves normalizing sub-indicators and applying subjective weights for aggregation, which raises concerns about the reliability of the rankings. In response to this issue, we propose an alternative method based on Data Envelopment Analysis (DEA) that utilizes flexible weights. Our approach is applied to the data from the UI-GreenMetric World University Ranking. We initially employ a general Benefit of the Doubt DEA model and subsequently enhance its discrimination power by computing super-efficiency. In the third model, we impose weight restrictions on sub-indicators. The results of our analysis offer valuable insights for all stakeholders, as illustrated by the implications derived for Czech universities included in the sample. Furthermore, we compare the results of universities in various European countries, establishing a connection between rankings and the fulfillment of Sustainable Development Goals (SDG) within individual countries. This research contributes to a more comprehensive understanding of the relationship between university performance, sustainability, and the associated implications for policy and benchmarking.
References
Allen, R., Athanassopoulos, A., Dyson, R. G. and Thanassoulis, E. (1997) ‘Weights restrictions and value judgments in data envelopment analysis: evolution’, development, and future directions, Annals of operations research, Vol. 73, pp. 13–34. https://doi.org/10.1023/A:1018968909638
Andersen, P. and Petersen, N. C. (1993) ‘A Procedure for Ranking Efficient Units in Data Envelopment Analysis’, Management Science, Vol. 39, No. 10, pp. 1261–1264. https://doi.org/10.1287/mnsc.39.10.1261
Atici, K. B., Yasayacak, G., Yildiz, Y. and Ulucan, A. (2021) ‘Green University and Academic Performance: An Empirical Study on UI GreenMetric and World University Rankings’, Journal of Cleaner Production, Vol. 291, 125289. https://doi.org/10.1016/j.jclepro.2020.125289
Banker, R. D. and Natarajan, R. (2008) ‘Evaluating Contextual Variables Affecting Productivity Using Data Envelopment Analysis’, Operations Research, Vol. 56, No. 1, pp. 48–58. http://dx.doi.org/10.1287/opre.1070.0460
Baptista, R., Lima, F. and Mendonça, J. (2011) ‘Establishment of higher education institutions and new firm entry’, Research Policy, Vol. 40, No. 5, pp. 751–760. http://dx.doi.org/10.1016/j.respol.2011.02.006
Boiocchi, R., Ragazzi, M., Torretta, V. and Rada, E.C. (2023) ‘Critical Analysis of the GreenMetric World University Ranking System: The Issue of Comparability’, Sustainability, Vol. 15, No. 2, 1343. https://doi.org/10.3390/su15021343
Boer, P. (2013) ‘Assessing sustainability and social responsibility in higher education assessment frameworks explained’, in Caeiro, S., Filho, W., Jabbour, C., Azeiteiro, U. (eds.) Sustainability Assessment Tools in Higher Education Institutions: Mapping Trends and Good Practices Around the World, Heidelberg: Springer, pp. 121–138. http://dx.doi.org/10.1007/978-3-319-02375-5_7
Charnes, A., Cooper, W. W., Huang, Z. M. and Sun D. B. (1990) ‘Polyhedral cone-ratio DEA models with an illustrative application to large commercial banks’, Journal of Econometrics, Vol. 46, No. 1–2, pp. 73–91. https://doi.org/10.1016/0304-4076(90)90048-X
Cherchye, L., Moesen, W. and Van Puyenbroeck, T. (2004) ‘Legitimately diverse, yet comparable: on synthesizing social inclusion performance in the EU’, Journal of Common Market Studies, Vol. 42, No. 5, pp. 919–955. https://doi.org/10.1111/j.0021-9886.2004.00535.x
Cherchye, L., Moesen, W., Rogge, N. and Van Puyenbroeck, T. (2007) ‘An introduction to “benefit of the doubt” composite indicators’, Social Indicators Research, Vol. 82, No. 1, pp. 111–145. https://doi.org/10.1007/s11205-006-9029-7
Cherchye, L., Moesen, W., Rogge, N., Van Puyenbroeck, T., Saisana, M., Saltelli, A., Liska, R. and Tarantola, S. (2008) ‘Creating Composite Indicators with DEA and Robustness Analysis: The Case of the Technology Achievement Index’, The Journal of the Operational Research Society, Vol. 59, No. 2, pp. 239–251. http://www.jstor.org/stable/30132778
Ceulemans, K., Molderez, I. and Van Liedekerke, L. (2015) ‘Sustainability reporting in higher education: a comprehensive review of the recent literature and paths for further research’, Journal of Cleaner Production, Vol. 106, pp. 127–143. http://dx.doi.org/10.1016/j.jclepro.2014.09.052
Dalal-Clayton, B. and Bass S. (2002) Sustainable development strategies, 1st edition, London: Earthscan Publications.
Despotis, D. K. (2005) ‘A reassessment of the human development index via data envelopment analysis’, Journal of the Operational Research Society, Vol. 56, No. 8. pp. 969–980. https://doi.org/10.1057/palgrave.jors.2601927
Dyson, R. G. and Thanassoulis, E. (1988) ‘Reducing Weight Flexibility in Data Envelopment Analysis’, Journal of the Operational Research Society, Vol. 39, No. 6, pp. 563–576. https://doi.org/10.2307/2582861
European Commission (2004) The EU Economy Review 2004, [Online], Available: https://ec.europa.eu/economy_finance/publications/pages/publication451_en.pdf [9 Sep 2023].
Ferro G. and D‘Elia V. (2020) ‘Higher Education Efficiency Frontier Analysis: A Review of Variables to Consider’, Journal on Efficiency and Responsibility in Education and Science, Vol. 13, No. 3, pp. 140–153. http://dx.doi.org/10.7160/eriesj.2020.130304
Filho, W. (2011) ‘About the Role of Universities and Their Contribution to Sustainable Development’, Higher Education Policy, Vol. 24, pp. 427–438. https://doi.org/10.1057/hep.2011.16
Fritsch, M. and Aamoucke, R. (2017) ‘Fields of knowledge in higher education institutions, and innovative start-ups: an empirical investigation’, Papers in Regional Science, Vol. 96, No. S1, pp. 1–27. https://doi.org/10.1111/pirs.12175
Galleli, B., Teles, N. E. B., Santos, J. A. R. D., Freitas-Martins, M. S. and Hourneaux Junior, F. (2022) ‘Sustainability university rankings: a comparative analysis of UI green metric and the times higher education world university rankings’, International Journal of Sustainability in Higher Education, Vol. 23, No. 2, pp. 404–425. http://dx.doi.org/10.1108/IJSHE-12-2020-0475
Greco, S., Ishizaka, A., Tasiou, M. and Torrisi G. (2019) ‘On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness’, Social Indicators Research, Vol. 141, pp. 61–94. https://doi.org/10.1007/s11205-017-1832-9
GreenMetric World University Ranking (2022) UI GreenMetric, [Online], Available: https://greenmetric.ui.ac.id/ [22 Nov 2022].
Kaur, J. and Kaur, K. (2022) ‘Developing Awareness and Attitude Towards Sustainability Through an Activity-Based Intervention’, Journal on Efficiency and Responsibility in Education and Science, Vol. 15, No. 4, pp. 212–220. http://dx.doi.org/10.7160/eriesj.2022.150402
Klußmann, C., Sassen, R. and Gansel, E. (2019) ‘Structural key factors of participatory sustainability reporting for universities’, International Journal of Sustainability in Higher Education, Vol. 20, No. 6, pp. 1080–1098. http://dx.doi.org/10.1108/IJSHE-08-2018-0139
Kohl, K., Hopkins, C., Barth, M., Michelsen, G., Dlouhá, J., Razak, D. A., Abidin Bin Sanusi, Z. and Toman, I. (2022) ‘A whole-institution approach towards sustainability: a crucial aspect of higher education’s individual and collective engagement with the SDGs and beyond’, International Journal of Sustainability in Higher Education, Vol. 23 No. 2, pp. 218–236. https://doi.org/10.1108/IJSHE-10-2020-0398
Lauder, A., Sari, R. F., Suwartha, N. and Tjahjono, G. (2015) ‘Critical review of a global campus sustainability ranking: GreenMetric’, Journal of Cleaner Production, Vol. 108, pp. 852–863. http://doi.org/10.1016/j.jclepro.2015.02.080
Lozano, R. (2006) ‘A Tool for a Graphical Assessment of Sustainability in Universities (GASU)’, Journal of Cleaner Production, Vol. 14, No. 9–11, pp. 963–972. http://doi.org/10.1016/j.jclepro.2005.11.041
Lozano, R., Ceulemans, K., Alonso-Almeida, M., Huisingh, D., Lozano, F.J., Waas, T., Lambrechts, W., Lukman, R. and Hugé, J. (2015) ‘A review of commitment and implementation of sustainable development in higher education: Results from a worldwide survey’, Journal of Cleaner Production, Vol. 108, Part A, pp. 1–18. http://dx.doi.org/10.1016/j.jclepro.2014.09.048
Luptáčik, M. and Nežinský, E. (2022) ‘Measuring income inequalities beyond the Gini coefficient’, Central European Journal of Operations Research, Vol. 28, No. 2, pp. 561–578. https://doi.org/10.1007/s10100-019-00662-9
Mahlberg, B. and Obersteiner, M. (2001) ‘Remeasuring the HDI by data envelopment analysis’, International Institute for Applied Systems Analysis Interim Report, pp. 1–69. https://dx.doi.org/10.2139/ssrn.1999372
Masaryk University (2022) UNILEAD project, [Online], Available: https://sustain.muni.cz/en/about-us/who-we-are-and-what-we-do/unilead-project [22 Nov 2022].
Mori Junior, R., Fien, J. and Horne, R. (2019) ‘Implementing the UN SDGs in universities: Challenges, opportunities, and lessons learned’, Sustainability: The Journal of Record, Vol. 12, No. 2, pp. 129–133. https://doi.org/10.1089/sus.2019.0004
Nousheen, A., Zai, S. A. Y., Waseem, M. and Khan, S. A. (2020) ‘Education for sustainable development (ESD): Effects of sustainability education on pre-service teachers’ attitude towards sustainable development (SD)’, Journal of Cleaner Production, Vol. 250, pp. 119537. https://doi.org/10.1016/j.jclepro.2019.119537
Pedro, E.d.M., Leitão, J. and Alves, H. (2022) ‘Do socially responsible higher education institutions contribute to sustainable regional growth and innovation?’, International Journal of Sustainability in Higher Education, Vol. 23, No. 8, pp. 232–254. https://doi.org/10.1108/IJSHE-09-2021-0400
Purcell, W. M., Henriksen, H. and Spengler, J. D. (2019) ‘Universities as the engine of transformational sustainability toward delivering the sustainable development goals: “Living labs” for sustainability’, International Journal of Sustainability in Higher Education, Vol. 20, No. 8, pp. 1343–1357. http://dx.doi.org/10.1108/IJSHE-02-2019-0103
Quacquarelli Symonds (2023) QS Sustainability Rankings, [Online], Available: https://www.topuniversities.com/university-rankings/sustainability-rankings/2023 [30 Aug 2023].
Ragazzi, M. and Ghidini, F. (2017) ‘Environmental Sustainability of Universities: Critical Analysis of a Green Ranking’, Energy Procedia, Vol. 119, pp. 111–120. https://doi.org/10.1016/j.egypro.2017.07.054
Sachs, J. D., Lafortune, G., Fuller, G. and Drumm, E. (2022) Sustainable Development Report, [Online], Available: https://dashboards.sdgindex.org/ [22 Nov 2022].
Shen, Y., Hermans, E., Brijs, T. and Wets, G. (2013) ‘Data Envelopment Analysis for Composite Indicators: A Multiple Layer Model’, Social Indicators Research, Vol. 114, No. 2, pp. 739–756. https://doi.org/10.1007/s11205-012-0171-0
Tang, K. H. D. (2018) ‘Correlation between sustainability education and engineering students’ attitudes towards sustainability’, International Journal of Sustainability in Higher Education, Vol. 19, No. 3, pp. 459–472. https://doi.org/10.1108/IJSHE-08-2017-0139
Thomson Reuters (2023) Times Higher Education Impact Rankings, [Online], Available: https://www.timeshighereducation.com/impactrankings [30 Aug 2023]
Thompson, R. G., Langemeier, L. N., Lee, C. T., Lee, E. and Thrall, R. M. (1990) ‘The role of multiplier bounds in efficiency analysis with applications to Kansas farming’, Journal of Econometrics, Vol. 46, No. 1–2, pp. 93–108. https://doi.org/10.1016/0304-4076(90)90049-Y
Thuan P. V., Trung T., Thao T. T. P., Anh H. N., Thanh N. T. and Thuy L. P. (2022) ‘Over Three Decades of Data Envelopment Analysis Applied to the Measurement of Efficiency in Higher Education: A Bibliometric Analysis’, Journal on Efficiency and Responsibility in Education and Science, Vol. 15, No. 4, pp. 168–180. http://dx.doi.org/10.7160/eriesj.2020.130304
UNESCO (1992) Agenda 21, chapter 36, Promoting education, public awareness and training, [Online], Available: http://www.un-documents.net/a21-36.htm [22 Nov 2022].
United Nations (2014) 2030 Agenda for Sustainable Development, [Online], Available: https://sdgs.un.org/2030agenda [22 Nov 2022].
Zaim, O., Färe, R., and Grosskopf, S. (2001) ‘An Economic Approach to Achievement and Improvement Indexes’, Social Indicators Research, Vol. 56, pp. 91–118. https://doi.org/10.1023/A:1011837827659
Zhu, J. (2001) ‘Super-efficiency and DEA sensitivity analysis’, European Journal of Operational Research, Vol. 129, No. 2, pp 443–455. https://doi.org/10.1016/S0377-2217(99)00433-6
Additional Files
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2023 Markéta Matulová
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors declare with this manuscript intended for publication to ERIES Journal that:
- all co-authors agree with the publication of the manuscript even after amendments arising from peer review;
- all co-authors agree with the posting of the full text of this work on the web page of ERIES Journal and to the inclusion of references in databases accessible on the internet;
- no results of other researchers were used in the submitted manuscript without their consent, proper citation, or acknowledgement of their cooperation or material provided;
- the results (or any part of them) used in the manuscript have not been sent for publication to any other journal nor have they already been published (or if so, that the relevant works are cited in this manuscript);
- submission of the manuscript for publication was completed in accordance with the publishing regulations pertaining to place of work;
- experiments performed comply with current laws and written consent of the Scientific Ethics Committee / National Animal Care Authority (as is mentioned in the manuscript submitted);
- grant holders confirm that they have been informed of the submitted manuscript and they agree to its publication.
Authors retain copyright and grant ERIES Journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the published work with an acknowledgement of its initial publication in ERIES Journal. Moreover, authors are able to post the published work in an institutional repository with an acknowledgement of its initial publication in ERIES Journal. In addition, authors are permitted and encouraged to post the published work online (e.g. institutional repositories or on their website) as it can lead to productive exchanges, as well as earlier and greater citation of published work.
