Ranking of European Universities by DEA-Based Sustainability Indicator





Composite Index, Data Envelopment Analysis, Sustainability Goals, University Ranking


The paper introduces a novel approach to university rankings that considers a university's contribution to sustainable development. It addresses the usual controversies surrounding the construction of rankings using composite indicators. The conventional approach typically involves normalizing sub-indicators and applying subjective weights for aggregation, which raises concerns about the reliability of the rankings. In response to this issue, we propose an alternative method based on Data Envelopment Analysis (DEA) that utilizes flexible weights. Our approach is applied to the data from the UI-GreenMetric World University Ranking. We initially employ a general Benefit of the Doubt DEA model and subsequently enhance its discrimination power by computing super-efficiency. In the third model, we impose weight restrictions on sub-indicators. The results of our analysis offer valuable insights for all stakeholders, as illustrated by the implications derived for Czech universities included in the sample. Furthermore, we compare the results of universities in various European countries, establishing a connection between rankings and the fulfillment of Sustainable Development Goals (SDG) within individual countries. This research contributes to a more comprehensive understanding of the relationship between university performance, sustainability, and the associated implications for policy and benchmarking.


Allen, R., Athanassopoulos, A., Dyson, R. G. and Thanassoulis, E. (1997) ‘Weights restrictions and value judgments in data envelopment analysis: evolution’, development, and future directions, Annals of operations research, Vol. 73, pp. 13–34. https://doi.org/10.1023/A:1018968909638

Andersen, P. and Petersen, N. C. (1993) ‘A Procedure for Ranking Efficient Units in Data Envelopment Analysis’, Management Science, Vol. 39, No. 10, pp. 1261–1264. https://doi.org/10.1287/mnsc.39.10.1261

Atici, K. B., Yasayacak, G., Yildiz, Y. and Ulucan, A. (2021) ‘Green University and Academic Performance: An Empirical Study on UI GreenMetric and World University Rankings’, Journal of Cleaner Production, Vol. 291, 125289. https://doi.org/10.1016/j.jclepro.2020.125289

Banker, R. D. and Natarajan, R. (2008) ‘Evaluating Contextual Variables Affecting Productivity Using Data Envelopment Analysis’, Operations Research, Vol. 56, No. 1, pp. 48–58. http://dx.doi.org/10.1287/opre.1070.0460

Baptista, R., Lima, F. and Mendonça, J. (2011) ‘Establishment of higher education institutions and new firm entry’, Research Policy, Vol. 40, No. 5, pp. 751–760. http://dx.doi.org/10.1016/j.respol.2011.02.006

Boiocchi, R., Ragazzi, M., Torretta, V. and Rada, E.C. (2023) ‘Critical Analysis of the GreenMetric World University Ranking System: The Issue of Comparability’, Sustainability, Vol. 15, No. 2, 1343. https://doi.org/10.3390/su15021343

Boer, P. (2013) ‘Assessing sustainability and social responsibility in higher education assessment frameworks explained’, in Caeiro, S., Filho, W., Jabbour, C., Azeiteiro, U. (eds.) Sustainability Assessment Tools in Higher Education Institutions: Mapping Trends and Good Practices Around the World, Heidelberg: Springer, pp. 121–138. http://dx.doi.org/10.1007/978-3-319-02375-5_7

Charnes, A., Cooper, W. W., Huang, Z. M. and Sun D. B. (1990) ‘Polyhedral cone-ratio DEA models with an illustrative application to large commercial banks’, Journal of Econometrics, Vol. 46, No. 1–2, pp. 73–91. https://doi.org/10.1016/0304-4076(90)90048-X

Cherchye, L., Moesen, W. and Van Puyenbroeck, T. (2004) ‘Legitimately diverse, yet comparable: on synthesizing social inclusion performance in the EU’, Journal of Common Market Studies, Vol. 42, No. 5, pp. 919–955. https://doi.org/10.1111/j.0021-9886.2004.00535.x

Cherchye, L., Moesen, W., Rogge, N. and Van Puyenbroeck, T. (2007) ‘An introduction to “benefit of the doubt” composite indicators’, Social Indicators Research, Vol. 82, No. 1, pp. 111–145. https://doi.org/10.1007/s11205-006-9029-7

Cherchye, L., Moesen, W., Rogge, N., Van Puyenbroeck, T., Saisana, M., Saltelli, A., Liska, R. and Tarantola, S. (2008) ‘Creating Composite Indicators with DEA and Robustness Analysis: The Case of the Technology Achievement Index’, The Journal of the Operational Research Society, Vol. 59, No. 2, pp. 239–251. http://www.jstor.org/stable/30132778

Ceulemans, K., Molderez, I. and Van Liedekerke, L. (2015) ‘Sustainability reporting in higher education: a comprehensive review of the recent literature and paths for further research’, Journal of Cleaner Production, Vol. 106, pp. 127–143. http://dx.doi.org/10.1016/j.jclepro.2014.09.052

Dalal-Clayton, B. and Bass S. (2002) Sustainable development strategies, 1st edition, London: Earthscan Publications.

Despotis, D. K. (2005) ‘A reassessment of the human development index via data envelopment analysis’, Journal of the Operational Research Society, Vol. 56, No. 8. pp. 969–980. https://doi.org/10.1057/palgrave.jors.2601927

Dyson, R. G. and Thanassoulis, E. (1988) ‘Reducing Weight Flexibility in Data Envelopment Analysis’, Journal of the Operational Research Society, Vol. 39, No. 6, pp. 563–576. https://doi.org/10.2307/2582861

European Commission (2004) The EU Economy Review 2004, [Online], Available: https://ec.europa.eu/economy_finance/publications/pages/publication451_en.pdf [9 Sep 2023].

Ferro G. and D‘Elia V. (2020) ‘Higher Education Efficiency Frontier Analysis: A Review of Variables to Consider’, Journal on Efficiency and Responsibility in Education and Science, Vol. 13, No. 3, pp. 140–153. http://dx.doi.org/10.7160/eriesj.2020.130304

Filho, W. (2011) ‘About the Role of Universities and Their Contribution to Sustainable Development’, Higher Education Policy, Vol. 24, pp. 427–438. https://doi.org/10.1057/hep.2011.16

Fritsch, M. and Aamoucke, R. (2017) ‘Fields of knowledge in higher education institutions, and innovative start-ups: an empirical investigation’, Papers in Regional Science, Vol. 96, No. S1, pp. 1–27. https://doi.org/10.1111/pirs.12175

Galleli, B., Teles, N. E. B., Santos, J. A. R. D., Freitas-Martins, M. S. and Hourneaux Junior, F. (2022) ‘Sustainability university rankings: a comparative analysis of UI green metric and the times higher education world university rankings’, International Journal of Sustainability in Higher Education, Vol. 23, No. 2, pp. 404–425. http://dx.doi.org/10.1108/IJSHE-12-2020-0475

Greco, S., Ishizaka, A., Tasiou, M. and Torrisi G. (2019) ‘On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness’, Social Indicators Research, Vol. 141, pp. 61–94. https://doi.org/10.1007/s11205-017-1832-9

GreenMetric World University Ranking (2022) UI GreenMetric, [Online], Available: https://greenmetric.ui.ac.id/ [22 Nov 2022].

Kaur, J. and Kaur, K. (2022) ‘Developing Awareness and Attitude Towards Sustainability Through an Activity-Based Intervention’, Journal on Efficiency and Responsibility in Education and Science, Vol. 15, No. 4, pp. 212–220. http://dx.doi.org/10.7160/eriesj.2022.150402

Klußmann, C., Sassen, R. and Gansel, E. (2019) ‘Structural key factors of participatory sustainability reporting for universities’, International Journal of Sustainability in Higher Education, Vol. 20, No. 6, pp. 1080–1098. http://dx.doi.org/10.1108/IJSHE-08-2018-0139

Kohl, K., Hopkins, C., Barth, M., Michelsen, G., Dlouhá, J., Razak, D. A., Abidin Bin Sanusi, Z. and Toman, I. (2022) ‘A whole-institution approach towards sustainability: a crucial aspect of higher education’s individual and collective engagement with the SDGs and beyond’, International Journal of Sustainability in Higher Education, Vol. 23 No. 2, pp. 218–236. https://doi.org/10.1108/IJSHE-10-2020-0398

Lauder, A., Sari, R. F., Suwartha, N. and Tjahjono, G. (2015) ‘Critical review of a global campus sustainability ranking: GreenMetric’, Journal of Cleaner Production, Vol. 108, pp. 852–863. http://doi.org/10.1016/j.jclepro.2015.02.080

Lozano, R. (2006) ‘A Tool for a Graphical Assessment of Sustainability in Universities (GASU)’, Journal of Cleaner Production, Vol. 14, No. 9–11, pp. 963–972. http://doi.org/10.1016/j.jclepro.2005.11.041

Lozano, R., Ceulemans, K., Alonso-Almeida, M., Huisingh, D., Lozano, F.J., Waas, T., Lambrechts, W., Lukman, R. and Hugé, J. (2015) ‘A review of commitment and implementation of sustainable development in higher education: Results from a worldwide survey’, Journal of Cleaner Production, Vol. 108, Part A, pp. 1–18. http://dx.doi.org/10.1016/j.jclepro.2014.09.048

Luptáčik, M. and Nežinský, E. (2022) ‘Measuring income inequalities beyond the Gini coefficient’, Central European Journal of Operations Research, Vol. 28, No. 2, pp. 561–578. https://doi.org/10.1007/s10100-019-00662-9

Mahlberg, B. and Obersteiner, M. (2001) ‘Remeasuring the HDI by data envelopment analysis’, International Institute for Applied Systems Analysis Interim Report, pp. 1–69. https://dx.doi.org/10.2139/ssrn.1999372

Masaryk University (2022) UNILEAD project, [Online], Available: https://sustain.muni.cz/en/about-us/who-we-are-and-what-we-do/unilead-project [22 Nov 2022].

Mori Junior, R., Fien, J. and Horne, R. (2019) ‘Implementing the UN SDGs in universities: Challenges, opportunities, and lessons learned’, Sustainability: The Journal of Record, Vol. 12, No. 2, pp. 129–133. https://doi.org/10.1089/sus.2019.0004

Nousheen, A., Zai, S. A. Y., Waseem, M. and Khan, S. A. (2020) ‘Education for sustainable development (ESD): Effects of sustainability education on pre-service teachers’ attitude towards sustainable development (SD)’, Journal of Cleaner Production, Vol. 250, pp. 119537. https://doi.org/10.1016/j.jclepro.2019.119537

Pedro, E.d.M., Leitão, J. and Alves, H. (2022) ‘Do socially responsible higher education institutions contribute to sustainable regional growth and innovation?’, International Journal of Sustainability in Higher Education, Vol. 23, No. 8, pp. 232–254. https://doi.org/10.1108/IJSHE-09-2021-0400

Purcell, W. M., Henriksen, H. and Spengler, J. D. (2019) ‘Universities as the engine of transformational sustainability toward delivering the sustainable development goals: “Living labs” for sustainability’, International Journal of Sustainability in Higher Education, Vol. 20, No. 8, pp. 1343–1357. http://dx.doi.org/10.1108/IJSHE-02-2019-0103

Quacquarelli Symonds (2023) QS Sustainability Rankings, [Online], Available: https://www.topuniversities.com/university-rankings/sustainability-rankings/2023 [30 Aug 2023].

Ragazzi, M. and Ghidini, F. (2017) ‘Environmental Sustainability of Universities: Critical Analysis of a Green Ranking’, Energy Procedia, Vol. 119, pp. 111–120. https://doi.org/10.1016/j.egypro.2017.07.054

Sachs, J. D., Lafortune, G., Fuller, G. and Drumm, E. (2022) Sustainable Development Report, [Online], Available: https://dashboards.sdgindex.org/ [22 Nov 2022].

Shen, Y., Hermans, E., Brijs, T. and Wets, G. (2013) ‘Data Envelopment Analysis for Composite Indicators: A Multiple Layer Model’, Social Indicators Research, Vol. 114, No. 2, pp. 739–756. https://doi.org/10.1007/s11205-012-0171-0

Tang, K. H. D. (2018) ‘Correlation between sustainability education and engineering students’ attitudes towards sustainability’, International Journal of Sustainability in Higher Education, Vol. 19, No. 3, pp. 459–472. https://doi.org/10.1108/IJSHE-08-2017-0139

Thomson Reuters (2023) Times Higher Education Impact Rankings, [Online], Available: https://www.timeshighereducation.com/impactrankings [30 Aug 2023]

Thompson, R. G., Langemeier, L. N., Lee, C. T., Lee, E. and Thrall, R. M. (1990) ‘The role of multiplier bounds in efficiency analysis with applications to Kansas farming’, Journal of Econometrics, Vol. 46, No. 1–2, pp. 93–108. https://doi.org/10.1016/0304-4076(90)90049-Y

Thuan P. V., Trung T., Thao T. T. P., Anh H. N., Thanh N. T. and Thuy L. P. (2022) ‘Over Three Decades of Data Envelopment Analysis Applied to the Measurement of Efficiency in Higher Education: A Bibliometric Analysis’, Journal on Efficiency and Responsibility in Education and Science, Vol. 15, No. 4, pp. 168–180. http://dx.doi.org/10.7160/eriesj.2020.130304

UNESCO (1992) Agenda 21, chapter 36, Promoting education, public awareness and training, [Online], Available: http://www.un-documents.net/a21-36.htm [22 Nov 2022].

United Nations (2014) 2030 Agenda for Sustainable Development, [Online], Available: https://sdgs.un.org/2030agenda [22 Nov 2022].

Zaim, O., Färe, R., and Grosskopf, S. (2001) ‘An Economic Approach to Achievement and Improvement Indexes’, Social Indicators Research, Vol. 56, pp. 91–118. https://doi.org/10.1023/A:1011837827659

Zhu, J. (2001) ‘Super-efficiency and DEA sensitivity analysis’, European Journal of Operational Research, Vol. 129, No. 2, pp 443–455. https://doi.org/10.1016/S0377-2217(99)00433-6

Additional Files



How to Cite

Matulová, M. (2023) ’Ranking of European Universities by DEA-Based Sustainability Indicator ’, Journal on Efficiency and Responsibility in Education and Science, vol. 16, no. 4, pp. 287–298. https://doi.org/10.7160/eriesj.2023.160403