Over Three Decades of Data Envelopment Analysis Applied to the Measurement of Efficiency in Higher Education: A Bibliometric Analysis


  • Thuan Pham Van VNU University of Education, Vietnam National University, Hanoi, Vietnam
  • Trung Tran Vietnam Academy for Ethnic Minorities, Hanoi, Vietnam
  • Thao Trinh Thi Phuong Thai Nguyen University of Education, Thai Nguyen University, Thai Nguyen https://orcid.org/0000-0001-6277-4907
  • Anh Hoang Ngoc Tay Bac University, Son La, Vietnam
  • Thanh Nghiem Thi VNU University of Education, Vietnam National University Hanoi, Vietnam
  • Thuy La Phuong VNU University of Education, Vietnam National University Hanoi, Vietnam




Bibliometric, Data Envelopment Analysis, Efficiency, Higher education, Scopus


The higher education efficiency evaluation model using the data envelopment analysis method has interested many researchers. This paper uses bibliometric analysis on publications extracted from the Scopus database to provide a comprehensive overview of research publications on the measurement of higher education efficiency based on data envelopment analysis: its growth rate, major collaboration networks, the most important and popular research topic. A total of 169 related publications were collected and analyzed from 1988 to 2021. The analysis results show that: Publications published every year have increased sharply in the last six years; The quality of publications is relatively high as publications tend to be published in journals with high-ranking indexes; Countries with the most influence in studies on this topic are: Italy, China, Spain, the USA, and the United Kingdom; Authors with the most influence in this research direction are Agasisti T., Abbott M., Doucouliagos C., Avkiran N.K., and Johnes J.; The research cooperation among countries and among affiliations is not strong. Finally, the paper has provided recommendations for future studies based on the findings.


Abbott, M. and Doucouliagos, C. (2003) ‘The efficiency of Australian universities: a data envelopment analysis’, Economics of Education Review, Vol. 22, No. 1, pp. 89–97. https://doi.org/10.1016/S0272-7757(01)00068-1

Abramo, G., Cicero, T. and D’Angelo, C. A. (2011) ‘A field-standardized application of DEA to national-scale research assessment of universities’, Journal of Informetrics, Vol. 5, No. 4, pp. 618–628. https://doi.org/10.1016/j.joi.2011.06.001

Abramo, G. and D’Angelo, C. A. (2009) ‘Assessing technical and cost efficiency of research activities: A case study of the Italian university system’, Research Evaluation, Vol. 18, No. 1, pp. 61–70. https://doi.org/10.3152/095820209X408869

Abramo, G., D’Angelo, C. A. and Pugini, F. (2008) ‘The measurement of Italian universities’ research productivity by a non parametric-bibliometric methodology’, Scientometrics, Vol. 76, No. 2, pp. 225–244. https://doi.org/10.1007/s11192-007-1942-2

Agasisti, T. (2011) ‘Performances and spending efficiency in higher education: A European comparison through non-parametric approaches’, Education Economics, Vol. 19, No. 2, pp. 199–224. https://doi.org/10.1080/09645290903094174

Agasisti, T. and Pérez-Esparrells, C. (2010) ‘Comparing efficiency in a cross-country perspective: The case of Italian and Spanish state universities’, Higher Education, Vol. 59, No. 1, pp. 85–103. https://doi.org/10.1007/s10734-009-9235-8

Ahn, T., Charnes, A. and Cooper, W. W. (1988) ‘Some statistical and DEA evaluations of relative efficiencies of public and private institutions of higher learning’, Socio-Economic Planning Sciences, Vol. 22, No. 6, pp. 259–269. https://doi.org/10.1016/0038-0121(88)90008-0

Aigner, D., Lovell, C. A. K. and Schmidt, P. (1977) ‘Formulation and estimation of stochastic frontier production function models’, Journal of Econometrics, Vol. 6, No. 1, pp. 21–37. https://doi.org/10.1016/0304-4076(77)90052-5

Andersson, C., Antelius, J., Månsson, J. and Sund, K. (2017) ‘Technical efficiency and productivity for higher education institutions in Sweden’, Scandinavian Journal of Educational Research, Vol. 61, No. 2, pp. 205–223. https://doi.org/10.1080/00313831.2015.1120230

Andersson, C. and Sund, K. (2021) ‘Technical Efficiency and Productivity of Higher Education Institutions in the Nordic Countries’, International Journal of Public Administration, Vol. 45, No. 2, pp. 107–120. https://doi.org/10.1080/01900692.2020.1868508

Avkiran, N. K. (2001) ‘Investigating technical and scale efficiencies of Australian universities through data envelopment analysis’, Socio-Economic Planning Sciences, Vol. 35, No. 1, pp. 57–80. https://doi.org/10.1016/S0038-0121(00)00010-0

Börner, K., Chen, C. and Boyack, K. W. (2005) ‘Visualizing knowledge domains’, Annual Review of Information Science and Technology, Vol. 37, No. 1, pp. 179–255. https://doi.org/10.1002/aris.1440370106

Cavaignac, L. and Petiot, R. (2017) ‘A quarter century of Data Envelopment Analysis applied to the transport sector: A bibliometric analysis’, Socio-Economic Planning Sciences, Vol. 57, pp. 84–96. https://doi.org/10.1016/j.seps.2016.11.003

Charnes, A., Cooper, W. W. and Rhodes, E. (1978) ‘Measuring the efficiency of decision making units’, European Journal of Operational Research, Vol. 2, No. 6, pp. 429–444. https://doi.org/10.1016/0377-2217(78)90138-8

Cohan, A., Ammar, W., van Zuylen, M. and Cady, F. (2019) ‘Structural scaffolds for citation intent classification in scientific publications’, In NAACL HLT 2019 - 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - Proceedings of the Conference (Vol. 1, pp. 3586–3596), Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/n19-1361

Cooper, W. W., Seiford, L. M. and Zhu, J. (2011) Handbook on data envelopment analysis, , New York: Springer Science & Business Media.

Daghbashyan, Z. (2009) Do university units differ in the efficiency of resource utilization?, Working Paper Series in Economics and Institutions of Innovation 176, Royal Institute of Technology, CESIS - Centre of Excellence for Science and Innovation Studies.

Ferro, G. and D'Eelia, V. (2020) ‘Higher education efficiency frontier analysis: A review of variables to consider’, Journal on Efficiency and Responsibility in Education and Science, Vol. 13, No. 3, pp. 140–153. https://doi.org/10.7160/eriesj.2020.130304

Flegg, A. T., Allen, D. O., Field, K. and Thurlow, T. W. (2004) ‘Measuring the efficiency of British universities: A multi-period data envelopment analysis’, Education Economics, Vol. 12, No. 3, pp. 231–249. https://doi.org/10.1080/0904529042000258590

Guccio, C, Martorana, M. F. and Mazza, I. (2016a) ‘Efficiency assessment and convergence in teaching and research in Italian public universities’, Scientometrics, Vol. 107, No. 3, pp. 1063–1094. https://doi.org/10.1007/s11192-016-1903-8

Guccio, C, Martorana, M. F. and Monaco, L. (2016b) ‘Evaluating the impact of the Bologna Process on the efficiency convergence of Italian universities: a non-parametric frontier approach’, Journal of Productivity Analysis, Vol. 45, No. 3, pp. 275–298. https://doi.org/10.1007/s11123-015-0459-6

Guccio, Calogero, Martorana, M. F. and Mazza, I. (2017) ‘The efficiency change of Italian public universities in the new millennium: a non-parametric analysis’, Tertiary Education and Management, Vol. 23, No. 3, pp. 222–236. https://doi.org/10.1080/13583883.2017.1329451

Ha, C. T., Thao, T. T. P., Trung, N. T., Huong, L. T. T., Dinh, N. Van and Trung, T. (2020) ‘A Bibliometric Review of Research on STEM Education in ASEAN: Science Mapping the Literature in Scopus Database, 2000 to 2019’, Eurasia Journal of Mathematics, Science and Technology Education, Vol. 16, No. 10, pp. em1889. https://doi.org/10.29333/ejmste/8500

Ibrahim, C. and Fadhli, R. (2021) ‘Performance of Indonesia’s World-Class University Efficiency with Bibliometrics (Scientific Strength) Approach and Data Envelopment Analysis’, Webology, Vol. 18, No. 1, pp. 32–50. https://doi.org/10.14704/WEB/V18I1/WEB18003

Johnes, G. and Johnes, J. (1992) ‘Apples and oranges: The aggregation problem in publications analysis’, Scientometrics, Vol. 25, No. 2, pp. 353–365. https://doi.org/10.1007/BF02028091

Johnes, J. (2006) ‘Data envelopment analysis and its application to the measurement of efficiency in higher education’, Economics of Education Review, Vol. 25, No. 3, pp. 273–288. https://doi.org/10.1016/j.econedurev.2005.02.005

Johnes, J. and Johnes, G. (1995) ‘Research funding and performance in U.K. University Departments of Economics: A frontier analysis’, Economics of Education Review, Vol. 14, No. 3, pp. 301–314. https://doi.org/10.1016/0272-7757(95)00008-8

Kosor, M. M. (2013) ‘Efficiency Measurement in Higher Education: Concepts, Methods and Perspective’, Procedia - Social and Behavioral Sciences, Vol. 106, pp. 1031–1038. https://doi.org/10.1016/j.sbspro.2013.12.117

Lampe, H. W. and Hilgers, D. (2015) ‘Trajectories of efficiency measurement: A bibliometric analysis of DEA and SFA’, European Journal of Operational Research, Vol. 240, No. 1, 1–21. https://doi.org/10.1016/j.ejor.2014.04.041

Liu, W. (2019) ‘The data source of this study is Web of Science Core Collection? Not enough’, Scientometrics, Vol. 121, No. 3, pp. 1815–1824. https://doi.org/10.1007/s11192-019-03238-1

McMahon, W. W. (1983) Efficiency and equity criteria for educational budgeting and finance, In W. W. McMahon & T. Geske (eds.), Financing education: overcoming inefficiency and inequity (pp. 1–30), University of Illinois Press.

McMillan, M. L. and Datta, D. (1998) ‘The relative efficiencies of Canadian universities: A DEA perspective’, Canadian Public Policy, Vol. 24, No. 4, pp. 509–511. https://doi.org/10.2307/3552021

Meeusen, W. and van Den Broeck, J. (1977) ‘Efficiency Estimation from Cobb-Douglas Production Functions with Composed Error’, International Economic Review, Vol. 18, No. 2, pp. 435–444. https://doi.org/10.2307/2525757

Merigó, J. M., Gil-Lafuente, A. M. and Yager, R. R. (2015) ‘An overview of fuzzy research with bibliometric indicators’, Applied Soft Computing, Vol. 27, pp. 420–433. https://doi.org/10.1016/j.asoc.2014.10.035

Mikušová, P. (2017) ‘Measuring the efficiency of the Czech public higher education institutions: An application of DEA’, Journal on Efficiency and Responsibility in Education and Science, Vol. 10, No. 2, pp. 58–63. https://doi.org/10.7160/eriesj.2017.100204

Mongeon, P. and Paul-Hus, A. (2016) ‘The journal coverage of Web of Science and Scopus: a comparative analysis’, Scientometrics, Vol. 106, No. 1, pp. 213–228. https://doi.org/10.1007/s11192-015-1765-5

Moral-Muñoz, J. A., Herrera-Viedma, E., Santisteban-Espejo, A. and Cobo, M. J. (2020) ‘Software tools for conducting bibliometric analysis in science: An up-to-date review’, El Profesional de La Información, Vol. 29, No. 1, pp. 1–20. https://doi.org/10.3145/epi.2020.ene.03

Özkaya, A. (2019) ‘Bibliometric Analysis of the Publications Made in STEM Education Area’, Bartın Üniversitesi Eğitim Fakültesi Dergisi, Vol. 8, No. 2, pp. 590–628. https://doi.org/10.14686/buefad.450825

Pham-Duc, B., Nguyen, H., Le Minh, C., Khanh, L. H. and Trung, T. (2020) ‘A Bibliometric and Content Analysis of Articles in Remote Sensing From Vietnam Indexed in Scopus for the 2000–2019 Period’, Serials Review, Vol. 46, No. 4, pp. 275–285. https://doi.org/10.1080/00987913.2020.1854155

Pham-Duc, B., Tran, T., Trinh, T.-P.-T., Nguyen, T.-T., Nguyen, N.-T. and Le, H.-T.-T. (2020) ‘A spike in the scientific output on social sciences in Vietnam for recent three years: Evidence from bibliometric analysis in Scopus database (2000–2019)’, Journal of Information Science, Vol. 8, No. 5, pp. 623–639. https://doi.org/10.1177/0165551520977447

Ramírez-Gutiérrez, Z., Barrachina-Palanca, M. and Ripoll-Feliu, V. M. (2019) ‘University rankings disclosure and efficiency in higher education: A bibliometric and systematic analysis’, Revista de Educación, Vol. 384, pp. 247–286. https://doi.org/10.4438/1988-592X-RE-2019-384-412

Ruiz-Rosero, J., Ramirez-Gonzalez, G., Williams, J. M., Liu, H., Khanna, R. and Pisharody, G. (2017) ‘Internet of things: A scientometric review’, Symmetry, Vol. 9, No. 12, p. 301. https://doi.org/10.3390/sym9120301

Rusydiana, A. S., Rahmawati, R. and Shafitranata, S. (2021) ‘DEA on Islamic Banking: A Bibliometric Study and Critical Perspective’, Library Philosophy and Practice, 4904.

Semantic Scholar (2022) AI-Powered Research Tool, [Online], Available at: https://www.semanticscholar.org/ [15 Jun 2022].

Simar, L. and Wilson, P. W. (1998) ‘Sensitivity analysis of efficiency scores: How to bootstrap in nonparametric frontier models’, Management Science, Vol. 44, No. 1, pp. 49–61. https://doi.org/10.1287/mnsc.44.1.49

Trianni, A., Merigó, J. M. and Bertoldi, P. (2018) ‘Ten years of Energy Efficiency: A bibliometric analysis’, Energy Efficiency, Vol. 11, No. 8, pp. 1917–1939. https://doi.org/10.1007/s12053-018-9762-1

Tyagi, P., Yadav, S. P. and Singh, S. P. (2009) ‘Relative performance of academic departments using DEA with sensitivity analysis’, Evaluation and Program Planning, Vol. 32, No. 2, pp. 168–177. https://doi.org/10.1016/j.evalprogplan.2008.10.002

Viet Nguyen, T., Simioni, M. and Le Van, D. (2019) ‘Assessment of TFP change at provincial level in Vietnam: New evidence using Färe–Primont productivity index’, Economic Analysis and Policy, Vol. 64, pp. 329–345. https://doi.org/10.1016/J.EAP.2019.09.007

Wolszczak-Derlacz, J. and Parteka, A. (2011) ‘Efficiency of European public higher education institutions: A two-stage multicountry approach’, Scientometrics, Vol. 89, No. 3, pp. 887–917. https://doi.org/10.1007/s11192-011-0484-9

Yu, D. and He, X. (2020) ‘A bibliometric study for DEA applied to energy efficiency: Trends and future challenges’, Applied Energy, Vol. 268, 115048. https://doi.org/10.1016/j.apenergy.2020.115048

Zupic, I. and Čater, T. (2015) ‘Bibliometric Methods in Management and Organization’, Organizational Research Methods, Vol. 18, No. 3, pp. 429–472. https://doi.org/10.1177/1094428114562629

Additional Files



How to Cite

Pham Van, T., Tran, T., Trinh Thi Phuong, T., Hoang Ngoc, A., Nghiem Thi, T. and La Phuong, T. (2022) ’Over Three Decades of Data Envelopment Analysis Applied to the Measurement of Efficiency in Higher Education: A Bibliometric Analysis’, Journal on Efficiency and Responsibility in Education and Science, vol. 15, no. 4, pp. 251–265. https://doi.org/10.7160/eriesj.2022.150406



Review study