Over Three Decades of Data Envelopment Analysis Applied to the Measurement of Efficiency in Higher Education: A Bibliometric Analysis
DOI:
https://doi.org/10.7160/eriesj.2022.150406Keywords:
Bibliometric, Data Envelopment Analysis, Efficiency, Higher education, ScopusAbstract
The higher education efficiency evaluation model using the data envelopment analysis method has interested many researchers. This paper uses bibliometric analysis on publications extracted from the Scopus database to provide a comprehensive overview of research publications on the measurement of higher education efficiency based on data envelopment analysis: its growth rate, major collaboration networks, the most important and popular research topic. A total of 169 related publications were collected and analyzed from 1988 to 2021. The analysis results show that: Publications published every year have increased sharply in the last six years; The quality of publications is relatively high as publications tend to be published in journals with high-ranking indexes; Countries with the most influence in studies on this topic are: Italy, China, Spain, the USA, and the United Kingdom; Authors with the most influence in this research direction are Agasisti T., Abbott M., Doucouliagos C., Avkiran N.K., and Johnes J.; The research cooperation among countries and among affiliations is not strong. Finally, the paper has provided recommendations for future studies based on the findings.
References
Abbott, M. and Doucouliagos, C. (2003) ‘The efficiency of Australian universities: a data envelopment analysis’, Economics of Education Review, Vol. 22, No. 1, pp. 89–97. https://doi.org/10.1016/S0272-7757(01)00068-1
Abramo, G., Cicero, T. and D’Angelo, C. A. (2011) ‘A field-standardized application of DEA to national-scale research assessment of universities’, Journal of Informetrics, Vol. 5, No. 4, pp. 618–628. https://doi.org/10.1016/j.joi.2011.06.001
Abramo, G. and D’Angelo, C. A. (2009) ‘Assessing technical and cost efficiency of research activities: A case study of the Italian university system’, Research Evaluation, Vol. 18, No. 1, pp. 61–70. https://doi.org/10.3152/095820209X408869
Abramo, G., D’Angelo, C. A. and Pugini, F. (2008) ‘The measurement of Italian universities’ research productivity by a non parametric-bibliometric methodology’, Scientometrics, Vol. 76, No. 2, pp. 225–244. https://doi.org/10.1007/s11192-007-1942-2
Agasisti, T. (2011) ‘Performances and spending efficiency in higher education: A European comparison through non-parametric approaches’, Education Economics, Vol. 19, No. 2, pp. 199–224. https://doi.org/10.1080/09645290903094174
Agasisti, T. and Pérez-Esparrells, C. (2010) ‘Comparing efficiency in a cross-country perspective: The case of Italian and Spanish state universities’, Higher Education, Vol. 59, No. 1, pp. 85–103. https://doi.org/10.1007/s10734-009-9235-8
Ahn, T., Charnes, A. and Cooper, W. W. (1988) ‘Some statistical and DEA evaluations of relative efficiencies of public and private institutions of higher learning’, Socio-Economic Planning Sciences, Vol. 22, No. 6, pp. 259–269. https://doi.org/10.1016/0038-0121(88)90008-0
Aigner, D., Lovell, C. A. K. and Schmidt, P. (1977) ‘Formulation and estimation of stochastic frontier production function models’, Journal of Econometrics, Vol. 6, No. 1, pp. 21–37. https://doi.org/10.1016/0304-4076(77)90052-5
Andersson, C., Antelius, J., Månsson, J. and Sund, K. (2017) ‘Technical efficiency and productivity for higher education institutions in Sweden’, Scandinavian Journal of Educational Research, Vol. 61, No. 2, pp. 205–223. https://doi.org/10.1080/00313831.2015.1120230
Andersson, C. and Sund, K. (2021) ‘Technical Efficiency and Productivity of Higher Education Institutions in the Nordic Countries’, International Journal of Public Administration, Vol. 45, No. 2, pp. 107–120. https://doi.org/10.1080/01900692.2020.1868508
Avkiran, N. K. (2001) ‘Investigating technical and scale efficiencies of Australian universities through data envelopment analysis’, Socio-Economic Planning Sciences, Vol. 35, No. 1, pp. 57–80. https://doi.org/10.1016/S0038-0121(00)00010-0
Börner, K., Chen, C. and Boyack, K. W. (2005) ‘Visualizing knowledge domains’, Annual Review of Information Science and Technology, Vol. 37, No. 1, pp. 179–255. https://doi.org/10.1002/aris.1440370106
Cavaignac, L. and Petiot, R. (2017) ‘A quarter century of Data Envelopment Analysis applied to the transport sector: A bibliometric analysis’, Socio-Economic Planning Sciences, Vol. 57, pp. 84–96. https://doi.org/10.1016/j.seps.2016.11.003
Charnes, A., Cooper, W. W. and Rhodes, E. (1978) ‘Measuring the efficiency of decision making units’, European Journal of Operational Research, Vol. 2, No. 6, pp. 429–444. https://doi.org/10.1016/0377-2217(78)90138-8
Cohan, A., Ammar, W., van Zuylen, M. and Cady, F. (2019) ‘Structural scaffolds for citation intent classification in scientific publications’, In NAACL HLT 2019 - 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - Proceedings of the Conference (Vol. 1, pp. 3586–3596), Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/n19-1361
Cooper, W. W., Seiford, L. M. and Zhu, J. (2011) Handbook on data envelopment analysis, , New York: Springer Science & Business Media.
Daghbashyan, Z. (2009) Do university units differ in the efficiency of resource utilization?, Working Paper Series in Economics and Institutions of Innovation 176, Royal Institute of Technology, CESIS - Centre of Excellence for Science and Innovation Studies.
Ferro, G. and D'Eelia, V. (2020) ‘Higher education efficiency frontier analysis: A review of variables to consider’, Journal on Efficiency and Responsibility in Education and Science, Vol. 13, No. 3, pp. 140–153. https://doi.org/10.7160/eriesj.2020.130304
Flegg, A. T., Allen, D. O., Field, K. and Thurlow, T. W. (2004) ‘Measuring the efficiency of British universities: A multi-period data envelopment analysis’, Education Economics, Vol. 12, No. 3, pp. 231–249. https://doi.org/10.1080/0904529042000258590
Guccio, C, Martorana, M. F. and Mazza, I. (2016a) ‘Efficiency assessment and convergence in teaching and research in Italian public universities’, Scientometrics, Vol. 107, No. 3, pp. 1063–1094. https://doi.org/10.1007/s11192-016-1903-8
Guccio, C, Martorana, M. F. and Monaco, L. (2016b) ‘Evaluating the impact of the Bologna Process on the efficiency convergence of Italian universities: a non-parametric frontier approach’, Journal of Productivity Analysis, Vol. 45, No. 3, pp. 275–298. https://doi.org/10.1007/s11123-015-0459-6
Guccio, Calogero, Martorana, M. F. and Mazza, I. (2017) ‘The efficiency change of Italian public universities in the new millennium: a non-parametric analysis’, Tertiary Education and Management, Vol. 23, No. 3, pp. 222–236. https://doi.org/10.1080/13583883.2017.1329451
Ha, C. T., Thao, T. T. P., Trung, N. T., Huong, L. T. T., Dinh, N. Van and Trung, T. (2020) ‘A Bibliometric Review of Research on STEM Education in ASEAN: Science Mapping the Literature in Scopus Database, 2000 to 2019’, Eurasia Journal of Mathematics, Science and Technology Education, Vol. 16, No. 10, pp. em1889. https://doi.org/10.29333/ejmste/8500
Ibrahim, C. and Fadhli, R. (2021) ‘Performance of Indonesia’s World-Class University Efficiency with Bibliometrics (Scientific Strength) Approach and Data Envelopment Analysis’, Webology, Vol. 18, No. 1, pp. 32–50. https://doi.org/10.14704/WEB/V18I1/WEB18003
Johnes, G. and Johnes, J. (1992) ‘Apples and oranges: The aggregation problem in publications analysis’, Scientometrics, Vol. 25, No. 2, pp. 353–365. https://doi.org/10.1007/BF02028091
Johnes, J. (2006) ‘Data envelopment analysis and its application to the measurement of efficiency in higher education’, Economics of Education Review, Vol. 25, No. 3, pp. 273–288. https://doi.org/10.1016/j.econedurev.2005.02.005
Johnes, J. and Johnes, G. (1995) ‘Research funding and performance in U.K. University Departments of Economics: A frontier analysis’, Economics of Education Review, Vol. 14, No. 3, pp. 301–314. https://doi.org/10.1016/0272-7757(95)00008-8
Kosor, M. M. (2013) ‘Efficiency Measurement in Higher Education: Concepts, Methods and Perspective’, Procedia - Social and Behavioral Sciences, Vol. 106, pp. 1031–1038. https://doi.org/10.1016/j.sbspro.2013.12.117
Lampe, H. W. and Hilgers, D. (2015) ‘Trajectories of efficiency measurement: A bibliometric analysis of DEA and SFA’, European Journal of Operational Research, Vol. 240, No. 1, 1–21. https://doi.org/10.1016/j.ejor.2014.04.041
Liu, W. (2019) ‘The data source of this study is Web of Science Core Collection? Not enough’, Scientometrics, Vol. 121, No. 3, pp. 1815–1824. https://doi.org/10.1007/s11192-019-03238-1
McMahon, W. W. (1983) Efficiency and equity criteria for educational budgeting and finance, In W. W. McMahon & T. Geske (eds.), Financing education: overcoming inefficiency and inequity (pp. 1–30), University of Illinois Press.
McMillan, M. L. and Datta, D. (1998) ‘The relative efficiencies of Canadian universities: A DEA perspective’, Canadian Public Policy, Vol. 24, No. 4, pp. 509–511. https://doi.org/10.2307/3552021
Meeusen, W. and van Den Broeck, J. (1977) ‘Efficiency Estimation from Cobb-Douglas Production Functions with Composed Error’, International Economic Review, Vol. 18, No. 2, pp. 435–444. https://doi.org/10.2307/2525757
Merigó, J. M., Gil-Lafuente, A. M. and Yager, R. R. (2015) ‘An overview of fuzzy research with bibliometric indicators’, Applied Soft Computing, Vol. 27, pp. 420–433. https://doi.org/10.1016/j.asoc.2014.10.035
Mikušová, P. (2017) ‘Measuring the efficiency of the Czech public higher education institutions: An application of DEA’, Journal on Efficiency and Responsibility in Education and Science, Vol. 10, No. 2, pp. 58–63. https://doi.org/10.7160/eriesj.2017.100204
Mongeon, P. and Paul-Hus, A. (2016) ‘The journal coverage of Web of Science and Scopus: a comparative analysis’, Scientometrics, Vol. 106, No. 1, pp. 213–228. https://doi.org/10.1007/s11192-015-1765-5
Moral-Muñoz, J. A., Herrera-Viedma, E., Santisteban-Espejo, A. and Cobo, M. J. (2020) ‘Software tools for conducting bibliometric analysis in science: An up-to-date review’, El Profesional de La Información, Vol. 29, No. 1, pp. 1–20. https://doi.org/10.3145/epi.2020.ene.03
Özkaya, A. (2019) ‘Bibliometric Analysis of the Publications Made in STEM Education Area’, Bartın Üniversitesi Eğitim Fakültesi Dergisi, Vol. 8, No. 2, pp. 590–628. https://doi.org/10.14686/buefad.450825
Pham-Duc, B., Nguyen, H., Le Minh, C., Khanh, L. H. and Trung, T. (2020) ‘A Bibliometric and Content Analysis of Articles in Remote Sensing From Vietnam Indexed in Scopus for the 2000–2019 Period’, Serials Review, Vol. 46, No. 4, pp. 275–285. https://doi.org/10.1080/00987913.2020.1854155
Pham-Duc, B., Tran, T., Trinh, T.-P.-T., Nguyen, T.-T., Nguyen, N.-T. and Le, H.-T.-T. (2020) ‘A spike in the scientific output on social sciences in Vietnam for recent three years: Evidence from bibliometric analysis in Scopus database (2000–2019)’, Journal of Information Science, Vol. 8, No. 5, pp. 623–639. https://doi.org/10.1177/0165551520977447
Ramírez-Gutiérrez, Z., Barrachina-Palanca, M. and Ripoll-Feliu, V. M. (2019) ‘University rankings disclosure and efficiency in higher education: A bibliometric and systematic analysis’, Revista de Educación, Vol. 384, pp. 247–286. https://doi.org/10.4438/1988-592X-RE-2019-384-412
Ruiz-Rosero, J., Ramirez-Gonzalez, G., Williams, J. M., Liu, H., Khanna, R. and Pisharody, G. (2017) ‘Internet of things: A scientometric review’, Symmetry, Vol. 9, No. 12, p. 301. https://doi.org/10.3390/sym9120301
Rusydiana, A. S., Rahmawati, R. and Shafitranata, S. (2021) ‘DEA on Islamic Banking: A Bibliometric Study and Critical Perspective’, Library Philosophy and Practice, 4904.
Semantic Scholar (2022) AI-Powered Research Tool, [Online], Available at: https://www.semanticscholar.org/ [15 Jun 2022].
Simar, L. and Wilson, P. W. (1998) ‘Sensitivity analysis of efficiency scores: How to bootstrap in nonparametric frontier models’, Management Science, Vol. 44, No. 1, pp. 49–61. https://doi.org/10.1287/mnsc.44.1.49
Trianni, A., Merigó, J. M. and Bertoldi, P. (2018) ‘Ten years of Energy Efficiency: A bibliometric analysis’, Energy Efficiency, Vol. 11, No. 8, pp. 1917–1939. https://doi.org/10.1007/s12053-018-9762-1
Tyagi, P., Yadav, S. P. and Singh, S. P. (2009) ‘Relative performance of academic departments using DEA with sensitivity analysis’, Evaluation and Program Planning, Vol. 32, No. 2, pp. 168–177. https://doi.org/10.1016/j.evalprogplan.2008.10.002
Viet Nguyen, T., Simioni, M. and Le Van, D. (2019) ‘Assessment of TFP change at provincial level in Vietnam: New evidence using Färe–Primont productivity index’, Economic Analysis and Policy, Vol. 64, pp. 329–345. https://doi.org/10.1016/J.EAP.2019.09.007
Wolszczak-Derlacz, J. and Parteka, A. (2011) ‘Efficiency of European public higher education institutions: A two-stage multicountry approach’, Scientometrics, Vol. 89, No. 3, pp. 887–917. https://doi.org/10.1007/s11192-011-0484-9
Yu, D. and He, X. (2020) ‘A bibliometric study for DEA applied to energy efficiency: Trends and future challenges’, Applied Energy, Vol. 268, 115048. https://doi.org/10.1016/j.apenergy.2020.115048
Zupic, I. and Čater, T. (2015) ‘Bibliometric Methods in Management and Organization’, Organizational Research Methods, Vol. 18, No. 3, pp. 429–472. https://doi.org/10.1177/1094428114562629
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Thuan Pham Van, Trung Tran, Thao Trinh Thi Phuong, Anh Hoang Ngoc, Thanh Nghiem Thi, Thuy La Phuong
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors declare with this manuscript intended for publication to ERIES Journal that:
- all co-authors agree with the publication of the manuscript even after amendments arising from peer review;
- all co-authors agree with the posting of the full text of this work on the web page of ERIES Journal and to the inclusion of references in databases accessible on the internet;
- no results of other researchers were used in the submitted manuscript without their consent, proper citation, or acknowledgement of their cooperation or material provided;
- the results (or any part of them) used in the manuscript have not been sent for publication to any other journal nor have they already been published (or if so, that the relevant works are cited in this manuscript);
- submission of the manuscript for publication was completed in accordance with the publishing regulations pertaining to place of work;
- experiments performed comply with current laws and written consent of the Scientific Ethics Committee / National Animal Care Authority (as is mentioned in the manuscript submitted);
- grant holders confirm that they have been informed of the submitted manuscript and they agree to its publication.
Authors retain copyright and grant ERIES Journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the published work with an acknowledgement of its initial publication in ERIES Journal. Moreover, authors are able to post the published work in an institutional repository with an acknowledgement of its initial publication in ERIES Journal. In addition, authors are permitted and encouraged to post the published work online (e.g. institutional repositories or on their website) as it can lead to productive exchanges, as well as earlier and greater citation of published work.
