Identification of Effectiveness Measurements and Bias Publication of Literature Results Study

A Cooperative Learning Models on Mathematics Learning Outcomes of Vocational School Students in Indonesia

Authors

  • M. Rais Ridwan Graduate School, Study Program of Research and Evaluation Education, Universitas Negeri Yogyakarta https://orcid.org/0000-0003-1747-5128
  • Samsul Hadi Department of Electrical Engineering Education, Faculty of Engineering, Universitas Negeri Yogyakarta
  • Jailani Department of Mathematics Education, Faculty of Mathematics and Education, Universitas Negeri Yogyakarta

DOI:

https://doi.org/10.7160/eriesj.2022.150306

Keywords:

Cooperative learning model, funnel plot, mathematics learning outcomes, meta-analysis, publication bias

Abstract

This meta-analysis intends to determine the impact of cooperative learning model research findings on the mathematics learning outcomes of Indonesian vocational high school students. Based on moderator variables, such as grade level and student sample size, identify efficacy and publication bias measures. Data from descriptive analysis, which included the mean, standard deviation, and sample size, were collected from 21 research projects based on applying the cooperative learning model in the experimental group and direct learning in the control class. Forest plot analysis was the data analysis method used. The results of the measure of the effectiveness of the cooperative learning model on mathematics learning outcomes in grades 10 and 11 were 0.87 and 0.92, with each effect size category being medium. While the effectiveness of the learning model is measured using a sample size of 1 to 30 students, and more than 30 students were 0.94 and 0.83, respectively, each has a medium effect size category.  The results of other analyses show no publication bias. The findings of this study provided teachers with information on how to apply effective cooperative learning models to mathematical learning outcomes in 10th and 11th grade and the efficiency of learning with large class size.

Author Biographies

M. Rais Ridwan, Graduate School, Study Program of Research and Evaluation Education, Universitas Negeri Yogyakarta

1Graduate School, Study Program of Research and Evaluation Education, Universitas Negeri Yogyakarta, Yogyakarta 55281, Indonesia

2Study Program of Mathematics Education, STKIP YPUP Makassar, Makassar 90223, Indonesia
E-mail: mrais.2019@student.uny.ac.id; mraisridwan@stkip.ypup.ac.id

Samsul Hadi, Department of Electrical Engineering Education, Faculty of Engineering, Universitas Negeri Yogyakarta

Ph.D, Professor, Lecturer, Department of Electrical Engineering Education, Faculty of Engineering, Universitas Negeri Yogyakarta, Jl. Colombo No. 1 Karangmalang, Yogyakarta 55281, Indonesia.

Jailani, Department of Mathematics Education, Faculty of Mathematics and Education, Universitas Negeri Yogyakarta

Ph.D, Lecturer, Department of Mathematics Education, Faculty of Mathematics and Science, Universitas Negeri Yogyakarta, Jl. Colombo No. 1 Karangmalang, Yogyakarta 55281, Indonesia.

References

Agustini, K., Wahyuni, D. S., Mertayasa, I. N. E., Wedhanti, N. K. and Sukrawarpala, W. (2021) ‘Student-centered learning models and learning outcomes: Meta-analysis and effect sizes on the students’ thesis’, Journal of Physics: Conference Series, Vol. 1810, 012049, pp. 1–9. https://doi.org/10.1088/1742-6596/1810/1/012049

Baguma, R., Bagarukayo, E., Namubiru, P., Brown, C. and Mayisela, T. (2019) ‘Using WhatsApp in teaching to develop higher order thinking skills-A literature review using the activity theory lens’, International Journal of Education and Development Using Information and Communication Technology, Vol. 15, No. 2, pp. 98–116.

Begg, C. B. and Mazumdar, M. (1994) ‘Operating characteristics of a rank correlation test for publication bias’, Biometrics, Vol. 50, No. 4, pp. 1088–1101. https://doi.org/10.2307/2533446

Bjork, C. (2013) ‘Teacher training, school norms and teacher effectiveness in Indonesia’, in Suryadarma D. and G. Jones, G. W. (ed.), Education in Indonesia, pp. 53–67, Singapore: ISEAS. https://doi.org/10.1355/9789814459877-008

Borenstein, M., Hedges, L. V., Higgins, J. P. T. and Rothstein, H. R. (2009) Introduction to meta-analysis, Chicgester: John Wiley & Sons.

Capar, G. and Tarim, K. (2015) ‘Efficacy of the cooperative learning method on mathematics achievement and attitude: A meta-analysis research’, Educational Sciences: Theory and Practice, Vol. 15, No. 2, pp. 553–559. https://doi.org/10.12738/estp.2015.2.2098

Card, N. A. (2012) Applied meta-analysis for social science research, New York: The Guilford Press.

Cohen, L., Manion, L. and Morrison, K. (2007) Research methods in education, sixth edition, London and New York: Routledge.

Cooper, H. M. (2016) Research synthesis and meta-analysis, fifth edition. Los Angeles: Sage.

Egger, M., Smith, D. G., Schneider, M. and Minder, C. (1997) ‘Bias in meta-analysis detected by a simple, graphical test’, British Medical Journal, Vol. 315, pp. 629–634, https://doi.org/10.1136/bmj.315.7109.629

Ellis, P. D. (2010) The essential guide to effect sizes: Statistical power, meta-analysis, and the interpretation of research result, New York: Cambridge University Press.

Febriani, S., Khamalnah, Pebrianti, D. L. and Fahminingsih, I. (2020) ‘Pengaruh model pembelajaran discovery learning terhadap hasil belajar siswa kelas X SMK Muhammadiyah Kajen [The influence of the Discovery learning model on the learning outcomes of class X students at SMK Muhammadiyah Kajen]’, Prosiding Seminar Nasional Pendidikan Matematika, Pekalongan, pp. 227–231.

Field, A. P. and Gillett, R. (2010) ‘How to do a meta-analysis’, British Journal of Mathematical and Statistical Psychology, Vol. 63, No. 3, pp. 665–694. https://doi.org/10.1348/000711010X502733

Glass, G. V., McGaw, B. and Smith, M. L. (1981) Meta-analysis in social research, Newbury Park: Sage.

Hattie, J. (2009) Visible learning: A synthesis of over 800 meta-analyses relating to achievement, London: Routledge.

Ismail, S. N., Muhammad, S., Kanesan, A. G. and Ali, R. M. (2019) ‘The influence of teachers’ perception and readiness towards the implementation of Critical Thinking Skills (CTS) practice in mathematics’, International Journal of Instruction, Vol. 12, No. 2, pp. 337–352. https://doi.org/10.29333/iji.2019.12222a

Israel, H. and Richter, R. R. (2011) ‘A guide to understanding meta-analysis’, Journal of Orthopedic Sports Physical Therapy, Vol. 41, No. 7, pp. 496–504. https://doi.org/10.2519/jospt.2011.3333

Johnson, D. W., Johnson, R. T. and Smith, K. A. (2014) ‘Cooperative learning: Improving university instruction by basing practice on validated theory’, Journal on Excellence in University Teaching, Vol. 25, No. 3-4, pp. 85–118.

Johnson, D. W. and Johnson, R. T. (2014) ‘Cooperative learning in 21st century’, Anales de Psicología, Vol. 30, No. 3, pp. 841–851. https://doi.org/10.6018/analesps.30.3.201241

Kalaian, S. A. and Kasim, R. M. (2014) ‘A meta-analytic review of studies of the effectiveness of smallgroup learning methods on statistics achievement’, Journal of Statistics Education, Vol. 22, No. 1, pp. 1–20. https://doi.org/10.1080/10691898.2014.11889691

Kumar, R. (2017) The effect of collaborative learning on enhancing student achievement: a meta-analysis, [unpublished thesis], Montreal: Concordia University.

Kyndt, E. Raes, E., Lismont, B., Timmers, F., Cascallar, E. and Dochy, F. (2013) ‘A meta-analysis of the effects of face-to-face cooperative learning. do recent studies falsify or verify earlier findings?’, Educational Research Review, Vol. 10, pp. 133–149. https://doi.org/10.1016/j.edurev.2013.02.002

Lai, E. R. and Viering, M. (2012) ‘Assessing 21st century skills: Integrating research findings’, National Council on Measurement in Education, Vancouver, BC: Pearson.

Mansurah, R., Wahyuningsih, S., Insani, N. and Syaharuddin (2021) ‘Meta-analisis: Model kooperatif Two Stay Two Stray terhadap hasil belajar [Meta-analysis: Two Stay Two Stray cooperative model on learning outcomes]’, Jurnal Elementary, Vol. 4, No. 2, pp. 97–102.

Mullen, B., Muellerleile, P. and Bryant, B. (2001) ‘Cumulative meta-analysis: A consideration of indicators of sufficiency and stability’, Personality and Social Psychology Bulletin, Vol. 27, No. 11, pp. 1450–1462. https://doi.org/10.1177/01461672012711006

Mustofa and Yuwana, H. S. (2016) ‘The development of appreciation learning model of indonesia literature based critical discourse analysis to improve the students’ critical thinking skill’, Journal of Education and Practice, Vol. 7, No. 33, pp. 166–175.

Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., McGuinness, L. A., Stewart, L. A., Thomas, J., Tricco, A. C., Welch, V. A., Whiting, P. and Moher, D. (2021) ‘The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews’, British Medical Journal, Vol. 372, No. 71, pp. 1–9. https://doi.org/10.1136/bmj.n71

Parveen, Q., Yousuf, M. I. and Mustafa, S. (2017) ‘An experimental study on the effect of cooperative learning on students’ academic achievement and students’ perceptions towards cooperative learning’, The Anthropologist, Vol. 27, No. 1-3, pp. 69–76. https://doi.org/10.1080/09720073.2017.1311670

Rahayu, E., Murni, A. and Sakur. (2017) ‘Pengaruh penerapan teknik kancing gemerincing dalam pembelajaran kooperatif tipe STAD terhadap hasil belajar matematika siswa kelas X SMK Kesehatan Pro-Skill Indonesia [The effect of the application of the Clinking Button technique in STAD type cooperative learning on mathematics learning outcomes of class X Students of Indonesian Pro-skill Health Vocational Schools]’, Jurnal Online Mahasiswa Fakultas Keguruan dan Ilmu Pendidikan Universitas Riau, Vol. 4, No. 1, pp. 1–12.

Retnawati, H. Apino, E., Kartianom, Djidu, H. and Anazifa, R. D. (2018) Pengantar Meta Analisis [Introduction to Meta-Analysis], Yogyakarta: Parama Publishing.

Ridwan, M. R., Retnawati, H., Hadi, S. and Jailani. (2021) ‘The effectiveness of innovative learning on mathematical problem- solving ability : A meta-analysis’, International Journal of Research in Education and Science, Vol. 7, No. 3, pp. 910–932. https://doi.org/10.46328/ijres.2287

Ridwan, M. R., Retnawati, H., Hadi, S. and Jailani. (2022). ‘Teachers’ perceptions in applying mathematics critical thinking skills for middle school students : A case of phenomenology. Anatolian Journal of Education, Vol. 7, No. 1, pp. 1–16. https://doi.org/https://doi.org/10.29333/aje.2022.711a

Ridwan, M. R., Hadi, S. and Jailani, J. (2022). ‘A meta-analysis study on the effectiveness of a cooperative learning model on vocational high school students’ mathematics learning outcomes.’ Participatory Educational Research, Vol. 9, No. 4, pp. 396–421. https://doi.org/10.17275/per.22.97.9.4

Rodzalan, S. A. and Saat, M. (2015) ‘The perception of critical thinking and problem-solving skill among malaysian undergraduate students’, Procedia-Social Behaviour Science, Vol. 172, pp. 25–32. https://doi.org/10.1016/j.sbspro.2015.01.425

Rosenthal, R. (1979) ‘The file drawer problem and tolerance for null results’, Psychological Bulletin, Vol. 86, No. 3, pp. 638–641. https://doi.org/10.1037/0033-2909.86.3.638

Rothstein, H. R., Sutton, A. J. and Borenstein, M. (2005) Publication bias in meta-analysis: Prevention, assessment and adjustments, Chichester, UK: John Wiley.

Saavedra, A. R. and Opfer, V. D. (2012) Teaching and learning 21st century skills: Lessons from the learning sciences, New York: Asia Society.

San, I. and Kis A. (2018) ‘Effect of Traditional methods in geometry and numbers learning domains on academic achievement: A meta-analysis study’, International Journal of Research in Education and Science, Vol. 4, No. 2, pp. 544–554. https://doi.org/10.21890/ijres.428950

Setiana, D. S., Ili L., Rumasoreng, M. I. and Prabowo, A. (2020) ‘Relationship between cooperative learning method and students’ mathematics learning achievement: A meta-analysis correlation’, Al-Jabar: Jurnal Pendidikan Matematika, Vol. 11, No. 1, pp. 145–158. https://doi.org/10.24042/ajpm.v11i1.6620

Setiawan, N. D., Susilowati, D. and Farahsanti, I. (2020) ‘Pengaruh model pembelajaran kooperatif tipe Numbered Heads Together terhadap prestasi belajar ditinjau dari kemampuan awal [The influence of Numbered Heads Together type of cooperative learning model on learning achievement in terms of initial ability]’, Jurnal Pendidikan, Sains Sosial, dan Agama, Vol. 6, No. 2, pp. 19–27. https://doi.org/10.53565/pssa.v6i2.196

Setyawan, A., and Leonard (2017) ‘Pengaruh model pembelajaran Contextual Teaching and Learning (CTL) terhadap hasil belajar matematika [The effect of Contextual Teaching and Learning (CTL) learning model on mathematics learning outcomes]’, Prosiding Diskusi Panel Nasional Pendidikan Matematika, pp. 736–745.

Sharan, Y. (2010) ‘Cooperative learning for academic and social gains: Valued pedagogy, problematic practice’, European Journal of Education, Vol. 45, No. 2, pp. 300–313. https://doi.org/10.1111/j.1465-3435.2010.01430.x

Slavin, R. E. (1989) ‘Research on cooperative learning: Consensus and controversy’, Educational Leadership, Vol. 47, No. 4, pp. 52–54.

Slavin, R. E. (2014) ‘Cooperative learning and academic achievement: Why does groupwork work?’, Anales de Psicología, Vol. 30, No. 3, pp. 785–791. https://doi.org/10.6018/analesps.30.3.201201

Springer, L., Stanne, M. E. and Donovan, S. S. (1999) ‘Effects of small-group learning on undergraduates in science, mathematics, engineering and technology: A meta-analysis’, Review of Educational Research, Vol. 69, No. 1, pp. 21–52. https://dx.doi.org/10.2307/1170643

Turgut, S. and Turgut, I. G. (2018) ‘The effects of cooperative learning on mathematics achievement in turkey: A meta-analysis study’, International Journal of Instruction, Vol. 11, No. 3, pp. 663–680. https://doi.org/10.12973/IJI.2018.11345A

Vega, M. L. and Hederich, C. (2015) ‘The impact of a cooperative learning program on the academic achievement in mathematics and language in fourth grade students and its relation to cognitive style’, New Approaches in Educational Research, Vol. 4, No. 2, pp. 84–90. https://doi.org/10.7821/naer.2015.7.124

Wijaya, A., Retnawati, H., Setyaningrum, W., Aoyama, K. and Sugiman (2019) ‘Diagnosing students’ learning difficulties in the eyes of Indonesian mathematics teachers’, Journal on Mathematics Education, Vol. 10, No. 7, pp. 357–64. https://doi.org/10.22342/jme.10.3.7798.357-364

Xie, C., Wang, M. and Hu, H. (2018) ‘Effects of constructivist and transmission instructional models on mathematics achievement in mainland China: A meta-analysis’, Frontiers in Psychology, Vol. 9, 1923, pp. 1–18. https://doi.org/10.3389/fpsyg.2018.01923

Additional Files

Published

2022-09-30

How to Cite

Ridwan, M. R., Hadi, S. and Jailani (2022) ’Identification of Effectiveness Measurements and Bias Publication of Literature Results Study: A Cooperative Learning Models on Mathematics Learning Outcomes of Vocational School Students in Indonesia’, Journal on Efficiency and Responsibility in Education and Science, vol. 15, no. 3, pp. 189–200. https://doi.org/10.7160/eriesj.2022.150306

Issue

Section

Review study