Identification of Effectiveness Measurements and Bias Publication of Literature Results Study
A Cooperative Learning Models on Mathematics Learning Outcomes of Vocational School Students in Indonesia
DOI:
https://doi.org/10.7160/eriesj.2022.150306Keywords:
Cooperative learning model, funnel plot, mathematics learning outcomes, meta-analysis, publication biasAbstract
This meta-analysis intends to determine the impact of cooperative learning model research findings on the mathematics learning outcomes of Indonesian vocational high school students. Based on moderator variables, such as grade level and student sample size, identify efficacy and publication bias measures. Data from descriptive analysis, which included the mean, standard deviation, and sample size, were collected from 21 research projects based on applying the cooperative learning model in the experimental group and direct learning in the control class. Forest plot analysis was the data analysis method used. The results of the measure of the effectiveness of the cooperative learning model on mathematics learning outcomes in grades 10 and 11 were 0.87 and 0.92, with each effect size category being medium. While the effectiveness of the learning model is measured using a sample size of 1 to 30 students, and more than 30 students were 0.94 and 0.83, respectively, each has a medium effect size category. The results of other analyses show no publication bias. The findings of this study provided teachers with information on how to apply effective cooperative learning models to mathematical learning outcomes in 10th and 11th grade and the efficiency of learning with large class size.
References
Agustini, K., Wahyuni, D. S., Mertayasa, I. N. E., Wedhanti, N. K. and Sukrawarpala, W. (2021) ‘Student-centered learning models and learning outcomes: Meta-analysis and effect sizes on the students’ thesis’, Journal of Physics: Conference Series, Vol. 1810, 012049, pp. 1–9. https://doi.org/10.1088/1742-6596/1810/1/012049
Baguma, R., Bagarukayo, E., Namubiru, P., Brown, C. and Mayisela, T. (2019) ‘Using WhatsApp in teaching to develop higher order thinking skills-A literature review using the activity theory lens’, International Journal of Education and Development Using Information and Communication Technology, Vol. 15, No. 2, pp. 98–116.
Begg, C. B. and Mazumdar, M. (1994) ‘Operating characteristics of a rank correlation test for publication bias’, Biometrics, Vol. 50, No. 4, pp. 1088–1101. https://doi.org/10.2307/2533446
Bjork, C. (2013) ‘Teacher training, school norms and teacher effectiveness in Indonesia’, in Suryadarma D. and G. Jones, G. W. (ed.), Education in Indonesia, pp. 53–67, Singapore: ISEAS. https://doi.org/10.1355/9789814459877-008
Borenstein, M., Hedges, L. V., Higgins, J. P. T. and Rothstein, H. R. (2009) Introduction to meta-analysis, Chicgester: John Wiley & Sons.
Capar, G. and Tarim, K. (2015) ‘Efficacy of the cooperative learning method on mathematics achievement and attitude: A meta-analysis research’, Educational Sciences: Theory and Practice, Vol. 15, No. 2, pp. 553–559. https://doi.org/10.12738/estp.2015.2.2098
Card, N. A. (2012) Applied meta-analysis for social science research, New York: The Guilford Press.
Cohen, L., Manion, L. and Morrison, K. (2007) Research methods in education, sixth edition, London and New York: Routledge.
Cooper, H. M. (2016) Research synthesis and meta-analysis, fifth edition. Los Angeles: Sage.
Egger, M., Smith, D. G., Schneider, M. and Minder, C. (1997) ‘Bias in meta-analysis detected by a simple, graphical test’, British Medical Journal, Vol. 315, pp. 629–634, https://doi.org/10.1136/bmj.315.7109.629
Ellis, P. D. (2010) The essential guide to effect sizes: Statistical power, meta-analysis, and the interpretation of research result, New York: Cambridge University Press.
Febriani, S., Khamalnah, Pebrianti, D. L. and Fahminingsih, I. (2020) ‘Pengaruh model pembelajaran discovery learning terhadap hasil belajar siswa kelas X SMK Muhammadiyah Kajen [The influence of the Discovery learning model on the learning outcomes of class X students at SMK Muhammadiyah Kajen]’, Prosiding Seminar Nasional Pendidikan Matematika, Pekalongan, pp. 227–231.
Field, A. P. and Gillett, R. (2010) ‘How to do a meta-analysis’, British Journal of Mathematical and Statistical Psychology, Vol. 63, No. 3, pp. 665–694. https://doi.org/10.1348/000711010X502733
Glass, G. V., McGaw, B. and Smith, M. L. (1981) Meta-analysis in social research, Newbury Park: Sage.
Hattie, J. (2009) Visible learning: A synthesis of over 800 meta-analyses relating to achievement, London: Routledge.
Ismail, S. N., Muhammad, S., Kanesan, A. G. and Ali, R. M. (2019) ‘The influence of teachers’ perception and readiness towards the implementation of Critical Thinking Skills (CTS) practice in mathematics’, International Journal of Instruction, Vol. 12, No. 2, pp. 337–352. https://doi.org/10.29333/iji.2019.12222a
Israel, H. and Richter, R. R. (2011) ‘A guide to understanding meta-analysis’, Journal of Orthopedic Sports Physical Therapy, Vol. 41, No. 7, pp. 496–504. https://doi.org/10.2519/jospt.2011.3333
Johnson, D. W., Johnson, R. T. and Smith, K. A. (2014) ‘Cooperative learning: Improving university instruction by basing practice on validated theory’, Journal on Excellence in University Teaching, Vol. 25, No. 3-4, pp. 85–118.
Johnson, D. W. and Johnson, R. T. (2014) ‘Cooperative learning in 21st century’, Anales de Psicología, Vol. 30, No. 3, pp. 841–851. https://doi.org/10.6018/analesps.30.3.201241
Kalaian, S. A. and Kasim, R. M. (2014) ‘A meta-analytic review of studies of the effectiveness of smallgroup learning methods on statistics achievement’, Journal of Statistics Education, Vol. 22, No. 1, pp. 1–20. https://doi.org/10.1080/10691898.2014.11889691
Kumar, R. (2017) The effect of collaborative learning on enhancing student achievement: a meta-analysis, [unpublished thesis], Montreal: Concordia University.
Kyndt, E. Raes, E., Lismont, B., Timmers, F., Cascallar, E. and Dochy, F. (2013) ‘A meta-analysis of the effects of face-to-face cooperative learning. do recent studies falsify or verify earlier findings?’, Educational Research Review, Vol. 10, pp. 133–149. https://doi.org/10.1016/j.edurev.2013.02.002
Lai, E. R. and Viering, M. (2012) ‘Assessing 21st century skills: Integrating research findings’, National Council on Measurement in Education, Vancouver, BC: Pearson.
Mansurah, R., Wahyuningsih, S., Insani, N. and Syaharuddin (2021) ‘Meta-analisis: Model kooperatif Two Stay Two Stray terhadap hasil belajar [Meta-analysis: Two Stay Two Stray cooperative model on learning outcomes]’, Jurnal Elementary, Vol. 4, No. 2, pp. 97–102.
Mullen, B., Muellerleile, P. and Bryant, B. (2001) ‘Cumulative meta-analysis: A consideration of indicators of sufficiency and stability’, Personality and Social Psychology Bulletin, Vol. 27, No. 11, pp. 1450–1462. https://doi.org/10.1177/01461672012711006
Mustofa and Yuwana, H. S. (2016) ‘The development of appreciation learning model of indonesia literature based critical discourse analysis to improve the students’ critical thinking skill’, Journal of Education and Practice, Vol. 7, No. 33, pp. 166–175.
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., McGuinness, L. A., Stewart, L. A., Thomas, J., Tricco, A. C., Welch, V. A., Whiting, P. and Moher, D. (2021) ‘The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews’, British Medical Journal, Vol. 372, No. 71, pp. 1–9. https://doi.org/10.1136/bmj.n71
Parveen, Q., Yousuf, M. I. and Mustafa, S. (2017) ‘An experimental study on the effect of cooperative learning on students’ academic achievement and students’ perceptions towards cooperative learning’, The Anthropologist, Vol. 27, No. 1-3, pp. 69–76. https://doi.org/10.1080/09720073.2017.1311670
Rahayu, E., Murni, A. and Sakur. (2017) ‘Pengaruh penerapan teknik kancing gemerincing dalam pembelajaran kooperatif tipe STAD terhadap hasil belajar matematika siswa kelas X SMK Kesehatan Pro-Skill Indonesia [The effect of the application of the Clinking Button technique in STAD type cooperative learning on mathematics learning outcomes of class X Students of Indonesian Pro-skill Health Vocational Schools]’, Jurnal Online Mahasiswa Fakultas Keguruan dan Ilmu Pendidikan Universitas Riau, Vol. 4, No. 1, pp. 1–12.
Retnawati, H. Apino, E., Kartianom, Djidu, H. and Anazifa, R. D. (2018) Pengantar Meta Analisis [Introduction to Meta-Analysis], Yogyakarta: Parama Publishing.
Ridwan, M. R., Retnawati, H., Hadi, S. and Jailani. (2021) ‘The effectiveness of innovative learning on mathematical problem- solving ability : A meta-analysis’, International Journal of Research in Education and Science, Vol. 7, No. 3, pp. 910–932. https://doi.org/10.46328/ijres.2287
Ridwan, M. R., Retnawati, H., Hadi, S. and Jailani. (2022). ‘Teachers’ perceptions in applying mathematics critical thinking skills for middle school students : A case of phenomenology. Anatolian Journal of Education, Vol. 7, No. 1, pp. 1–16. https://doi.org/https://doi.org/10.29333/aje.2022.711a
Ridwan, M. R., Hadi, S. and Jailani, J. (2022). ‘A meta-analysis study on the effectiveness of a cooperative learning model on vocational high school students’ mathematics learning outcomes.’ Participatory Educational Research, Vol. 9, No. 4, pp. 396–421. https://doi.org/10.17275/per.22.97.9.4
Rodzalan, S. A. and Saat, M. (2015) ‘The perception of critical thinking and problem-solving skill among malaysian undergraduate students’, Procedia-Social Behaviour Science, Vol. 172, pp. 25–32. https://doi.org/10.1016/j.sbspro.2015.01.425
Rosenthal, R. (1979) ‘The file drawer problem and tolerance for null results’, Psychological Bulletin, Vol. 86, No. 3, pp. 638–641. https://doi.org/10.1037/0033-2909.86.3.638
Rothstein, H. R., Sutton, A. J. and Borenstein, M. (2005) Publication bias in meta-analysis: Prevention, assessment and adjustments, Chichester, UK: John Wiley.
Saavedra, A. R. and Opfer, V. D. (2012) Teaching and learning 21st century skills: Lessons from the learning sciences, New York: Asia Society.
San, I. and Kis A. (2018) ‘Effect of Traditional methods in geometry and numbers learning domains on academic achievement: A meta-analysis study’, International Journal of Research in Education and Science, Vol. 4, No. 2, pp. 544–554. https://doi.org/10.21890/ijres.428950
Setiana, D. S., Ili L., Rumasoreng, M. I. and Prabowo, A. (2020) ‘Relationship between cooperative learning method and students’ mathematics learning achievement: A meta-analysis correlation’, Al-Jabar: Jurnal Pendidikan Matematika, Vol. 11, No. 1, pp. 145–158. https://doi.org/10.24042/ajpm.v11i1.6620
Setiawan, N. D., Susilowati, D. and Farahsanti, I. (2020) ‘Pengaruh model pembelajaran kooperatif tipe Numbered Heads Together terhadap prestasi belajar ditinjau dari kemampuan awal [The influence of Numbered Heads Together type of cooperative learning model on learning achievement in terms of initial ability]’, Jurnal Pendidikan, Sains Sosial, dan Agama, Vol. 6, No. 2, pp. 19–27. https://doi.org/10.53565/pssa.v6i2.196
Setyawan, A., and Leonard (2017) ‘Pengaruh model pembelajaran Contextual Teaching and Learning (CTL) terhadap hasil belajar matematika [The effect of Contextual Teaching and Learning (CTL) learning model on mathematics learning outcomes]’, Prosiding Diskusi Panel Nasional Pendidikan Matematika, pp. 736–745.
Sharan, Y. (2010) ‘Cooperative learning for academic and social gains: Valued pedagogy, problematic practice’, European Journal of Education, Vol. 45, No. 2, pp. 300–313. https://doi.org/10.1111/j.1465-3435.2010.01430.x
Slavin, R. E. (1989) ‘Research on cooperative learning: Consensus and controversy’, Educational Leadership, Vol. 47, No. 4, pp. 52–54.
Slavin, R. E. (2014) ‘Cooperative learning and academic achievement: Why does groupwork work?’, Anales de Psicología, Vol. 30, No. 3, pp. 785–791. https://doi.org/10.6018/analesps.30.3.201201
Springer, L., Stanne, M. E. and Donovan, S. S. (1999) ‘Effects of small-group learning on undergraduates in science, mathematics, engineering and technology: A meta-analysis’, Review of Educational Research, Vol. 69, No. 1, pp. 21–52. https://dx.doi.org/10.2307/1170643
Turgut, S. and Turgut, I. G. (2018) ‘The effects of cooperative learning on mathematics achievement in turkey: A meta-analysis study’, International Journal of Instruction, Vol. 11, No. 3, pp. 663–680. https://doi.org/10.12973/IJI.2018.11345A
Vega, M. L. and Hederich, C. (2015) ‘The impact of a cooperative learning program on the academic achievement in mathematics and language in fourth grade students and its relation to cognitive style’, New Approaches in Educational Research, Vol. 4, No. 2, pp. 84–90. https://doi.org/10.7821/naer.2015.7.124
Wijaya, A., Retnawati, H., Setyaningrum, W., Aoyama, K. and Sugiman (2019) ‘Diagnosing students’ learning difficulties in the eyes of Indonesian mathematics teachers’, Journal on Mathematics Education, Vol. 10, No. 7, pp. 357–64. https://doi.org/10.22342/jme.10.3.7798.357-364
Xie, C., Wang, M. and Hu, H. (2018) ‘Effects of constructivist and transmission instructional models on mathematics achievement in mainland China: A meta-analysis’, Frontiers in Psychology, Vol. 9, 1923, pp. 1–18. https://doi.org/10.3389/fpsyg.2018.01923
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 M. Rais Ridwan, Samsul Hadi, Jailani
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors declare with this manuscript intended for publication to ERIES Journal that:
- all co-authors agree with the publication of the manuscript even after amendments arising from peer review;
- all co-authors agree with the posting of the full text of this work on the web page of ERIES Journal and to the inclusion of references in databases accessible on the internet;
- no results of other researchers were used in the submitted manuscript without their consent, proper citation, or acknowledgement of their cooperation or material provided;
- the results (or any part of them) used in the manuscript have not been sent for publication to any other journal nor have they already been published (or if so, that the relevant works are cited in this manuscript);
- submission of the manuscript for publication was completed in accordance with the publishing regulations pertaining to place of work;
- experiments performed comply with current laws and written consent of the Scientific Ethics Committee / National Animal Care Authority (as is mentioned in the manuscript submitted);
- grant holders confirm that they have been informed of the submitted manuscript and they agree to its publication.
Authors retain copyright and grant ERIES Journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the published work with an acknowledgement of its initial publication in ERIES Journal. Moreover, authors are able to post the published work in an institutional repository with an acknowledgement of its initial publication in ERIES Journal. In addition, authors are permitted and encouraged to post the published work online (e.g. institutional repositories or on their website) as it can lead to productive exchanges, as well as earlier and greater citation of published work.