Development of the Four-Tier Diagnostic Test to Identify Student Misconceptions in the Static Fluids Chapter
DOI:
https://doi.org/10.7160/eriesj.2025.180403Keywords:
conceptual understanding, four-tier diagnostic test, misconceptions, static fluids, WinstepAbstract
Misconceptions about static fluid concepts in physics are common among students, making it essential for teachers to identify and address them. This research aims to develop and evaluate the quality of a four-tier diagnostic test instrument and identify student misconceptions in the static fluid chapter. The sample for this research comprised 91 grade 11 students from the State Madrasah Aliyah in Bantul, Indonesia, selected using a purposive sampling technique. The findings of this research indicate that the four-tier diagnostic test instrument is suitable for identifying student misconceptions. The test validation results showed 17 valid test items and 1 invalid test item. This diagnostic test is reliable, with a person reliability coefficient of 0.73, an item reliability coefficient of 0.96, and a Cronbach's alpha coefficient of 0.72. The test items include two very difficult, seven difficult, and nine moderate items. The discrimination power of the 17 test items is good, except for one, which is poor. This instrument also found that the most common student misconceptions were in the hydrostatic pressure sub-chapter (71% of students) and in surface tension (66% of students).
References
Aiken, L. R. (1985) ‘Three coefficients for analyzing the reliability and validity of ratings’, Educational and Psychological Measurement, Vol. 45, No. 1, pp. 131–142. https://doi.org/10.1177/0013164485451012
Asrizal, A., Zan, A. M., Mardian, V. and Festiyed, F. (2022) ‘The impact of static fluid e-module by integrating STEM on learning outcomes of students’, Journal of Education Technology, Vol. 6, No. 1, pp. 110–118. https://doi.org/10.23887/jet.v6i1.42458
Assem, H. D., Nartey, L., Appiah, E., and Aidoo, J. K. (2023) ‘A review of students‘ academic performance in physics: attitude, instructional methods, misconceptions, and teachers’ qualification’, European Journal of Education and Pedagogy, Vol. 4, No. 1, pp. 84–92. https://doi.org/10.24018/ejedu.2023.4.1.551
Bichi, A. A. and Talib, R. (2018) ‘Item response theory: An introduction to latent trait models to test and item development’, International Journal of Evaluation and Research in Education, Vol. 7, No. 2, pp. 142–151. https://doi.org/10.11591/ijere.v7i2.12900
Cai, S., Liu, C., Wang, T., Liu, E. and Liang, J. C. (2021) ‘Effects of learning physics using Augmented Reality on students‘ self‐efficacy and conceptions of learning’, British Journal of Educational Technology, Vol. 52, No. 1, pp. 235–251. https://doi.org/10.1111/bjet.13020
Caleon, I. S. and Subramaniam, R. (2010) ‘Do students know what they know and don‘t know? Using a four-tier diagnostic test to assess the nature of students‘ alternative conceptions’, Research in Science Education, Vol. 40, No. 3, pp. 313–337. https://doi.org/10.1007/s11165-009-9122-4
Çebi, A. and Reisoğlu, İ. (2023) ‘Adaptation of self-assessment instrument for educators‘ digital competence into Turkish culture: A study on reliability and validity’, Technology, Knowledge and Learning, Vol. 28, No. 2, pp. 569–583. https://doi.org/10.1007/s10758-021-09589-0
Çelikkanlı, N. Ö. and Kızılcık, H. Ş. (2022) ‘A review of studies about four-tier diagnostic tests in physics education’, Journal of Turkish Science Education, Vol. 19, No. 4, pp. 1291–1311. https://doi.org/10.36681/tused.2022.175
Dack, H. (2019) ‘Understanding teacher candidate misconceptions and concerns about differentiated instruction’, The Teacher Educator, Vol. 54, No. 1, pp. 22–45. https://doi.org/10.1080/08878730.2018.1485802
Deiters, U. K. and Kraska, T. (2023) High-Pressure Fluid Phase Equilibria: Phenomenology and Computation, Amsterdam: Elsevier.
Domínguez, J. M., Fourtakas, G., Altomare, C., Canelas, R. B., Tafuni, A., García-Feal, O. et al. (2022) ‘DualSPHysics: From fluid dynamics to multiphysics problems’, Computational Particle Mechanics, Vol. 9, No. 5, pp. 867–895. https://doi.org/10.1007/s40571-021-00404-2
Gupta, S., Chatterjee, S. and Chanda, A. (2023) ‘Influence of vertically treaded outsoles on interfacial fluid pressure, mass flow rate, and shoe-floor traction during slips’, Fluids, Vol. 8, No. 3, pp. 82–90. https://doi.org/10.3390/fluids8030082
Hasanah, U. (2020) ‘The effectiveness of STEM education for overcoming students‘ misconceptions in high school physics: Engineering viewpoint’, Science Education International, Vol. 31, No. 1, pp. 5–13. https://doi.org/10.33828/sei.v31.i1.1
Hill, H. C. and Chin, M. (2018) ‘Connections between teachers‘ knowledge of students, instruction, and achievement outcomes’, American Educational Research Journal, Vol. 55, No. 5, pp. 1076–1112. https://doi.org/10.3102/0002831218769614
Hong, Y. S., Han, C. P., and Cho, S. S. (2021) ‘Level-based learning algorithm based on the difficulty level of the test problem’, Applied Sciences, Vol. 11, No. 10, pp. 4380–4393. https://doi.org/10.3390/app11104380
Iqbal, Q. and Malzahn, D. (2017) ‘Evaluating discriminating power of single-criteria and multi-criteria models towards inventory classification’, Computers & Industrial Engineering, Vol. 104, No. 1, pp. 219–223. https://doi.org/10.1016/j.cie.2016.12.007
Istiyono, E., Dwandaru, W. S. B., Fenditasari, K., Ayub, M. R. S. S. N., and Saepuzaman, D. (2023) ‘The development of a four-tier diagnostic test based on modern test theory in physics education’, European Journal of Educational Research, Vol. 12, No. 1, pp. 371–385. https://doi.org/10.12973/eu-jer.12.1.371
Kaptay, G. (2021) ‘A unified equation for the viscosity of pure liquid metals’, International Journal of Materials Research, Vol. 96, No. 1, pp. 24–31. https://doi.org/10.3139/146.018080
Kim, Y. J., Almond, R. G. and Shute, V. J. (2016) ‘Applying evidence-centered design for the development of game-based assessments in physics playground’, International Journal of Testing, Vol. 16, No. 2, pp. 142–163. https://doi.org/10.1080/15305058.2015.1108322
Kiray, S. A. and Simsek, S. (2021) ‘Determination and evaluation of the science teacher candidates‘ misconceptions about density by using the four-tier diagnostic test’, International Journal of Science and Mathematics Education, Vol. 19, no. 5, pp. 935–955. https://doi.org/10.1007/s10763-020-10087-5
Kösem, Ş. D. and Özdemir, Ö. F. (2014) ‘The nature and role of thought experiments in solving conceptual physics problems’, Science & Education, Vol. 23, No. 1, pp. 865–895. https://doi.org/10.1007/s11191-013-9635-0
Kundu, P. K., Cohen, I. M. and Dowling, D. R. (2015) Fluid Mechanics, 6th ed., San Diego, CA: Academic Press.
Laliyo, L. A. R., Hamdi, S., Pikoli, M., Abdullah, R. and Panigoro, C. (2021) ‘Implementation of four-tier multiple-choice instruments based on the partial credit model in evaluating students‘ learning progress’, European Journal of Educational Research, Vol. 10, No. 2, pp. 825–840. https://doi.org/10.12973/eu-jer.10.2.825
Lee, J. E., Recker, M. and Yuan, M. (2020) ‘The validity and instructional value of a rubric for evaluating online course quality: An empirical study’, Online Learning, Vol. 24, No. 1, pp. 245–256. https://doi.org/10.24059/olj.v24i1.1949
Levy, R., Okun, Z. and Shpigelman, A. (2021) ‘High-pressure homogenization: Principles and applications beyond microbial inactivation’, Food Engineering Reviews, Vol. 13, pp. 490–508. https://doi.org/10.1007/s12393-020-09239-8
Li, Y., Luo, H., Li, H., Chen, S., Jiang, X. and Li, J. (2020) ‘Dynamic capillarity during displacement process in fractured tight reservoirs with multiple fluid viscosities’, Energy Science & Engineering, Vol. 8, No. 2, pp. 300–311. https://doi.org/10.1002/ese3.558
Lightfoot, C. J., Wilkinson, T. J., Memory, K. E., Palmer, J., and Smith, A. C. (2021) ‘Reliability and validity of the patient activation measure in kidney disease: results of Rasch analysis’, Clinical Journal of the American Society of Nephrology, Vol. 16, No. 6, pp. 880–888. https://doi.org/10.2215/CJN.19611220
Liu, J. and Li, S. (2019) ‘Capillarity-driven migration of small objects: A critical review’, The European Physical Journal E, Vol. 42, No. 1, pp. 1–23. https://doi.org/10.1140/epje/i2019-11759-1
Lourdusamy, R. and Magendiran, P. (2021) ’A systematic analysis of difficulty level of the question paper using students‘ marks: a case study’, International Journal of Information Technology, Vol. 13, No. 3, pp. 1127–1143. https://doi.org/10.1007/s41870-020-00599-2
Machts, N., Kaiser, J., Schmidt, F. T. and Moeller, J. (2016) ‘Accuracy of teachers‘ judgments of students‘ cognitive abilities: A meta-analysis’, Educational Research Review, Vol. 19, pp. 85–103. https://doi.org/10.1016/j.edurev.2016.06.003
Madina, I. S., Ratnawulan, R., Sari, S. Y., Sundari, P. D., and Mayasari, T. (2022) ‘Identification of students‘ misconceptions about straight motion materials using a four-tier diagnostic test and certainty of response index (CRI)’, Pillar of Physics Education, Vol. 15, No. 1, pp. 21–30. https://doi.org/10.24036/12658171074
Maison, D., Astalini, D. A. K. and Sumaryanti, R. P. (2020) ‘Supporting assessment in education: E-assessment interest in physics’, Universal Journal of Educational Research, Vol. 8, No. 1, pp. 89–97. https://doi.org/10.13189/ujer.2020.080110
Maknun, J. (2020) ‘Implementation of a guided inquiry learning model to improve understanding of physics concepts and critical thinking skills of vocational high school students’, International Education Studies, Vol. 13, No. 6, pp. 117–130. https://doi.org/10.5539/ies.v13n6p117
Mason, R. A. and Just, M. A. (2016) ‘Neural representations of physics concepts’, Psychological Science, Vol. 27, No. 6, pp. 904–913. https://doi.org/10.1177/0956797616641941
Naylor, D. and Tsai, S. S. (2022) ‘Archimedes‘ principle with surface tension effects in undergraduate fluid mechanics’, International Journal of Mechanical Engineering Education, Vol. 50, No. 3, pp. 749–763. https://doi.org/10.1177/03064190211055431
Neito, R., Vilhunen, E., Lavonen, J. and Reivelt, K. (2025) ‘Students‘ situational interest and perceived relevance during designed coherent physics learning modules’, International Journal of Science Education, Vol. 2, No. 1, pp. 1–24. https://doi.org/10.1080/09500693.2025.2488400
Nguyen, H. N. G., Zhao, C. F., Millet, O. and Gagneux, G. (2020) ‘An original method for measuring liquid surface tension from capillary bridges between two equal-sized spherical particles’, Powder Technology, Vol. 363, No. 1, pp. 349–359. https://doi.org/10.1016/j.powtec.2019.12.049
Noxaïc, A. L. and Fadel, K. (2022) ‘How to use the Archimedes Paradox for educational purposes’, The Physics Teacher, Vol. 60, No. 2, pp. 137–139. https://doi.org/10.1119/10.0009424
Ozkan, G. and Selcuk, G. S. (2015) ‘The effectiveness of conceptual change texts and context-based learning on students‘ conceptual achievement’, Journal of Baltic Science Education, Vol. 14, No. 6, 753–764. https://doi.org/10.33225/jbse/15.14.753
Putra, A. S. U., Hamidah, I. and Nahadi. (2020) ‘The development of five-tier diagnostic test to identify misconceptions and causes of students‘ misconceptions in waves and optics materials’, Journal of Physics: Conference Series, Vol. 1521, No. 2, pp. 1–9. https://doi.org/10.1088/1742-6596/1521/2/022020
Rabin, L. A., Krishnan, A., Bergdoll, R. and Fogel, J. (2021) ‘Correlates of exam performance in an introductory statistics course: Basic math skills along with self-reported psychological/behavioral and demographic variables’, Statistics Education Research Journal, Vol. 20, No. 1. https://doi.org/10.52041/serj.v20i1.97
Raissi, M., Yazdani, A. and Karniadakis, G. E. (2020) ‘Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations’, Science, Vol. 367, No. 6481, pp. 1026–1030. https://doi.org/10.1126/science.aaw4741
Robbins, M. E., DiQuattro, G. J. and Burkholder, E. W. (2025) ‘Assessment of expert decisions in graduate quantum mechanics’, Physical Review Physics Education Research, Vol. 21, No. 1, pp. 1–10. https://doi.org/10.1103/PhysRevPhysEducRes.21.010125
Saidi, S. S. and Siew, N. M. (2019) ‘Reliability and validity analysis of statistical reasoning test survey instrument using the Rasch measurement model’, International Electronic Journal of Mathematics Education, Vol. 14, No. 3, pp. 535–546. https://doi.org/10.29333/iejme/5755
Saricayir, H., Ay, S., Comek, A., Cansiz, G. and Uce, M. (2016) ‘Determining students‘ conceptual understanding level of thermodynamics’, Journal of Education and Training Studies, Vol. 4, No. 6, pp. 69–79. https://doi.org/10.11114/jets.v4i6.1421
Setiawan, A., Mardapi, D. and Andrian, D. (2019) ‘The development of an instrument for assessing students‘ affective domain using self-and peer-assessment models’, International Journal of Instruction, Vol. 12, No. 3, pp. 425–438. https://doi.org/10.29333/iji.2019.12326a
Shafiei, M., Kazemzadeh, Y., Martyushev, D. A., Dai, Z. and Riazi, M. (2023) ‘Effect of chemicals on the phase and viscosity behavior of water in oil emulsions’, Scientific Reports, Vol. 13, No. 1, pp. 1–14. https://doi.org/10.1038/s41598-023-31379-0
Suprapto, N. (2020) ‘Do we experience misconceptions?: An ontological review of misconceptions in Science’, Studies in Philosophy of Science and Education, Vol. 1, No. 2, pp. 50–55. https://doi.org/10.46627/sipose.v1i2.24
Sürücü, L. and Maslakçi, A. (2020) ‘Validity and reliability in quantitative research’, Business & Management Studies: An International Journal, Vol. 8, No. 3, pp. 2694–2726. https://doi.org/10.15295/bmij.v8i3.1540
Tang, Z., Fang, K., Bukhari, M. N., Song, Y. and Zhang, K. (2020) ‘Effects of viscosity and surface tension of a reactive dye ink on droplet formation’, Langmuir, Vol. 36, No. 32, pp. 9481–9488. https://doi.org/10.1021/acs.langmuir.0c01392
Taslidere, E. (2016) ‘Development and use of a three-tier diagnostic test to assess high school students‘ misconceptions about the photoelectric effect’, Research in Science & Technological Education, Vol. 34, No. 2, pp. 164–186. https://doi.org/10.1080/02635143.2015.1124409
Tsompou, A. and Kocherbitov, V. (2022) ‘The effects of water purity on the removal of hydrophobic substances from solid surfaces without surfactants’, Journal of Colloid and Interface Science, Vol. 608, No. 1, pp. 1929–1941. https://doi.org/10.1016/j.jcis.2021.10.040
Türkoguz, S. (2020) ‘Comparison of threshold values of three-tier diagnostic and multiple-choice tests based on response time’, Anatolian Journal of Education, Vol. 5, No. 2, pp. 19–36. https://doi.org/10.29333/aje.2020.522a
Van den Akker, J., Gravemeijer, K., McKenney, S. and Nieveen, N. (2006) Educational Design Research, London: Routledge.
Van Laar, E., van Deursen, A. J., van Dijk, J. A. and de Haan, J. (2018) ‘21st-century digital skills instrument aimed at working professionals: Conceptual development and empirical validation’, Telematics and Informatics, Vol. 35, No. 8, pp. 2184–2200. https://doi.org/10.1016/j.tele.2018.08.006
Vaske, J. J., Beaman, J. and Sponarski, C. C. (2017) ‘Rethinking internal consistency in Cronbach‘s Alpha’, Leisure Sciences, Vol. 39, No. 2, pp. 163–173. https://doi.org/10.1080/01490400.2015.1127189
Wahyuni, N., Bhakti, Y. B., Mutakin, T. Z. and Astuti, I. A. D. (2021) ‘The development of a four-tier diagnostic test instrument to identify the learners‘ misconception of circular motions’, Impulse: Journal of Research and Innovation in Physics Education, Vol. 1, No. 1, pp. 24–31. https://doi.org/10.14421/impulse.2021.11-03
Yuberti, Y., Suryani, Y. and Kurniawati, I. (2020) ‘Four-tier diagnostic test with the certainty of response index to identify misconceptions in physics’, Indonesian Journal of Science and Mathematics Education, Vol. 3, No. 2, pp. 245–253. https://doi.org/10.24042/ijsme.v3i2.6061
Zenger, T. and Bitzenbauer, P. (2022) ‘Exploring German secondary school students‘ conceptual knowledge of density’, Science Education International, Vol. 33, No. 1, pp. 86–92. https://doi.org/10.33828/sei.v33.i1.9
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Himawan Putranta, Fahdah Afifah
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors declare with this manuscript intended for publication to ERIES Journal that:
- all co-authors agree with the publication of the manuscript even after amendments arising from peer review;
- all co-authors agree with the posting of the full text of this work on the web page of ERIES Journal and to the inclusion of references in databases accessible on the internet;
- no results of other researchers were used in the submitted manuscript without their consent, proper citation, or acknowledgement of their cooperation or material provided;
- the results (or any part of them) used in the manuscript have not been sent for publication to any other journal nor have they already been published (or if so, that the relevant works are cited in this manuscript);
- submission of the manuscript for publication was completed in accordance with the publishing regulations pertaining to place of work;
- experiments performed comply with current laws and written consent of the Scientific Ethics Committee / National Animal Care Authority (as is mentioned in the manuscript submitted);
- grant holders confirm that they have been informed of the submitted manuscript and they agree to its publication.
Authors retain copyright and grant ERIES Journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the published work with an acknowledgement of its initial publication in ERIES Journal. Moreover, authors are able to post the published work in an institutional repository with an acknowledgement of its initial publication in ERIES Journal. In addition, authors are permitted and encouraged to post the published work online (e.g. institutional repositories or on their website) as it can lead to productive exchanges, as well as earlier and greater citation of published work.
