ANALYSIS OF EXAM RESULTS OF THE SUBJECT ’APPLIED MATHEMATICS FOR IT’
Keywords:Framing Effect, Difficulty Index, Discrimination Index, Reliability of the tests, Validity of the test
In this paper the exam results of the subject “Applied Mathematics for Informatics” from the last 10 years have been analysed. The exam has two parts: written test and oral exam. The grades of the students of the subject Applied Mathematics for Informatics formerly Methods of Operation Research have been low for a long time. We want to know if this is due to the quality of the tests or due to reducing the number of hours of contact teaching or due to the mathematical character of the subject and to the unpopularity of such kind of subjects or some other factors, for instance. Based on the bad results, students have also initiated a change in the scoring system. This article builds on our paper at the conference ERIE 2013. The main goals of this paper are to find out if the grades have had the tendency to decline during the years and to evaluate the validity, reliability, difficulty, and discrimination power of the tests.
Brožová, H., Rydval, J. (2013) ‘Analysis of the exam test quality’, Proceedings of the 10th International Conference on Efficiency and Responsibility in Education, Prague, pp. 120–127.
Cronbach, L.J. (2004) ‘My Current Thoughts on Coefficient Alpha and Successor Procedures’, Educational and Psychological Measurement, vol. 64, no. 3, pp. 391-418. http://dx.doi.org/10.1177/0013164404266386.
Druckman, J.N. (2001) ‘Evaluating framing effects’, Journal of Economic Psychology, vol. 22, no. 1, pp. 91-101. http://dx.doi.org/10.1016/S0167-4870(00)00032-5
Gallimore, M., Stewart, J. (2014) ‘Increasing the impact of mathematics support on aiding student transition in higher education’, Teaching Mathematics and Its Applications, vol. 33, no. 2, pp. 98-109, http://dx.doi.org/10.1093/teamat/hru008
Grossman, T.G.A. (2001) ‘Causes of the Decline of the Business School Management Science Course’, INFORMS Transactions on Education, vol. 1, no. 2, pp. 51-61. http://dx.doi.org/10.1287/ited.1.2.51
Hardin, J.R., Holder, A. Beck, J. Ch., Furman, K., Hanna, A., Rader, D., Rego, C. (2012) ‘Recommendations for an Undergraduate Curriculum at the Interface of Operations Research and Computer Science’, INFORMS Transactions on Education, vol. 12, no. 3, pp. 117-123, http://dx.doi.org/10.1287/ited.1110.0080.
Jacobs, L.C. (1991) Test Reliability, [online], Available: http://www.indiana.edu/~best/test_reliability.shtml [3 Aug 2013].
Jarkovská, M., Kučera, P., Vostrá Vydrová, H., Varvažovská P. (2012) ‘Analysis of Students´ Results in Distance-studies centres’, Journal on Efficiency and Responsibility in Education and Science, vol. 5, no. 2, pp. 78-91. http://dx.doi.org/10.7160/eriesj.2012.050203.
Jordan, E., Lasdon, L., Lenard, M., Moore, J., Powell, S., Willemain, T. (1997) ‘OR/MS and MBAs’, OR/MS Today, vol. 24, no. 1, pp. 36-41.
Kaspříková, N. (2011) ‘Multivariate Analysis of Examination Papers’, Proceedings of the 8th International Conference on Efficiency and Responsibility in Education, Prague, pp. 120–127.
Kaspříková, N. (2012a) ‘Data analysis of students’ performance’, Proceedings of the 9th International Conference on Efficiency and Responsibility in Education, Prague, pp. 213–218.
Kaspříková, N. (2012b) ‘Statistical Evaluation of Examination Tests in Mathematics for Economists, Journal on Efficiency and Responsibility in Education and Science, vol. 5, no. 4, pp. 203-211. http://dx.doi.org/ 10.7160/eriesj.2012.050403.
Kolari, S., Savander-Ranne, C., Viskari E.L. (2008) ‘Learning needs time and effort: a time-use study of engineering students’, European Journal of Engineering Education, vol. 33, no. 1, pp. 483-498. http://dx.doi.org/10.1080/03043790802564046.
Miller, I. (2012) Edukometrie, [online], Available: http://www.miller.wz.cz/ [13 Sep 2013].
Revelle, W., Zinbarg, R.E. (2009) ‘Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma’, Psychometrika, vol. 74, no. 1, pp. 145–154. http://dx.doi.org/10.1007/s11336-008-9102-z.
Rydval, J., Brožová, H. (2011) ‘Quantification of Framing effect in education Process using ANP’, Proceedings of the 7th International Conference on Efficiency and Responsibility in Education, Prague, pp. 36-45.
Škaloudová, A. (2012) Měření reliability, [online], Available: http://userweb.pedf.cuni.cz/~www_kpsp/skalouda/pokrocili/reliabi.htm [18 May 2012].
Škoda, J., Doulík, P., Hajerová-Müllerová, L. (2006) Zásady správné tvorby, použití a hodnocení didaktických testů v přípravě budoucích učitelů, [online], Available: http://cvicebnice.ujep.cz/cvicebnice/FRVS1973F5d [25 May 2012].
Tversky, A., Kahneman, D. (1981) ‘The framing of decisions and the psychology of choice’, Science, vol. 211, no. 4481, pp. 453-458. http://dx.doi.org/10.1126/science.7455683.
Wells, C.S., Wollack, J.A. (2003) ‘An Instructor’s Guide to Understanding Test Reliability’, Testing & Evaluation Services, University of Wisconsin, [online], Available: http://testing.wisc.edu/Reliability.pdf [8 Mar 2013].
How to Cite
Authors declare with this manuscript intended for publication to ERIES Journal that:
- all co-authors agree with the publication of the manuscript even after amendments arising from peer review;
- all co-authors agree with the posting of the full text of this work on the web page of ERIES Journal and to the inclusion of references in databases accessible on the internet;
- no results of other researchers were used in the submitted manuscript without their consent, proper citation, or acknowledgement of their cooperation or material provided;
- the results (or any part of them) used in the manuscript have not been sent for publication to any other journal nor have they already been published (or if so, that the relevant works are cited in this manuscript);
- submission of the manuscript for publication was completed in accordance with the publishing regulations pertaining to place of work;
- experiments performed comply with current laws and written consent of the Scientific Ethics Committee / National Animal Care Authority (as is mentioned in the manuscript submitted);
- grant holders confirm that they have been informed of the submitted manuscript and they agree to its publication.
Authors retain copyright and grant ERIES Journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the published work with an acknowledgement of its initial publication in ERIES Journal. Moreover, authors are able to post the published work in an institutional repository with an acknowledgement of its initial publication in ERIES Journal. In addition, authors are permitted and encouraged to post the published work online (e.g. institutional repositories or on their website) as it can lead to productive exchanges, as well as earlier and greater citation of published work.