On the Problem of Generating a Large Number of Comparable Test Variants

  • Mikuláš Gangur University of West Bohemia in Pilsen, faculty of Economics
  • Miroslav Plevný University of West Bohemia in Pilsen, faculty of Economics
Keywords: automatic test generation, combinatorial explosion, evaluation methodologies, XSL transformation

Abstract

The paper presents a possible way of solving the problem of creating more test variants for a large number of students divided into groups. The proposed solution may consist in introducing a parameterized automatic test generator. The principle of an automatic parameterized test generator is shown. The process of the question tree construction according to the increasing numbers of questions in the banks of the particular subjects leads to a combinatorial explosion. This often results in the excessive time of generation of the different variants of tests. To solve this problem, a heuristic method based on a pre-processing stage that precedes the construction of the searching tree is proposed. Further, the results of the experiments comparing the time of the test generation and the congruence of the test variants generated by the algorithm either using or non-using this heuristics are presented. According to these results, the use of the generator with the proposed heuristics provides a considerably shorter time of generation, and the congruence of the generated test variants is even better in most cases.

References


  • Aiken (2013) MoodleDocs: Aiken format. [Online], Available: http://docs.moodle.org/22/en/Aiken_format [26 Jul 2016].

  • Brusilovsky, P. and Pathak, S. (2002) ‘Assessing Student Programming Knowledge with Web-based Dynamic Parameterized Quizzes’. Association for the Advancement of Computing in Education (AACE), pp. 1548-1553.

  • Fakhrusy, M.R. and Widyani, Y. (2017) ‘Moodle plugins for quiz generation using genetic algorithm’. 2017 International Conference on Data and Software Engineering (ICoDSE) Palembang, Indonesia, INSPEC Accession Number: 17578381. http://dx.doi.org/10.1109/ICODSE.2017.8285882

  • Foltýnek, T. (2009) ‘A New Approach to the Achievement Test Items Evaluation: the Correctness Coefficients’. Journal on Efficiency and Responsibility in Education and Science, vol. 2, no. 1, pp. 28-40.

  • Gangur, M. (2011) ‘Automatic generation of cloze questions’. CSEDU 2011 - Proceedings of the 3rd International Conference on Computer Supported Education, Portugal, SciTePress - Science and Technology Publications, pp. 264-269.

  • Gangur, M. (2014) ‘Automatic Parameterized Generation of Test’. DIVAI 2014: 10th International Scientific Conference on Distance Learning in Applied Informatics. Prague, Wolters Kluwer, pp. 55-64.

  • Gladavská, L. and Plevný, M. (2014) ‘Problems of automatic generation of questions for the purpose of testing the knowledge in a management science course’. DIVAI 2014: 10th International Scientific Conference on Distance Learning in Applied Informatics. Prague, Wolters Kluwer, pp. 325-335.

  • Hürst, W., Jung, S. and Welte, M. (2007) ‘Effective learn-quiz generation for handheld devices’. Proceedings of the 9th international conference on Human computer interaction with mobile devices and services, ACM, pp. 364-366.

  • Kapusta, J., Munk, M. and Turčáni, M. (2010) ‘Evaluation of adaptive techniques dependent on educational content’. 4th International Conference on Application of Information and Communication Technologies, AICT2010, INSPEC Accession Number:  5611791. http://dx.doi.org/10.1109/ICAICT.2010.5611791

  • Klůfa, J. and Kaspříková, N. (2012) ‘Multiple Choice Question Tests for Entrance Examinations - A Probabilistic Approach’. Journal on Efficiency and Responsibility in Education and Science, vol. 5, no. 4, pp. 195-202. http://dx.doi.org/10.7160/eriesj.2012.050402

  • Klůfa J. (2016) ‘Comparison of the Test Variants in Entrance Examinations’. Journal on Efficiency and Responsibility in Education and Science, vol. 9, no. 4, pp. 111-116, http://dx.doi.org/10.7160/eriesj.2016.090404

  • Kosek, J. (2013) XML for everyone. [Online], Available: http://www.kosek.cz/xml/index.html [20 May 2016].

  • Mine, T., Shoudai, T. and Suganuma, A. (2000) ‘Automatic Exercise Generator with Tagged Documents Considering Learner’s Performance’. Association for the Advancement of Computing in Education (AACE), Chesapeake, VA, pp. 779-780.

  • Niazi, R. and Mahmoud, Q.H. (2000) ‘A Web-based Tool for Generating Quizzes for Mobile Devices’. A poster at the 39th ACM Technical Symposium on Computer Science Education (SIGCSE). Portland, OR.

  • Nuthong, S. and Witosurapot, S. (2017) ‘Enabling fine granularity of difficulty ranking measure for automatic quiz generation’. 9th International Conference on Information Technology and Electrical Engineering (ICITEE), Phuket, Thailand, pp. 1-6. http://dx.doi.org/10.1109/ICITEED.2017.8250492

  • Rosman, P. and Buřita, L. (2014) ‘Concept of the computer science course and some aspects of ICT integration into education’. E&M Ekonomie a management, vol. 17, no. 3, pp. 169-180. http://dx.doi.org/10.15240/tul/001/2014-3-013

  • Sung, L.-C., Lin, Y.-C. and Chen, M.C. (2007) ‘An Automatic Quiz Generation System for English Text’. 7th IEEE International Conference on Advanced Learning Technologies, Proceedings, Niigata, Japan, INSPEC Accession Number: 9868711. http://dx.doi.org/10.1109/ICALT.2007.56

  • Tomas, A.P. and Leal, J.P. (2013) ‘Automatic generation and delivery of multiple-choice math quizzes’. Principles and Practice of Constraint Programming. CP 2013. Lecture Notes in Computer Science, Vol. 8124. Springer, Berlin, Heidelberg, pp. 848-863. http://dx.doi.org/10.1007/978-3-642-40627-0_62

  • Yang, A., Wu, J. and Wang, L. (2008) ‘Research and design of test question database management system based on the three-tier structure’. WSEAS Transactions on Systems, vol. 7, no. 12, pp. 1473-1483.

  • Zeng, J., Sakai, T., Yin, C., Suzuki, T. and Hirokawa, S. (2013). ‘Automatic generation of tourism quiz using blogs’. Artificial Life and Robotics, vol. 17, no. 3-4, pp. 412-416. http://dx.doi.org/10.1007/s10015-012-0076-7

Published
2019-01-09
How to Cite
Gangur, M. and Plevný, M. (2019) ’On the Problem of Generating a Large Number of Comparable Test Variants’, Journal on Efficiency and Responsibility in Education and Science, vol. 11, no. 4, pp. 78-84. https://doi.org/10.7160/eriesj.2018.110402
Section
Research Paper