Archives
Current issue
About
About us
Aims and Scope
Abstracting and Indexing
Editorial Office
Open Access Policy
Publication Ethics
Journal History
Publisher
Follow us: Twitter
Contact
For Authors
Editorial Policy
Peer Review Policy
Manuscript Preparation Guidelines
Copyright & Licencing
Publication Fees
Fee Waiver Policy for Doctoral Students
EJMSTE Language Editing Service
More
Statistics
Special Issues
Special Issue Announcements
Published Special Issues
RESEARCH PAPER
Development of the automatic item generation system for the diagnosis of misconceptions about force and laws of motion
1
Faculty of Education, Chulalongkorn University, Bangkok, THAILAND
Online publication date: 2023-05-08
Publication date: 2023-06-01
EURASIA J. Math., Sci Tech. Ed 2023;19(6):em2282
KEYWORDS
ABSTRACT
The understanding of force and laws of motion is a fundamental foundation for learning
mechanics and understanding other complex physics-related subjects. Automatic item generation
(AIG) is also suitable for generating items and able to reduce the chance of item exposure. We,
thus, developed an AIG system for the diagnosis of misconceptions about force and laws of
motion in order to create a large number of quality items that would be used to diagnose
students’ misconceptions. AIG system that has been developed contains 18 item models; it can
generate 320-3,200 test items. The system contains six menus, i.e., (1) users’ data, (2) item models,
(3) item generation, (4) test generation, (5) the users’ guide, and (6) the system’s developer. Based
on the examination of AIG system’s quality by experts on educational assessment and experts on
information technology, AIG’s quality in terms of utility, feasibility, propriety, and accuracy is at
the highest level. The system was improved using the two dimensions of users’ experiences with
physics instructors, i.e., (1) pragmatic dimension and (2) hedonic dimension. This research offers
an approach to developing AIG system that responds to users’ needs.
REFERENCES (29)
1.
Aini, F. N., Sutopo, & Suyudi, A. (2021). Teaching integrated Newton’s laws of motion for high school students. AIP Conference Proceedings, 2330, 050013. https://doi.org/10.1063/5.0043....
2.
de la Torre, J., & Minchen, N. (2014). Cognitively diagnostic assessments and the cognitive diagnosis model framework. Psicología Educativa [Educational Psychology], 20(2), 89-97. https://doi.org/10.1016/j.pse.....
3.
Embretson, S., & Yang, X. (2006). Automatic item generation and cognitive psychology. In C. R. Rao, & S. Sinharay (Eds.), Handbook of statistics (pp. 747-768). North Holland. https://doi.org/10.1016/S0169-....
4.
Gierl, M. J., & Lai, H. (2013). Instructional topics in educational measurement (ITEMS) module: Using automated processes to generate test items. Educational Measurement: Issues and Practice, 32(3), 36-50. https://doi.org/10.1111/emip.1....
5.
Gierl, M. J., & Lai, H. (2016). A process for reviewing and evaluating generated test items. Educational Measurement: Issues and Practice, 35(4), 6-20. https://doi.org/10.1111/emip.1....
6.
Gierl, M. J., & Lai, H. (2018). Using automatic item generation to create solutions and rationales for computerized formative testing. Applied Psychological Measurement, 42(1), 42-57. https://doi.org/10.1177/014662....
7.
Gierl, M. J., Zhou, J., & Alves, C. (2008). Developing a taxonomy of item model types to promote assessment engineering. The Journal of Technology, Learning and Assessment, 7(2), 1-51.
8.
Graf, E. A., Peterson, S., Steffen, M., & Lawless, R. (2005). Psychometric and cognitive analysis as a basis for the design and revision of quantitative item models. ETS. https://doi.org/10.1002/j.2333....
9.
Gurel, D. K., Eryılmaz, A., & McDermott, L. C. (2015). A review and comparison of diagnostic instruments to identify students’ misconceptions in science. EURASIA Journal of Mathematics, Science and Technology Education, 11(5), 989-1008. https://doi.org/10.12973/euras....
10.
Hassenzahl, M. (2003). The thing and I: Understanding the relationship between user and product. In M. A. Blythe, K. Overbeeke, A. F. Monk, & P. C. Wright (Eds.), Funology: From usability to enjoyment (pp. 31-42). Kluwer Academic. https://doi.org/10.1007/1-4020....
11.
Hussain, A., Hussein, I., Mkpojiogu, E. O., & Sarlan, A. (2019). The state of user experience design (UXD) practice in Malaysia: An in-situ interview approach. International Journal of Innovative Technology and Exploring Engineering, 8(8S), 498-505.
12.
Javidanmehr, Z., & Sarab, M. R. A. (2017). Cognitive diagnostic assessment: Issues and considerations. International Journal of Language Testing, 7(2), 73-98.
13.
Kaniawati, I., Fratiwi, N. J., Danawan, A., Suyana, I., Samsudin, A., & Suhendi, E. (2019). Analyzing students’ misconceptions about Newton’s laws through four-tier Newtonian test (FTNT). Journal of Turkish Science Education, 16(1), 110-122.
14.
Krueger, A. E., Pollmann, K., Fronemann, N., & Foucault, B. (2020). Guided user research methods for experience design–A new approach to focus groups and cultural probes. Multimodal Technologies and Interaction, 4(3), 1-22. https://doi.org/10.3390/mti403....
15.
Lai, H., Gierl, M. J., Byrne, B. E., Spielman, A. I., & Waldschmidt, D. M. (2016). Three modeling applications to promote automatic item generation for examinations in dentistry. Journal of Dental Education, 80(3), 339-347. https://doi.org/10.1002/j.0022....
16.
Latifi, S., Gierl, M., Wang, R., Lai, H., & Wang, A. (2017). Information-based methods for evaluating the semantics of automatically generated test items. Artificial Intelligence Research, 6(1), 69-79. https://doi.org/10.5430/air.v6....
17.
Narjaikaew, P. (2013). Alternative conceptions of primary school teachers of science about force and motion. Procedia-Social and Behavioral Sciences, 88, 250-257. https://doi.org/10.1016/j.sbsp....
18.
National Research Council. (1997). Science teaching reconsidered: A handbook. National Academies Press.
19.
Pellegrino, J. W., & Hilton, M. L. (2012). Education for life and work: Developing transferable knowledge and skills in the 21st century. National Academies Press.
20.
Saglam-Arslan, A., & Devecioglu, Y. (2010). Student teachers’ levels of understanding and model of understanding about Newton’s laws of motion. Asia-pacific Forum on Science Learning and Teaching, 11(1), Article 7.
21.
Sinharay, S., & Johnson, M. S. (2008). Use of item models in a large-scale admissions test: A case study. International Journal of Testing, 8(3), 209-236. https://doi.org/10.1080/153050....
22.
Sinharay, S., & Johnson, M. S. (2013). Statistical modeling of automatically generated items. In M. J. Gierl, & T. Haladyna (Eds.), Automatic item generation: Theory and practice (pp.183-195). Routledge.
23.
Sornkhatha, P., & Srisawasdi, N. (2013). Supporting conceptual development in Newton’s laws of motion using an interactive computer-simulated laboratory environment. Procedia-Social and Behavioral Sciences, 93, 2010-2014. https://doi.org/10.1016/j.sbsp....
24.
Tang, R., Hu, Z., Henry, N., & Thomas, A. (2021). A usability evaluation of research data management librarian academy (RDMLA): Examining the impact of learner differences in pedagogical usability. Journal of Web Librarianship, 15(3), 154-193. https://doi.org/10.1080/193229....
25.
Thibaut, L., Ceuppens, S., De Loof, H., De Meester, J., Goovaerts, L., Struyf, A., Boeve-de Pauw, J., Dehaene, W., Deprez, J., De Cock, M., Hellinckx, L., Knipprath, H., Langie, G., Struyven, K., van de Velde, D., van Petegem, P., & Depaepe, F. (2018). Integrated STEM education: A systematic review of instructional practices in secondary education. European Journal of STEM Education, 3(1), 02. https://doi.org/10.20897/ejste....
26.
Wancham, K., Tangdhanakanond, K., & Kanjanawasee, S. (2022). The construction and validation of the cognitive model of force and motion for a diagnosis of misconceptions. Journal of Education Naresuan University, 24(3), 60-70.
27.
Wancham, K., Tangdhanakanond, K., & Kanjanawasee, S. (2023). Sex and grade issues in influencing misconceptions about force and laws of motion: An application of cognitively diagnostic assessment. International Journal of Instruction, 16(2), 437-456. https://doi.org/10.29333/iji.2....
28.
Yarbrough, D. B., Shula, L. M., Hopson, R. K., & Caruthers, F. A. (2011). The program evaluation standards: A guide for evaluators and evaluation users. SAGE.
29.
Yasri, P. (2014). A systematic classification of student misconceptions in biological evolution. International Journal of Biology, 3(2), 31-41. https://doi.org/10.20876/ijobe....
Share
RELATED ARTICLE
| eISSN: | 1305-8223 |
| ISSN: | 1305-8215 |
We process personal data collected when visiting the website. The function of obtaining information about users and their behavior is carried out by voluntarily entered information in forms and saving cookies in end devices. Data, including cookies, are used to provide services, improve the user experience and to analyze the traffic in accordance with the Privacy policy. Data are also collected and processed by Google Analytics tool (more).
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.
