RESEARCH PAPER
An analysis of calculus application questions in grade 12 mathematics exams in South Africa
 
 
More details
Hide details
1
Fujairah Boys’ School, Fujairah, UAE
 
 
Publication date: 2024-10-13
 
 
EURASIA J. Math., Sci Tech. Ed 2024;20(10):em2519
 
KEYWORDS
ABSTRACT
This study employed a quantitative survey methodology to analyze the 2021-2023 grade 12 calculus application exam questions in the context of South Africa. A total of 11 grade 12 teachers and 220 grade 12 students participated in the study. Analysis of the survey data and students’ test results points to the view that examiners sometimes misjudge the level of difficulty of the exam questions and include questions that are very difficult, which fail to discriminate between strong and weak candidates. It was noticed that calculus applications questions that most students could not correctly answer included multiple mathematical skills that were compacted in a short statement. This paper recommends that mathematics examiners should continuously reflect on their own work and find ways to improve their skills in setting future exam papers. The inclusion of item difficulty and item discrimination indices in post-exam analysis of results could be part of the examiners’ reflective practice. Feedback from the grade 12 mathematics teachers on the standard of each exam question is just as important to the examiners as the examiners’ reports are to the teachers.
REFERENCES (40)
1.
Adedoyin, O. O., & Mokobi, T. (2013). Using IRT psychometric analysis in examining the quality of junior certificate mathematics multiple choice examination test items. International Journal of Asian Social Science, 3(4), 992-1011.
 
2.
Amadi, B. D., Ogunka, R. I., & Tandi, L. I. (2019). Estimating the psychometric properties of 50 multiple choice mathematics item for senior secondary II students in Ikwerre Local Government Area of Rivers State using classical test theory. The African Journal of Behavioural and Scale Development Research, 1(2).
 
3.
Balila, J. S., & Cajilig, N. G. (2016). Psychometric analysis of mathematics achievement test using item response theory. Jurnal Universitas Advent Indonesia, 1(2), 34-44.
 
4.
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, Article 149. https://doi.org/10.3389/fpubh.....
 
5.
Burdman, P. (2019). Why calculus? Why indeed? JustEquations. https://justequations.org/blog....
 
6.
Chinn, S. (2020). The trouble with maths: A practical guide to helping learners with numeracy difficulties (4th ed.). Routledge. https://doi.org/10.4324/978100....
 
7.
Date, A. P., Borkar, A. S., Badwaik, R. T., Siddiqui, R. A., Shende, T. R., & Dashputra, A. V. (2019). Item analysis as tool to validate multiple choice question bank in pharmacology. International Journal of Basic & Clinical Pharmacology, 8(9), 1999-2003. https://doi.org/10.18203/2319-....
 
8.
Dennon, A. (2022). Want to get into Harvard? Ace calculus. BestColleges.com. https://www.best colleges.com/news/analysis/2022/02/28/college-admissions-calculus/.
 
9.
Department of Basic Education. (2021). National senior certificate grade 12 mathematics P1 November 2021. Department of Basic Education. https://www.education.gov.za/C....
 
10.
Department of Basic Education. (2022a). 2021 national senior certificate diagnostic report part 1: Content subjects. Department of Basic Education. https://www.education.gov.za/?....
 
11.
Department of Basic Education. (2022b). National senior certificate grade 12 mathematics P1 November 2022. Department of Basic Education. https://www.education.gov.za/C....
 
12.
Department of Basic Education. (2023a). National senior certificate 2022 diagnostic report part 1: Content subjects. Department of Basic Education. https://www.education.gov.za/?....
 
13.
Department of Basic Education. (2023b). National senior certificate grade 12 mathematics P1 November 2023. Department of Basic Education. https://www.education.gov.za/C....
 
14.
Department of Basic Education. (2024). 2023 diagnostic report book 1. Department of Basic Education. https://www.ecexams.co.za/2023....
 
15.
Djidu, H., Jailani, J., & Retnawati, H. (2021). Higher-order thinking skills among male and female students: An experimental study of the problem-based calculus learning model in secondary schools. Beta: Jurnal Tadris Matematika, 14(2), 107-125. https://doi.org/10.20414/betaj....
 
16.
Dosek, T. (2012). Snowball sampling and Facebook: How social media can help access hard-to-reach populations. PS: Political Science & Politics, 54(4), 651-655. https://doi.org/10.1017/S10490....
 
17.
Gamage, S. H., Ayres, J. R., Behrend, M. B., & Smith, E. J. (2019). Optimising Moodle quizzes for online assessments. International Journal of STEM Education, 6, Article 27. https://doi.org/10.1186/s40594....
 
18.
Gardner, J., O’Leary, M., & Yuan, L. (2021). Artificial intelligence in educational assessment: ‘Breakthrough? or buncombe and ballyhoo?’. Journal of Computer Assisted Learning, 37(5), 1207-1216. https://doi.org/10.1111/jcal.1....
 
19.
Geisler, S., & Rolka, K. (2021). “That wasn’t the math I wanted to do!”–Students’ beliefs during the transition from school to university mathematics. International Journal of Science and Mathematics Education, 19(3), 599-618. https://doi.org/10.1007/s10763....
 
20.
Georgetown University. (2022). The case for de-emphasizing calculus in college admissions. Access and affordability. Georgetown University. https://feed.georgetown.edu/ac....
 
21.
Gierl, M. J., Bulut, O., Guo, Q., & Zhang, X. (2017). Developing, analyzing, and using distractors for multiple-choice tests in education: A comprehensive review. Review of Educational Research, 87(6), 1082-1116. https://doi.org/10.3102/003465....
 
22.
Hartati, N., & Yogi, H. P. (2019). Item analysis for a better quality test. English Language in Focus, 2(1), 59-70. https://doi.org/10.24853/elif.....
 
23.
Huntley, B., Engelbrecht, J., & Harding, A. (2010). A model for measuring the quality of a mathematics question. Far East Journal of Mathematical Education, 5(2), 141-171.
 
24.
Issah, Z. (2022a). Education in Kenya: The problem with KCPE and KCSE. Medium. https://zinahissa.medium.com/e....
 
25.
Issah, Z. (2022b). Standardizing Kenya’s national exams. Medium. https://zinahissa.medium.com/s....
 
26.
Kheyami, D., Jaradat, A., Al-Shibani, T., & Ali, F. A. (2018). Item analysis of multiple choice questions at the Department of Paediatrics, Arabian Gulf University, Manama, Bahrain. Sultan Qaboos University Medical Journal, 18(1), 68-74. https://doi.org/10.18295/squmj....
 
27.
Kumar, D., Jaipurkar, R., Shekhar, A., Sikri, G., & Srinivas, V. (2021). Item analysis of multiple choice questions: A quality assurance test for an assessment tool. Medical Journal Armed Forces India, 77(1), 85-89. https://doi.org/10.1016/j.mjaf....
 
28.
Lee, H. Y., Yune, S. J., Lee, S. Y., Im, S., & Kam, B. S. (2024). The impact of repeated item development training on the prediction of medical faculty members’ item difficulty index. BMC Medical Education, 24(1), Article 599. https://doi.org/10.1186/s12909....
 
29.
Mitra, N. K., Nagaraja, H. S., Ponnudurai, G., & Judson, J. P. (2009). The levels of difficulty and discrimination indices in type A multiple choice questions of pre-clinical semester 1 multidisciplinary summative tests. IeJSME, 3(1), 2-7. https://doi.org/10.56026/imu.3....
 
30.
Nitko, A. (2004). Educational assessment of students (4th ed.). Pearson/Merill Prentice Hall.
 
31.
Noble, S., Scheinost, D., & Constable, R. T. (2021). A guide to the measurement and interpretation of fMRI test-retest reliability. Current Opinion in Behavioral Sciences, 40, 27-32. https://doi.org/10.1016/j.cobe....
 
32.
Ntumi, S., Agbenyo, S., & Bulala, T. (2023). Estimating the psychometric properties (“item difficulty, discrimination and reliability indices”) of test items using Kuder-Richardson approach (KR-20). Shanlax International Journal of Education, 11(3), 18-28. https://doi.org/10.34293/educa....
 
33.
Padua, R., & Santos, R. G. (1997). Educational evaluation and measurement: Theory, practice, and application. KATHA Publishing.
 
34.
Patil, R., Palve, S. B., Vell, K., & Boratne, A. V. (2016). Evaluation of multiple choice questions by item analysis in a medical college at Pondicherry, India. International Journal of Community Medicine and Public Health, 3(6), 1612-1616. https://doi.org/10.18203/2394-....
 
35.
Rafi, I., Retnawati, H., Apino, E., Hadiana, D., Lydiati, I., & Rosyada, M. N. (2023). What might be frequently overlooked is actually still beneficial: Learning from post national-standardized school examination. Pedagogical Research, 8(1), Article em0145. https://doi.org/10.29333/pr/12....
 
36.
Rush, B. R., Rankin, D. C., & White, B. J. (2016). The impact of item-writing flaws and item complexity on examination item difficulty and discrimination value. BMC Medical Education, 16, 250. https://doi.org/10.1186/s12909....
 
37.
Sharma, L. R. (2021). Analysis of difficulty index, discrimination index and distractor efficiency of multiple choice questions of speech sounds of English. International Research Journal of MMC, 2(1), 15-28. https://doi.org/10.3126/irjmmc....
 
38.
Syeda, Z. F., Nazir, H. M., & Shah, A. A. (2021). Semi standadrdization of a test of secondary school mathematics. Pakistan Journal of Humanities & Social Sciences Research, 4(2), 1-50. https://doi.org/10.37605/pjhss....
 
39.
Taber, K. S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Research in Science Education, 48(6), 1273-1296. https://doi.org/10.1007/s11165....
 
40.
Tjabolo, S. A., & Otaya, L. G. (2019). Quality of school exam tests based on item response theory. Universal Journal of Educational Research, 7(10), 2156-2164. https://doi.org/10.13189/ujer.....
 
eISSN:1305-8223
ISSN:1305-8215
Journals System - logo
Scroll to top