RESEARCH PAPER
Design and content validity of mathematics creative problem-solving ability instrument for junior high school students
 
More details
Hide details
1
Universitas Negeri Yogyakarta, Sleman, INDONESIA
 
2
Universitas Muria Kudus, Kudus, INDONESIA
 
 
Online publication date: 2024-05-30
 
 
Publication date: 2024-06-01
 
 
EURASIA J. Math., Sci Tech. Ed 2024;20(6):em2462
 
KEYWORDS
ABSTRACT
This research aims to design and validate the contents of the mathematical creative problem-solving (MCPS) instrument to measure creative problem-solving skills. This instrument consists of four aspects, each with related items representing latent variables for promoting students’ MCPS. An instrument construct that contains aspects of divergent and convergent thinking is presented. The stimulus provided is real problems in everyday life (real-world situations) with tiered levels of structure of the observed learning outcome (SOLO) taxonomy. The question structure developed is in the form of near-transfer and far-transfer questions. The content validity process is presented by seven expert validators experienced in mathematics, mathematics education, and measurement. The level of agreement between expert assessments is determined using the Aiken formula. Aiken coefficient for all items is above the good threshold. The instrument developed has demonstrated strong content validity and is recommended for measuring MCPS skills of junior high school students.
 
REFERENCES (81)
1.
Aiken, L. R. (1985). Three coefficients to analyze the reliability and validity of rating. Educational and Psychological Measurement, 45, 131-142. https://doi.org/10.1177/001316....
 
2.
Aktas, M. C., & Tabak, S. (2018). Turkish adaptation of math and me survey: A validity and reliability study. European Journal of Educational Research, 7(3), 707-714. https://doi.org/10.12973/eu-je....
 
3.
Allen, M. J., & Yen, W. M. (1979). Introduction to measurement theory. Brooks/Cole Publishing Company.
 
4.
Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214-221. https://doi.org/10.1016/j.saph....
 
5.
Amalina, I. K., & Vidákovich, T. (2022). An integrated STEM-based mathematical problem-solving test: Developing and reporting psychometric evidence. Journal on Mathematics Education, 13(4), 587-604. https://doi.org/10.22342/jme.v....
 
6.
Amalina, I. K., & Vidákovich, T. (2023). Assessment of domain-specific prior knowledge: A development and validation of mathematical problem-solving test. International Journal of Evaluation and Research in Education, 12(1), 468-476. https://doi.org/10.11591/ijere....
 
7.
Arp, R. (2008). Scenario visualization: An evolutionary account of creative problem solving. American Journal of Human Biology, 21(1). https://doi.org/10.1002/ajhb.2....
 
8.
Arthur, C., Badertscher, E., Goldenberg, E. P., Moeller, B., McLeod, M., Nikula, J., & Reed, K. (2017). Strategies to improve all students’ mathematics learning and achievement. Education Development Center, Inc.
 
9.
Authié, C. N., Poujade, M., Talebi, A., Defer, A., Zenouda, A., Coen, C., Mohand-Said, S., Chaumet-Riffaud, P., Audo, I., & Sahel, J.-A. (2023). Development and validation of a novel mobility test for rod-cone dystrophies, from reality to virtual reality. American Journal of Ophthalmology, 258, 43-54. https://doi.org/10.1016/j.ajo.....
 
10.
Bicer, A., Lee, Y., Capraro, R. M., Capraro, M. M., Barroso, L. R., & Rugh, M. (2019). Examining the effects of STEM PBL on students’ divergent thinking attitudes related to creative problem solving. In Proceedings of the 2019 IEEE Frontiers in Education Conference (pp. 1-6). IEEE. https://doi.org/10.1109/FIE439....
 
11.
Biggs, J. B., & Collis, K. F. (1982). Evaluating the quality of learning: The SOLO taxonomy (structure of the observed learning outcome). Academic Press. https://doi.org/10.1177/000494....
 
12.
Brophy, D. R. (2001). Comparing the attributes, activities, and performance of divergent, convergent, and combination thinkers. Creativity Research Journal, 13(3-4), 439-455. https://doi.org/10.1207/S15326....
 
13.
Buitrago, R., Salinas, J., & Boude, O. (2023). Validation of a model for the formalization of personal learning pathways through expert judgment. Journal of Higher Education Theory and Practice, 23(12), 224-241. https://doi.org/10.33423/jhetp....
 
14.
Byrnes, J. P. (1996). Cognitive development and learning in instructional contexts. Allyn and Bacon.
 
15.
Chamberlin, S. A., Liljedahl, P., & Savić, M. (2022). Mathematical creativity: A developmental perspective. Springer. https://doi.org/10.1007/978-3-....
 
16.
Chen, Y. W., Chang, W. H., & Kuo, C. C. (2016). A comparative study of the divergent problem solving abilities of mathematically and scientifically talented students and nongifted students. Thinking Skills and Creativity, 22, 247-255. https://doi.org/10.1016/j.tsc.....
 
17.
Chirove, M., Mogari, D., & Ugorji, O. (2022). Students’ mathematics-related belief systems and their strategies for solving non-routine mathematical problems. Waikato Journal of Education, 27(3), 101-121. https://doi.org/10.15663/wje.v....
 
18.
Cho, S., & Hwang, D.-J. (2007). Math creative problem solving ability test for identification of the mathematically gifted middle school students. Journal of Gifted/Talented Education, 17(1), 1-26. https://doi.org/10.9722/JGTE.2....
 
19.
Creswell, J. W., & Poth, C. N. (2018). Qualitative inquiry & research design: Choosing among five approaches. SAGE. https://doi.org/10.13187/rjs.2....
 
20.
Cukurova, M., Bennett, J., & Abrahams, I. (2018). Students’ knowledge acquisition and ability to apply knowledge into different science contexts in two different independent learning settings. Research in Science and Technological Education, 36(1), 17-34. https://doi.org/10.1080/026351....
 
21.
Daniels, J. S., Moreau, D., & Macnamara, B. N. (2022). Learning and transfer in problem solving progressions. Journal of Intelligence, 10(4), 85. https://doi.org/10.3390/jintel....
 
22.
de Vink, I. C., Willemsen, R. H., Lazonder, A. W., & Kroesbergen, E. H. (2022). Creativity in mathematics performance: The role of divergent and convergent thinking. British Journal of Educational Psychology, 92(2), 484-501. https://doi.org/10.1111/bjep.1....
 
23.
del Pozo-Herce, P., Martínez-Sabater, A., Chover-Sierra, E., Gea-Caballero, V., Satústegui-Dordá, P. J., Saus-Ortega, C., Tejada-Garrido, C. I., Sánchez-Barba, M., Pérez, J., Juárez-Vela, R., Santolalla-Arnedo, I., & Baca-García, E. (2023). Application of the Delphi method for content validity analysis of a questionnaire to determine the risk factors of the Chemsex. Healthcare, 11(21), 2905. https://doi.org/10.3390/health....
 
24.
Erdem, C. (2020). Introduction to 21st century skills and education. In 21st century skills and education. Cambridge Scholars Publishing.
 
25.
Espinoza Salfate, L., Guerrero, G., Barbé Farré, J., & Márquez Salinas, F. (2023). Design and validation of a classroom observation instrument to evaluate the quality of mathematical activity from a gender perspective. Education Sciences, 13(3), 266. https://doi.org/10.3390/educsc....
 
26.
Fernandes, S., Abelha, M., & Albuquerque, A. S. (2022). The student journey in PBL: Using individual portfolios to promote self-reflection and assessment as learning. International Symposium on Project Approaches in Engineering Education, 12, 207-211. https://doi.org/10.5281/zenodo....
 
27.
Gavaz, H. O., Yazgan, Y., & Arslan, C. (2021). Non-routine problem solving and strategy flexibility: A quasi-experimental study. Journal of Pedagogical Research, 5(3), 40-54. https://doi.org/10.33902/jpr.2....
 
28.
Ghazali, N., Sahari Nordin, M., Hashim, S., & Hussein, S. (2018). Measuring content validity: Students self-efficacy and meaningful learning in massive open online course (MOOC) scale. In Proceedings of the 3rd International Conferences on Education in Muslim Society (pp. 128-133). https://doi.org/10.2991/icems-....
 
29.
Ghorbanpour, E., Abbasian, G. R., & Mohseni, A. (2021). Assessment alternatives in developing L2 listening ability: Assessment FOR, OF, AS learning or integration? Assessment x approach. International Journal of Language Testing, 11(1), 36-57.
 
30.
Gilligan, K. A., Thomas, M. S. C., & Farran, E. K. (2020). First demonstration of effective spatial training for near transfer to spatial performance and far transfer to a range of mathematics skills at 8 years. Developmental Science, 23(4), e12909. https://doi.org/10.1111/desc.1....
 
31.
Gizzi, E., Nair, L., Chernova, S., & Sinapov, J. (2022). Creative problem solving in artificially intelligent agents: A survey and framework. International Joint Conference on Artificial Intelligence, 75(2022), 857-911. https://doi.org/10.24963/ijcai....
 
32.
Hook, P. (2014). About SOLO taxonomy. https://leadinglearnerdotme.fi....
 
33.
Hrnjičić, A., Alihodžić, A., Čunjalo, F., & Hamzić, D. K. (2022). Development of an item bank for measuring students’ conceptual understanding of real functions. European Journal of Science and Mathematics Education, 10(4), 455-470. https://doi.org/10.30935/scima....
 
34.
Incebacak, B., & Ersoy, E. (2018). Ortaokul öğrencilerinin yaratıcı problem çözme becerileri [Creative problem solving skills of middle school students]. Necatibey Eğitim Fakültesi Elektronik Fen ve Matematik Eğitimi Dergisi [Necatibey Faculty of Education Electronic Journal of Science and Mathematics Education], 12(1), 1-24. https://doi.org/10.17522/balik....
 
35.
Isrok’atun. (2014). Situation-based learning untuk meningkatkan kemampuan creative problem solving matematis siswa [Situation-based learning to improve students’ creative mathematical problem solving abilities]. Universitas Pendidikan Indonesia.
 
36.
Jaiswal, P. (2019). Using constructive alignment to foster teaching learning processes. English Language Teaching, 12(6), 10. https://doi.org/10.5539/elt.v1....
 
37.
Johnny, J., Abdullah, A. H., Abu, M. S., Mokhtar, M., & Atan, N. A. (2017). Difficulties in reasoning among high achievers when doing problem solving in mathematics. Man in India, 97(12), 61-70.
 
38.
Kahveci, M., Kahveci, A., Mansour, N., & Alarfaj, M. M. (2016). Construct validity and reliability measures of scores from the science teachers’ pedagogical discontentment (STPD) scale. EURASIA Journal of Mathematics, Science and Technology Education, 12(3), 549-558. https://doi.org/10.12973/euras....
 
39.
Karamustafaoğlu, O., & Pektaş, H. M. (2023). Developing students’ creative problem solving skills with inquiry-based STEM activity in an out-of-school learning environment. Education and Information Technologies, 28, 7651-7669. https://doi.org/10.1007/s10639....
 
40.
Kasemsap, K. (2017). Advocating problem-based learning and creative problem-solving skills in global education. In C. Zhou (Ed.), Handbook of research on creative problem-solving skill development in higher education (pp. 351-377). IGI Global. https://doi.org/10.4018/978-1-....
 
41.
Keles, T. (2022). Investigation of high school students’ creative problem-solving attributes. Journal of Pedagogical Research, 6(4), 66-83. https://doi.org/10.33902/JPR.2....
 
42.
Kim, H., Cho, S., & Ahn, D. (2003). Development of mathematical creative problem solving ability test for identification of the gifted in math. Gifted Education International, 18, 164-174. https://doi.org/10.1177/026142....
 
43.
Klymchuk, S., Thomas, M., Alexander, J., Evans, T., Gulyaev, S., Liu, W., Novak, J., Murphy, P., Stephens, J., & Zaliwski, A. (2020). Investigating the impact of non-routine problem-solving on creativity, engagement, and intuition of STEM tertiary students. Teaching and Learning Research Initiative. https://eric.ed.gov/?id=ED6080....
 
44.
Kozakli Ulger, T., & Yazgan, Y. (2021). Non-routine problem-posing skills of prospective mathematics teachers. Eurasian Journal of Educational Research, 21(94), 147-168. https://doi.org/10.14689/ejer.....
 
45.
Lee, K. H., Kim, Y., & Lim, W. (2020). Risks of aiming to kill two birds with one stone: The effect of mathematically gifted and talented students in the dual realities of special schooling. Mathematical Thinking and Learning, 23(4), 271-290. https://doi.org/10.1080/109860....
 
46.
Lee, K. S., Hwang, D., & Seo, J. J. (2003). A development of the test for mathematical creative problem solving ability. Journal of the Korea Society of Mathematical Education, Series D: Research in Mathematical Education, 7(3), 163-189.
 
47.
Lee, M., & Cha, D. (2016). A comparison of generalizability theory and many facet Rasch measurement in an analysis of mathematics creative problem solving test. Journal of Curriculum and Evaluation, 19(2), 251-279. https://doi.org/10.29221/jce.2....
 
48.
Leikin, R., Leikin, M., Paz-Baruch, N., Waisman, I., & Lev, M. (2017). On the four types of characteristics of super mathematically gifted students. High Ability Studies, 28(1), 107-125. https://doi.org/10.1080/135981....
 
49.
Leminger, E. A. (2020). Human resource professional’s attitudes towards creativity [Master’s project, State University of New York].
 
50.
Lim, H. L., Wun, T. Y., & Idris, N. (2010). Superitem test: As an alternative assessment tool. International Journal for Mathematics Teaching and Learning.
 
51.
Maker, C. J. (2020). Identifying exceptional talent in science, technology, engineering, and mathematics: Increasing diversity and assessing creative problem-solving. Journal of Advanced Academics, 31(3), 161-210. https://doi.org/10.1177/193220....
 
52.
McMillan, J. H. (2018). Classroom assessment: Principles and practice that enhance student learning and motivation. Pearson.
 
53.
Munahefi, D. N., Khoirunnisa, K., Dwijanto, Mulyono, Fariz, R., & Noverianto, B. (2021). Development of open ended project based learning model assisted by GeoGebra for mathematical creative thinking ability. In Proceedings of the 8th International Conference on Mathematics, Science and Education. https://doi.org/10.1063/5.0126....
 
54.
Novriania, M. R., & Surya, E. (2017). Analysis of student difficulties in mathematics problem solving ability at MTs SWASTA IRA Medan. International Journal of Sciences: Basic and Applied Research, 33(3), 63-75.
 
55.
OECD. (2012). PISA 2012 creative problem solving. https://www.oecd.org/pisa/inno....
 
56.
OECD. (2019). PISA 2021 creative thinking framework. OECD Publishing.
 
57.
Oraklibel, R. D., Ulkebas, S. D., & Oygur, I. (2018). Creative problem-solving assessment and product design education. In Proceedings of the International Conference on Engineering and Product Design Education.
 
58.
Orón, J. V., & Lizasoain, I. (2023). Achieving transfer from mathematics learning. Education Sciences, 13(2), 161. https://doi.org/10.3390/educsc....
 
59.
Phonapichat, P., Wongwanich, S., & Sujiva, S. (2014). An analysis of elementary school students’ difficulties in mathematical problem solving. Procedia-Social and Behavioral Sciences, 116, 3169-3174. https://doi.org/10.1016/j.sbsp....
 
60.
Proctor, T. (2005). Creative problem solving for managers–Developing skills for decision making and innovation. Routledge. https://doi.org/10.1177/135050....
 
61.
Rahayuningsih, S., Sirajuddin, S., & Ikram, M. (2021). Using open-ended problem-solving tests to identify students’ mathematical creative thinking ability. Participatory Educational Research, 8(3), 285-299. https://doi.org/10.17275/per.2....
 
62.
Rebello, N. S., Cui, L., Bennett, A. G., Zollman, D. A., & Ozimek, D. J. (2007). Transfer of learning in problem solving in the context of mathematics and physics. In D. H. Jonassen (Ed.), Learning to solve complex scientific problems. Routledge. https://doi.org/10.4324/978131....
 
63.
Risnanosanti, Susyla, D., & Syofiana, M. (2019). Developing students critical thinking ability through lesson study. Journal of Physics: Conference Series, 1320, 012005. https://doi.org/10.1088/1742-6....
 
64.
Roebianto, A., Savitri, S. I., Aulia, I., Suciyana, A., & Mubarokah, L. (2023). Content validity: Definition and procedure of content validation in psychological research. TPM-Testing, Psychometrics, Methodology in Applied Psychology, 30(1), 5-18. https://doi.org/10.4473/TPM30.....
 
65.
Rosaini, R., Budiyono, B., & Pratiwi, H. (2019). Mathematics teacher supporting higher order thinking skill of students through assessment as learning in instructional model. Journal of Physics: Conference Series, 1157(3), 032076. https://doi.org/10.1088/1742-6....
 
66.
Rotigel, J. V., & Fello, S. (2004). Mathematically gifted students: How can we meet their needs? Gifted Child Today, 27(4), 46-51. https://doi.org/10.4219/gct-20....
 
67.
Rubenstein, L. D. V., Callan, G. L., Speirs Neumeister, K., Ridgley, L. M., & Hernández Finch, M. (2020). How problem identification strategies influence creativity outcomes. Contemporary Educational Psychology, 60, 101840. https://doi.org/10.1016/j.cedp....
 
68.
Ryan, V., Fitzmaurice, O., & O’donoghue, J. (2022). Student interest and engagement in mathematics after the first year of secondary education. European Journal of Science and Mathematics Education, 10(4), 436-454. https://doi.org/10.30935/SCIMA....
 
69.
Sala, G., Deniz Aksayli, N., Semir Tatlidil, K., Tatsumi, T., Gondo, Y., & Gobet, F. (2019). Near and far transfer in cognitive training: A second-order meta-analysis. Collabra: Psychology, 5(1), 18. https://doi.org/10.1525/collab....
 
70.
Sipayung, T. N., Imelda, Siswono, T. Y. E., & Masriyah. (2021). The preliminary study of students’ creative problem-solving ability. Journal of Physics: Conference Series, 1836, 012052. https://doi.org/10.1088/1742-6....
 
71.
Suherman, S., & Vidákovich, T. (2022). Assessment of mathematical creative thinking: A systematic review. Thinking Skills and Creativity, 44, 101019. https://doi.org/10.1016/j.tsc.....
 
72.
Svensäter, G., & Rohlin, M. (2022). Assessment model blending formative and summative assessments using the SOLO taxonomy. European Journal of Dental Education, 27(1), 149-157. https://doi.org/10.1111/eje.12....
 
73.
Tan, S., & Maker, C. J. (2020). Assessing creative problem solving ability in mathematics: The discover mathematics assessment. Gifted and Talented International, 35(1), 58-71. https://doi.org/10.1080/153322....
 
74.
Teseo, R. F. (2019). Analyses of attribute patterns of mathematical creative problem-solving ability in 6th grade students. St. John’s University.
 
75.
Ulya, H., Rahayu, R., & Riyono, A. (2019). Integration of products assessment in mind mapping learning to enhance mathematical communication. Journal of Physics: Conference Series, 1175, 012142. https://doi.org/10.1088/1742-6....
 
76.
Ulya, H., Sugiman, Rosnawati, R., & Retnawati, H. (2024). Technology-based learning interventions on mathematical problem-solving: A meta-analysis of research in Indonesia. International Journal of Evaluation and Research in Education, 13(1), 292-301. https://doi.org/10.11591/ijere....
 
77.
van Hooijdonk, M., Mainhard, T., Kroesbergen, E. H., & van Tartwijk, J. (2020). Creative problem solving in primary education: Exploring the role of fact finding, problem finding, and solution finding across tasks. Thinking Skills and Creativity, 37), 100665. https://doi.org/10.1016/j.tsc.....
 
78.
van Hooijdonk, M., Mainhard, T., Kroesbergen, E. H., & Van Tartwijk, J. (2022). Examining the assessment of creativity with generalizability theory: An analysis of creative problem solving assessment tasks. Thinking Skills and Creativity, 43, 100994. https://doi.org/10.1016/j.tsc.....
 
79.
Yazgan-Sağ, G. (2022). Views on mathematical giftedness and characteristics of mathematically gifted students-the case of prospective primary mathematics teachers. Mathematics Teaching-Research Journal, 14(5), 128-140.
 
80.
Yuliani, A., Kusumah, Y. S., & Sumarmo, U. (2019). Mathematical creative problem solving ability and self-efficacy: A survey with eight grade students. Journal of Physics: Conference Series, 1157(3), 032097. https://doi.org/10.1088/1742-6....
 
81.
Zhang, Q., Zhang, Q., Zhang, X., & Gao, C. (2023). Effects of rule variant reasoning in far transfer problem solving. Acta Psychologica Sinica, 55(1), 117-128. https://doi.org/10.3724/SP.J.1....
 
eISSN:1305-8223
ISSN:1305-8215
Journals System - logo
Scroll to top