RESEARCH PAPER
Rasch rating scale analysis of the survey of attitudes toward statistics
More details
Hide details
1
Department of Educational Psychology, Faculty of Educational Sciences, The Hashemite University, Zarqa, JORDAN
Publication date: 2022-11-16
EURASIA J. Math., Sci Tech. Ed 2022;18(12):em2190
KEYWORDS
ABSTRACT
Students in every discipline in higher education take at least one course in statistics. Therefore, it
is necessary to enhance students’ understanding of statistics and their achievement in such
courses by considering several factors that might contribute to this enhancement. Students’
attitudes toward statistics are a critical factor that influences their performance in statistics
courses, and thus an accurate measurement of attitudes is needed. The survey of attitudes toward
statistics (SATS-36) is widely used in measuring attitudes toward statistics; thus, it is important to
ensure that its items accurately assess this construct. Therefore, the purpose of the current study
was to validate this survey when administered to a convenience sample of 423 university students.
Using the Rasch rating scale model, the current study examined the dimensionality, item fit to the
Rasch model, item and person reliabilities, functionality of response categories, and distribution
of the SATS-36 items along the attitudes toward statistics continuum.
The findings revealed excellent item and person reliabilities (greater than 0.90) and the unidimensionality of the survey. Additionally, all items were closely aligned with the respondents,
and the response categories were well-functioning as each category had more than 10
observations and outfit statistics were all low. However, some improvements were suggested. All
items on the effect subscale and some others from different subscales need to be altered in
content, deleting three items (two from the value subscale and one from the difficulty subscale)
and adding more items to have a better distribution of items along the continuum. Finally, the
number of response categories is recommended to be reduced to five instead of seven to have a
more efficient rating scale. The findings of the current study imply that even though great care
has been taken in the development of this survey, examining the quality of its items and the utility
of its rating scale in new settings, and using different validation approaches is necessary.
REFERENCES (38)
1.
Abbiati, N., Fabrizio, M., Lopez, M., Perez, A., Plencovich, M., & Cueto, G. (2021). Attitudes related to students’ performance in statistics in university programs in Argentina. Statistics Education Research Journal, 20(2), 8.
https://doi.org/10.52041/serj.....
2.
Akour, M. M., Hammouri, H., Sabah, S., & Alomari, H. (2021). Is it suitable to use the same categorization in rating scales when applied to students with distinctive levels of achievement? Practical Assessment, Research, and Evaluation, 26, 18.
https://doi.org/10.7275/212461....
3.
Al-Thani, A. M., Akour, M. M., & Al-Kohji, S. M. (2021). Psychometric evaluation of an Arabic red flag screening checklist of autism spectrum disorders in infants and toddlers. Research in Autism Spectrum Disorders, 82, 101727.
https://doi.org/10.1016/j.rasd....
5.
Assarierh, R. (2013). Construct validity of an Arabic version of the survey of attitudes toward statistics SATS-36. Journal of College of Education: Ain Shams University, 37(3), 650-672.
6.
Bechrakis, T., Gialamas, V., & Barkatsas, A. N. (2011). Survey of attitudes toward statistics (SATS): An investigation of its construct validity and its factor structure invariance by gender. International Journal of Theoretical Educational Practice, 1(1), 1-15.
10.
Cashin, S. E., & Elmore, P. B. (2005). The survey of attitudes toward statistics scale: A construct validity study. Educational and Psychological Measurement, 65(3), 509-524.
https://doi.org/10.1177/001316....
11.
Chiesi, F., & Primi, C. (2009). Assessing statistics attitudes among college students: Psychometric properties of the Italian version of the survey of attitudes toward statistics (SATS). Learning and Individual Differences, 19(2), 309-313.
https://doi.org/10.1016/j.lind....
12.
Chiesi, F., & Primi, C. (2010). Cognitive and non-cognitive factors related to students’ statistics achievement. Statistics Education Research Journal, 9(1), 6-26.
https://doi.org/10.52041/serj.....
13.
Coetzee, S., & Van der Merwe, P. (2010). Industrial psychology students’ attitudes towards statistics. South African Journal of Industrial Psychology, 36(1), 1-9.
https://doi.org/10.4102/sajip.....
14.
DiStefano, C., & Jiang, N. (2020). Applying the Rasch rating scale method to questionnaire data. In M. S. Khine (Ed.), Rasch measurement: Applications in quantitative educational research (pp. 31-46). Springer.
https://doi.org/10.1007/978-98....
15.
Emmioglu, E., & Capa-Aydin, Y. (2012). Attitudes and achievement in statistics: A meta-analysis study. Statistics Education Research Journal, 11(2), 95-102.
https://doi.org/10.52041/serj.....
16.
Evans, B. (2007). Student attitudes, conceptions, and achievement in introductory undergraduate college statistics. The Mathematics Educator, 17(2), 24-30.
17.
Hammouri, H., Akour, M. M., & Sabah, S. (2020). Evaluation of students’ noncognitive large scale assessments measures: Problem solving experiences scale as a case study. Opcion, 36(26), 3115-3141.
https://produccioncientificalu....
18.
Hidayat, R., Idris, W. I. W., Qudratuddarsi, H., & Rahman, M. N. A. (2021). Validation of the mathematical modeling attitude scale for Malaysian mathematics teachers. EURASIA Journal of Mathematics, Science and Technology Education, 17(12), em2047.
https://doi.org/10.29333/EJMST....
19.
Hilton, S. C., Schau, C., & Olsen, J. A. (2004). Survey of attitudes toward statistics: Factor structure invariance by gender and by administration time. Structural Equation Modeling, 11(1), 92-109.
https://doi.org/10.1207/S15328....
20.
Hommik, C., & Luik, P. (2017). Adapting the survey of attitudes towards statistics (SATS-36) for Estonian secondary school students. Statistics Education Research Journal, 16(1), 228-239.
https://doi.org/10.52041/serj.....
21.
Linacre, J. M. (2002). Understanding Rasch measurement: Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3(1), 85-106.
24.
Nolan, M. M., Beran, T., & Hecker, K. G. (2012). Surveys assessing students’ attitudes toward statistics: A systematic review of validity and reliability. Statistics Education Research Journal, 11(2), 103-123.
https://doi.org/10.52041/serj.....
25.
Persson, I., Kraus, K., Hansson, L., & Wallentin, F. Y. (2019). Confirming the structure of the survey of attitudes toward statistics (SATS-36) by Swedish students. Statistics Education Research Journal, 18(1), 83-93.
https://doi.org/10.52041/serj.....
26.
Ramirez, C., Schau, C., & Emmioglu, E. (2012). The importance of attitudes in statistics education. Statistics Education Research Journal, 11(2), 57-71.
https://doi.org/10.52041/serj.....
27.
Sabah, S., Hammouri, H., & Akour, M. (2013). Validation of a scale of attitudes toward science across countries using Rasch model: Findings from TIMSS. Journal of Baltic Science Education, 12(5), 692-702.
https://doi.org/10.33225/jbse/....
28.
Saidi, S. S., & Siew, N. M. (2019). Investigating the validity and reliability of survey attitude towards statistics instrument among rural secondary school students. International Journal of Educational Methodology, 5(4), 651-661.
https://doi.org/10.12973/ijem.....
29.
Sarikaya, E. E., Ok, A., Capa-Aydin, Y., & Schau, C. (2018). Turkish version of the survey of attitudes toward statistics: Factorial structure invariance by gender. International Journal of Higher Education, 7(2), 121-127.
https://doi.org/10.5430/ijhe.v....
30.
Schau, C. (2003). Students attitudes: The “other” important outcome in statistics education. In Proceedings of the Joint Statistical Meetings (pp. 3673-3683).
31.
Schau, C., Stevens, J., Dauphinee, T. L., & Vecchio, A. Del. (1995). The development and validation of the survey of attitudes toward statistics. Educational and Psychological Measurement, 55(5), 868-875.
https://doi.org/10.1177/001316....
32.
Sesé, A., Jiménez, R., Montaño, J. J., & Palmer, A. (2015). Can attitudes toward statistics and statistics anxiety explain students’ performance? Revista de Psicodidactica [Psychodidactic Magazine], 20(2), 285-304.
https://doi.org/10.1387/RevPsi....
33.
Sondergeld, T. A., & Johnson, C. C. (2014). Using Rasch measurement for the development and use of affective assessments in science education research. Science Education, 98(4), 581-613.
https://doi.org/10.1002/sce.21....
34.
Stanisavljevic, D., Trajkovic, G., Marinkovic, J., Bukumiric, Z., Cirkovic, A., & Milic, N. (2014). Assessing attitudes towards statistics among medical students: Psychometric properties of the Serbian version of the survey of attitudes towards statistics (SATS). PLoS ONE, 9(11), e112567.
https://doi.org/10.1371/journa....
35.
Teman, E. D. (2013). A Rasch analysis of the statistical anxiety rating scale. Journal of Applied Measurement, 14(4), 414-434.
36.
Tempelaar, D. T., van der Loeff, S. S., & Gijselaers, W. H. (2007). A structural equation model analyzing the relationship of students’ attitudes toward statistics, prior reasoning abilities and course performance. Statistics Education Research Journal, 6(2), 78-102.
https://doi.org/10.52041/serj.....
37.
Vanhoof, S., Kuppens, S., Sotos, A. E. C., Verschaffel, L., & Onghena, P. (2011). Measuring statistics attitudes: Structure of the survey of attitudes toward statistics (SATS-36). Statistics Education Research Journal, 10(1), 35-51.
https://doi.org/10.52041/serj.....
38.
Xu, C., & Schau, C. (2019). Exploring method effects in the six-factor structure of the survey of attitudes toward statistics (SATS-36) 4. Statistics Education Research Journal, 18(2), 39-53.
https://doi.org/10.52041/serj.....