Investigating Reliability and Validity for the Construct of Inferential Statistics
Keywords:
assessment; Partial Credit Model; Rasch analysisAbstract
A hierarchical construct to assess and describe students’
learning of inferential statistics has been previously developed using the
Rasch analysis. In particular, the Rasch Partial Credit Model was
instrumental in identifying the number of strata in the construct and in
establishing the reliability and validity of the instrument used. In this
paper, the analysis is replicated with a different sample of students to
investigate if the reliability and validity still hold.
References
Begg, A. (1997). Some Emerging Influences Underpinning Assessment in Statistics. In I.Gal & J.B.Garfield (Eds.), The Assessment Challenge In Statistics Education. Amsterdam : IOS Press and the International Statistical Institute.
Biggs, J.B. & Collis, K.F. (1982). Evaluating the quality of learning: The SOLO taxonomy. Academic Press: New York.
Biggs, J.B. & Collis, K.F. (1991). Multimodal learning and the quality of intelligent behaviour. Intelligence: Reconceptualization and measurement, 57-76.
Bond, T.G. & Fox, C.M. (2007). Applying The Rasch Model: Fundamental Measurement in the Human Science. Lawrence Erlbaum. New Jersey. 2nd ed.
Bude, L. (2006). Assessing students’ understanding of statistics. In Proceedings of the 7th Annual Meeting of the International Conference on Teaching Statistics. Salvador, Brazil: ISI.
Online: www.stat.auckland.ac.nz/~iase/publications/17/6G3_BUDE.pdf
Callingham, R. (2009). Using Rasch Measurement to Identify Cross-cultural Aspects of Statistical Literacy. In Changing Climates: Education for Sustainable Futures, 1, 1-10.
Creswell, J.W. (2008). Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research. Pearson Education International. 3rd Ed.
Garfield, J. & Ben-Zvi, D. (2007). How Students Learn Statistics Revisited : A Current Review of Research on Teaching and Learning Statistics. International Statistical Review, 75(3), 372-396.
Green, K. E., & Frantom, C. G. (2002). Survey Development and validation with the Rasch Model. In International Conference on Questionnaire Development, Evaluation, and Testing. Charleston, SC.
Hassad, R.A. (2009). Reform-oriented Teaching of Introductory Statistics in the Health, Social and Behavioral Sciences – Historical Context and Rationale. International Journal of Social Sciences, 4(2), 132-137.
Jolliffe, F. (2007). The Changing Brave New World Of Statistics Assessment. IASE/ISI Satellite.
Online: http://iase-web.org/documents/papers/sat2007/Jolliffe.pdf
Kaplan, J.J. & Thorpe, J. (2010). Post Secondary and Adult Statistical Literacy: Assessing Beyond the Classroom. In Data and Context in Statistics Education: Towards an Evidence-Based Society. Proceedings of the Eighth International Conference on Teaching Statistics. Voorburg, The Netherlands: International Statistical Institute.
Kassim, N.A., Ismail, N.Z., Mahmud, Z., & Zainol, M.S. (2010). Measuring Students Understanding of Statistical Concepts using Rasch Measurement. International Journal of Innovation, Management and Technology, 1(1), 13-19.
Kataoka, V.Y., da Silva, C.B., Vendramini, C. & Cazorla, I. (n.d.). Using Rasch Partial Credit Model to analyze the Responses of Brazilian Undergraduate students to a Statistics Questionnaire. Available online: http://www.cerme7.univ.rzeszow.pl
Knupfer, N.N. & McLellan, H. (2001). Descriptive Research Methodologies. In D.H. Jonassen (Ed.), Handbook of Research for Educational Communications and Technology. The Association for Educational Communications and Technology, AECT.
Krishnan, S., & Idris, N. (2013a). The Development of an Assessment Construct for Inferential Statistics. Paper submitted to the International Conference on Assessment for Higher Education Across Domains and Skills (AHEADS2013). Kuala Lumpur, Malaysia.
Krishnan, S., & Idris, N. (2013b). The Use of a Hierarchical Construct to Investigate Students’ Learning of Inferential Statistics. In S. Forbes and B. Phillips (Eds.) Proceedings of the Joint IASE/IAOS Satellite Conference, Macao, China. August 2013.
Krishnan, S., & Idris, N. (2013c). The Use of Graphics Calculator in a Matriculation Statistics Classroom: A Malaysian Perspective. Technology Innovations in Statistics Education, 7(2).
Lesser, L.M. (2010). Equity and the Increasingly Diverse Tertiary Student Population: Challenges and Opportunities in Statistics Education. In Data and Context in Statistics Education: Towards an Evidence-Based Society. Proceedings of the Eighth International Conference on Teaching Statistics. Voorburg, The Netherlands: International Statistical Institute.
Lesser, L.M., & Winsor, M.S. (2009). English language learners in introductory statistics: Lessons learned from an exploratory case study of two pre-service teachers. Statistics Education Research Journal, 8(2), 5-32.
Linacre, J.M. (2002). What do Infit and Outfit, Mean-Square and Standardized Mean. Rasch Measurement Transactions, 16(2).
MacGillivray, H.L. (2004). Data Analysis: Introductory methods in context. Pearson Education Australia.
Mahmud, Z. (2011). Diagnosis of Perceived Attitude, Importance, and Knowledge in Statistics Based on Rasch Probabilistic Model. International Journal of Applied Mathematics and Informatics, 5, 291-298.
Masters, G.N. (1982). A Rasch model for partial credit scoring. Pschometrika, 47, 149-174.
Nunnaly, J. (1978). Psychometric theory. New York: McGraw Hill.
Rumsey, D.J. (2002). Statistical literacy as a goal for introductory statistics courses. Journal of Statistics Education, 10(3).
Online: http://www.amstat.org/publications/jse/v10n3/rumsey2.html
Santos, J.R.A. (1999). Cronbach’s alpha: A tool for assessing the reliability of scales. Journal of extension, 37(2), 1-5.
Smith, T.M. (2008). An Investigation into Student Understanding of Statistical Hypothesis Testing. (Doctoral dissertation). Retrieved from Digital Repository at the University of Maryland. (umi-umd-5658.pdf)
Tishkovskaya, S. & Lancaster, G.A. (2010). Teaching strategies to promote Statistical Literacy: Review and Implementation. In Data and Context in Statistics Education: Towards an Evidence-Based Society. Proceedings of the Eighth International Conference on Teaching Statistics. Voorburg, The Netherlands: International Statistical Institute.
Watson, J.M. (1997). Assessing statistical literacy using the media. The Assessment Challenge in Statistics Education, 107-121.
Watson, J.M. & Callingham, R.A. (2003). Statistical literacy: A complex hierarchical construct. Statistics Education Research Journal, 2(2), 3-46.
Watson, J.M., Kelly, B.A. & Izard, J.F. (2005). Statistical Literacy over a Decade. Building connections: Theory, research and practice, 775-782.
Downloads
Published
Issue
Section
License
Copyright (c) 2014 Saras Krishnan, Noraini Idris
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published by IJLTER are licensed under a Creative Commons Attribution Non-Commercial No-Derivatives 4.0 International License (CCBY-NC-ND4.0).
