Students' misconceptions of statistical inference: A review of the empirical evidence from research on statistics education

Educational Research Review

Volumn 2, Issue 2, 2007, Pages 98-113

  Castro Sotos, Ana Elisa ^a   Vanhoof, Stijn ^a   Van den Noortgate, Wim ^a   Onghena, Patrick ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Misconceptions; Research review; Statistical inference; Students

Indexed keywords

EID: 36049040706     PISSN: 1747938X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.edurev.2007.04.001     Document Type: Article

References (75)

1. Aberson C.L., Berger D.E., Healy M.R., and Romero V.L. Evaluation of an interactive tutorial for teaching hypothesis testing concepts. Teaching of Psychology 30 1 (2003) 75-78
2. Ancker J.S. The language of conditional probability. Journal of Statistics Education 14 (2006). http://www.amstat.org/publications/jse/v14n2/ancker.html retrieved July 28, 2006, from http://www.amstat.org/publications/jse/v14n2/ancker.html
3. APA. Publication manual of the American Psychological Association. 5th ed. (2001), American Psychological Association, Washington, DC
4. APA. PsycINFO (2006), APA. http://www.apa.org/psycinfo/ retrieved November 27, 2006 from http://www.apa.org/psycinfo/ [on-line]
5. Bar-Hillel M. The role of sample size in sample evaluation. Organizational Behavior and Human Performance 24 (1979) 245-257
6. Batanero C. Controversies around the role of statistical tests in experimental research. Mathematical Thinking and Learning (An International Journal) 2 1/2 (2000) 75-97
7. Batanero C. Statistics education as a field for research and practice. Proceedings of the 10th international commission for mathematical instruction (2005), International Commission for Mathematical Instruction, Copenhagen, Denmark
8. Batanero C., Godino J.D., Vallecillos A., Green D.R., and Holmes P. Errors and difficulties in understanding elementary statistical concepts. International Journal of Mathematics Education in Science and Technology 25 4 (1994) 527-547
9. Batanero C., Tauber L.M., and Sánchez V. Significado y comprensión de la distribución normal en un curso introductorio de análisis de datos [Meaning and understanding of the normal distribution in an introductory data analysis course]. Quadrante 10 1 (2001) 59-92
10. Batanero C., Tauber L.M., and Sánchez V. Students' reasoning about the normal distribution. In: Ben-Zvi D., and Garfield J. (Eds). The challenge of developing statistical literacy, reasoning and thinking (2004), Kluwer Academic Publishers, Dordrecht, The Netherlands 257-276
11. Belia S., Fidler F., Williams J., and Cumming G. Researchers misunderstand confidence intervals and standard error bars. Psychological Methods 10 (2005) 389-396
12. Borovcnik M., and Peard R. Probability. In: Bishop A.J. (Ed). International handbook of mathematics education (1996), Kluwer Academic Publishers, Dordrecht, The Netherlands 239-287
13. Bower, K. M. (2003). Some misconceptions about the Normal distribution. Paper presented at the Six Sigma Forum. Milwaukee, WI: American Society for Quality.
14. Brewer J.K. Behavioral statistics textbooks: Source of myths and misconceptions?. Journal of Educational Statistics 10 3 (1985) 252-268
15. Chance B., delMas R.C., and Garfield J. Reasoning about sampling distributions. In: Ben-Zvi D., and Garfield J. (Eds). The challenge of developing statistical literacy, reasoning and thinking (2004), Kluwer Academic Publishers, Dordrecht, The Netherlands 295-323
16. Chow S.L. Statistical significance (1996), SAGE Publications Ltd., London
17. Cohen J. Things I have learned (so far). American Psychologist 45 12 (1990) 1304-1312
18. Cohen S., Smith G., Chechile R.A., Burns G., and Tsai F. Identifying impediments to learning probability and statistics from an assessment of instructional software. Journal of Educational and Behavioral Statistics 21 1 (1996) 35-54
19. Cumming G. Understanding replication: Confidence intervals, p-values, and what's likely to happen next time. Proceedings of the seventh international conference on teaching statistics. Salvador, Bahia, Brazil (2006), International Association for Statistical Education
20. Cumming G., and Maillardet R. Confidence intervals and replication: Where will the next mean fall?. Psychological Methods 11 (2006) 217-227
21. Cumming G., Williams J., and Fidler F. Replication, and researchers' understanding of confidence intervals and standard error bars. Understanding Statistics 3 (2004) 199-311
22. Daniel L.G. Statistical significance testing: A historical overview of misuse and misinterpretation with implications for the editorial policies of educational journals. Research in the Schools 5 2 (1998) 23-32
23. delMas R.C., and Liu Y. Exploring students' conceptions of the standard deviation. Statistics Education Research Journal 4 1 (2005) 55-82
24. Falk R. Misconceptions of statistical significance. Journal of Structural Learning 9 (1986) 83-96
25. Falk R., and Greenbaum C.W. Significance tests die hard. Theory and Psychology 5 1 (1995) 75-98
26. Fidler F. Should psychology abandon p-values and teach CIs instead? Evidence-based reforms in statistics education. Proceedings of the seventh international conference on teaching statistics. Salvador, Bahia, Brazil (2006), International Association for Statistical Education
27. Fidler F., Thomason N., Cumming G., Finch S., and Leeman J. Editors can lead researchers to confidence intervals, but can't make them think: Statistical reform lessons from medicine. Psychological Science 15 (2004) 119-123
28. Finch S. Explaining the law of large numbers. In: Pereira-Mendoza L., Seu Kea L., Wee Kee T., and Wong W.K. (Eds). Proceedings of the fifth international conference on teaching statistics (1998), International Statistical Institute, Voorburg, The Netherlands 731-736
29. Finch S., and Cumming G. Assessing conceptual change in learning statistics. In: Pereira-Mendoza L., Seu Kea L., Wee Kee T., and Wong W.K. (Eds). Proceedings of the fifth international conference on teaching statistics (1998), International Statistical Institute, Voorburg, The Netherlands 897-904
30. Garfield. Assessing statistical reasoning. Statistics Education Research Journal 2 (2003) 22-38
31. Gigerenzer G. The superego, the ego, and the id in statistical reasoning. In: Keren G., and Lewis C. (Eds). A handbook for data analysis in the behavioral sciences. Methodological issues (1993), Lawrence Erlbaum Associates, Publishers, Hillsdale, NJ 311-339
32. Gigerenzer G. On narrow norms and vague heuristics: A reply to Kahneman and Tversky. Psychological Review 103 (1996) 592-596
33. Gliner J.A., Leech N.L., and Morgan G.A. Problems with null hypothesis significance testing (NHST): What do the textbooks say?. The Journal of Experimental Education 71 1 (2002) 83-92
34. Gordon H.R.D. AVERA members' perceptions of statistical significance tests and other statistical controversies. Journal of Vocational Education Research 26 2. (2001). http://scholar.lib.vt.edu/ejournals/JVER/v26n2/gordon.html retrieved January 12, 2006, from http://scholar.lib.vt.edu/ejournals/JVER/v26n2/gordon.html
35. Guzzetti B.J., Snyder T.E., Glass G.V., and Gamas W.S. Promoting conceptual change in science: A comparative meta-analysis of instructional interventions from reading education and science education. Reading Research Quarterly 28 2 (1993) 116-159
36. Haller H., and Krauss S. Misinterpretations of significance: A problem students share with their teachers?. Methods of Psychological Research 7 1 (2002) 1-20
37. In: Harlow L.L., Mulaik S.A., and Steiger J.H. (Eds). What if there were no significance tests? (1997), Lawrence Erlbaum Associates, Publishers, London
38. Healey J.F. Statistics. A tool for social research. 7th ed. (2005), Thomson Wadsworth, Belmont, CA
39. IES. (2006). ERIC. Retrieved November 28, 2006, from http://www.eric.ed.gov/ERICWebPortal/Home.portal?_nfpb=true&_pageLabel=Home_page [on-line].
40. Innabi H. Students' judgment of the validity of societal statistical generalization. In: Rogerson A. (Ed). Proceedings of the international conference on mathematics education into the 21st Century: Societal challenges, issues and approaches. Cairo, Egypt (1999)
41. ISI. (2004). Web of science. Retrieved November 29, 2006, from http://portal.isiknowledge.com/portal.cgi?DestApp=WOS&Func=Frame [on-line].
42. Kahneman D., Slovic P., and Tversky A. Judgment under uncertainty: Heuristics and biases (1982), Cambridge University Press
43. Kahneman D., and Tversky A. Subjective probability: A judgment of representativeness. Cognitive Psychology 3 (1972) 430-454
44. Kirk R.E. Promoting good statistical practices: Some suggestions. Educational and Psychological Measurement 61 2 (2001) 213-218
45. Konold C. Informal conceptions of probability. Cognition and Instruction 6 1 (1989) 59-98
46. Konold C. Understanding students' beliefs about probability. In: Von Glaserfeld E. (Ed). Radical constructivism in mathematics education (1991), Kluwer Academic Publishers, Dordrecht, The Netherlands 139-156
47. Krantz D.H. The null hypothesis testing controversy in psychology. Journal of the American Statistical Association 44 (1999) 1372-1381
48. Krauss S., and Wassner C. How significance tests should be presented to avoid the typical misinterpretations. Proceedings of the sixth international conference on teaching statistics (2002), International Statistical Institute, Voorburg, The Netherlands
49. Lecoutre M.-P., Poitevineau J., and Lecoutre B. Even statisticians are not immune to misinterpretations of null hypothesis significance tests. International Journal of Psychology 38 1 (2003) 37-45
50. Lipson K. The role of computer based technology in developing understanding of the concept of sampling distribution. Proceedings of the sixth international conference on teaching statistics (2002), International Statistical Institute, Voorburg, The Netherlands
51. McLean A., and Ernest J.M. The role of statistical significance testing in educational research. Research in the Schools 5 2 (1998) 15-22
52. Mittag K.C., and Thompson B. A national survey of AERA members' perceptions of statistical significance tests and other statistical issues. Educational Researcher 29 4 (2000) 1420
53. Moore D.S., and McCabe G.P. Introduction to the practice of statistics. 5th ed. (2006), W.H. Freeman and Company, New York
54. Nilsson N.J. Probabilistic logic. Artificial Intelligence 28 1 (1986) 71-87
55. Nisbett R.E., and Ross L. Human inference: Strategies and shortcomings of social judgment (1980), Prentice Hall, Englewood Cliffs, NJ
56. Reichardt C.S., and Gollob H.F. When confidence intervals should be used instead of statistical tests, and vice versa. In: Harlow L.L., Mulaik S.A., and Steiger J.H. (Eds). What if there were no significance tests? (1997), Lawrence Erlbaum Associates, Publishers, London 259-284
57. Sedlmeier P. The distribution matters: Two types of sample-size tasks. Journal of Behavioral Decision Making 11 (1998) 281-301
58. Sedlmeier P., and Gigerenzer G. Was Bernoulli wrong? On intuitions about sample size. Journal of Behavioral Decision Making 13 (2000) 133-139
59. Shaughnessy J.M. Research in probability and statistics: Reflections and directions. In: Grouws D.A. (Ed). Handbook of research on mathematics teaching and learning (1992), Macmillan, New York 465-494
60. Shaughnessy J.M. Research on students' understandings of probability. In: Kilpatric J., Martin W.G., and Schifter D. (Eds). A research companion to principles and standards for school mathematics (2003), National Council of Teachers of Mathematics, Reston, VA 216-226
61. Shaughnessy J.M., and Dick T. Monty's dilemma: Should you stick or switch?. Mathematics Teacher 84 (1991) 252-256
62. Smith III J.P., diSessa A.A., and Roschelle J. Misconceptions reconceived: A constructivist analysis of knowledge in transition. The Journal of the Learning Sciences 3 2 (1993) 115-163
63. Tversky A., and Kahneman D. Belief in the law of small numbers. Psychological Bulletin 76 (1971) 105-110
64. Vallecillos A. Comprensión de la lógica del contraste de hipótesis en estudiantes universitarios [Understanding of the logic of hypothesis testing amongst university students]. Recherches en Didactique des Mathematiques 15 (1995) 53-81
65. Vallecillos A. Students' conceptions of the logic of hypothesis testing. Hiroshima Journal of Mathematics Education 4 (1996) 43-61
66. Vallecillos A. Some empirical evidence on learning difficulties about testing hypotheses. Proceedings of the 52 session of the International Statistical Institute (1999), International Statistical Institute, Helsinki 201-204 Tome 58, Book 2
67. Vallecillos A. Understanding of the logic of hypothesis testing amongst university students. Journal for Didactics of Mathematics 21 (2000) 101-123
68. Vallecillos A. Empirical evidence about understanding of the level of significance concept in hypotheses testing by university students. Themes in Education 3 2 (2002) 183-198
69. Vallecillos A., and Batanero C. Conditional probability and the level of significance in tests of hypotheses. In: Puig L., and Gutiérrez A. (Eds). Proceedings of the 20th conference of the International Group for the Psychology of mathematics education (1996), University of Valenciam, Valencia, Spain 271-378
70. Vallecillos A., and Batanero C. Conceptos activados en el contraste de hipótesis estadísticas y su comprensión por estudiantes universitarios [Activated concepts in the statistical hypotheses contrast and their understanding by university students]. Recherches en Didactique des Mathematiques 17 (1997) 29-48
71. Ware M.E., and Chastain J.D. Developing selection skills in introductory statistics. Teaching of Psychology 18 4 (1991) 219-222
72. Watson J.M., and Moritz J.B. Development of understanding of sampling for statistical literacy. Journal of Mathematical Behavior 19 (2000) 109-136
73. Well A.D., Pollatsek A., and Boyce S.J. Understanding the effects of sample size on the variability of the mean. Organizational Behavior and Human Decision Processes 47 (1990) 289-312
74. Wilensky U. What is normal anyway? Therapy for epistemological anxiety. Educational Studies in Mathematics 33 2 (1997) 171-202
75. Williams A.M. Students' understanding of the significance level concept. In: Pereira-Mendoza L., Kea L.S., Kee T.W., and Wong W. (Eds). Proceedings of the fifth international conference on teaching statistics (1998), International Statistical Institute, Voorburg, The Netherlands 743-749