Heuristics and Biases as Measures of Critical Thinking: Associations with Cognitive Ability and Thinking Dispositions

Journal of Educational Psychology

Volumn 100, Issue 4, 2008, Pages 930-941

  West, Richard F ^a   Toplak, Maggie E ^b   Stanovich, Keith E ^c  

^a JAMES MADISON UNIVERSITY   (United States)

^b York University   (Canada)

^c UNIVERSITY OF TORONTO   (Canada)

Author keywords

critical thinking; heuristics and biases; intelligence; thinking dispositions

Indexed keywords

EID: 56349149889     PISSN: 00220663     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0012842     Document Type: Article

References (114)

1. Ajzen I. Intuitive theories of events and the effects of base-rate information on prediction. Journal of Personality and Social Psychology 35 (1977) 303-314
2. Bar-Hillel M. Back to base rates. In: Hogarth R.M. (Ed). Insights into decision making: A tribute to Hillel J. Einhorn (1990), University of Chicago Press, Chicago 200-216
3. Baron J. Beliefs about thinking. In: Voss J., Perkins D., and Segal J. (Eds). Informal reasoning and education (1991), Erlbaum, Hillsdale, NJ 169-186
4. Baron J. Thinking and deciding. 3rd ed. (2000), Cambridge University Press, Cambridge, England
5. Baron J., Bazerman M.H., and Shonk K. Enlarging the societal pie through wise legislation. A psychological perspective. Perspectives on Psychological Science 1 (2006) 123-132
6. Beyth-Marom R., and Fischhoff B. Diagnosticity and pseudodiagnositicity. Journal of Personality and Social Psychology 45 (1983) 1185-1195
7. Bruine de Bruin W., Parker A.M., and Fischhoff B. Individual differences in adult decision-making competence. Journal of Personality and Social Psychology 92 (2007) 938-956
8. Cacioppo J.T., Petty R.E., Feinstein J., and Jarvis W. Dispositional differences in cognitive motivation: The life and times of individuals varying in need for cognition. Psychological Bulletin 119 (1996) 197-253
9. Cassady J.C. Self-reported GPA and SAT: A methodological note. Practical Assessment, Research, and Evaluation 7 12 (2001)
10. Casscells W., Schoenberger A., and Graboys T. Interpretation by physicians of clinical laboratory results. New England Journal of Medicine 299 (1978) 999-1001
11. College Board. College Board SAT: 2006 college-bound seniors. Total group profile report (2006). http://www.collegeboard.com/prod_downloads/about/news_info/cbsenior/yr2006/national-report.pdf Retrieved June 9, 2008, from http://www.collegeboard.com/prod_downloads/about/news_info/cbsenior/yr2006/national-report.pdf
12. Denes-Raj V., and Epstein S. Conflict between intuitive and rational processing: When people behave against their better judgment. Journal of Personality and Social Psychology 66 (1994) 819-829
13. De Neys W. Dual processing in reasoning: Two systems but one reasoner. Psychological Science 17 (2006) 428-433
14. Ennis R.H. A taxonomy of critical thinking dispositions and abilities. In: Baron J., and Sternberg R. (Eds). Teaching thinking skills: Theory and practice (1987), Freeman, New York 9-26
15. Ennis R.H. Critical thinking (1996), Prentice-Hall, Upper Saddle River, NJ
16. Ennis R.H., Millman J., and Tomko T.N. Cornell Critical Thinking Tests (1985), Midwest, Pacific Grove, CA
17. Evans J.St.B.T. Bias in human reasoning: Causes and consequences (1989), Erlbaum, Hove, England
18. Evans J.St.B.T. The heuristic-analytic theory of reasoning: Extension and evaluation. Psychonomic Bulletin and Review 13 (2006) 378-395
19. Evans J.St.B.T. Hypothetical thinking: Dual processes in reasoning and judgment (2007), Psychology Press, New York
20. Evans J.St.B.T., Barston J., and Pollard P. On the conflict between logic and belief in syllogistic reasoning. Memory & Cognition 11 (1983) 295-306
21. Evans J.St.B.T., and Curtis-Holmes J. Rapid responding increases belief bias: Evidence for the dual-process theory of reasoning. Thinking & Reasoning 11 (2005) 382-389
22. Evans J.St.B.T., and Feeney A. The role of prior belief in reasoning. In: Leighton J.P., and Sternberg R.J. (Eds). The nature of reasoning (2004), Cambridge University Press, New York 78-102
23. Evans J.St.B.T., Newstead S.E., and Byrne R.M.J. Human reasoning: The psychology of deduction (1993), Erlbaum, Hove, England
24. Evans J.St.B.T., and Over D.E. Rationality and reasoning (1996), Psychology Press, Hove, England
25. Facione P. California Critical Thinking Skills Test & California Critical Thinking Dispositions Inventory (1992), California Academic Press, La Cruz, CA
26. Facione P. Critical thinking: What it is and why it counts (2007), Insight Assessment, California Academic Press, Millbrae, CA. http://www.insightassessment.com/pdf_files/DEXadobe.PDF Retrieved February 13, 2008, from http://www.insightassessment.com/pdf_files/DEXadobe.PDF
27. Fong G.T., Krantz D.H., and Nisbett R.E. The effects of statistical training on thinking about everyday problems. Cognitive Psychology 18 (1986) 253-292
28. Frey M.C., and Detterman D.K. Scholastic assessment or g? The relationship between the Scholastic Assessment Test and general cognitive ability. Psychological Science 15 (2004) 373-378
29. Garnham A., and Oakhill J.V. Accounting for belief bias in a mental model framework: Comment on Klauer, Musch, and Naumer (2000). Psychological Review 112 (2005) 509-518
30. Gilovich T., Griffin D., and Kahneman D. Heuristics and biases: The psychology of intuitive judgment (2002), Cambridge University Press, New York
31. Halpern, D. (2008). Halpern critical thinking assessment: Background and scoring standards. Unpublished manuscript, Claremont McKenna College, CA.
32. Harcourt Assessment. Watson-Glaser Critical Thinking Appraisal: Sample questions [Brochure] (2006). http://harcourt.assessment.com/hai/Images/dotCom/HTC/WG/SampleQuestions.pdf Retrieved January 8, 2008, from http://harcourt.assessment.com/hai/Images/dotCom/HTC/WG/SampleQuestions.pdf
33. Hastie R., and Dawes R.M. Rational choice in an uncertain world (2001), Sage, Thousand Oaks, CA
34. Higgins D.M., Peterson J.B., Pihl R.O., and Lee A.G.M. Prefrontal cognitive ability, intelligence, Big Five personality, and the prediction of advanced academic and workplace performance. Journal of Personality and Social Psychology 93 (2007) 298-319
35. Hilton D.J. Psychology and the financial markets: Applications to understanding and remedying irrational decision making. In: Brocas I., and Carrillo J.D. (Eds). The psychology of economic decisions: Vol. 1. Rationality and well-being (2003), Oxford University Press, Oxford, England 273-297
36. Johnson-Laird P.N. Deductive reasoning. Annual Review of Psychology 50 (1999) 109-135
37. Kahneman D., and Tversky A. On the psychology of prediction. Psychological Review 80 (1973) 237-251
38. Kahneman D., and Tversky A. On the reality of cognitive illusions. Psychological Review 103 (1996) 582-591
39. Kahneman D., and Tversky A. Choices, value, and frames (2000), Cambridge University Press, New York
40. Kahneman D.A. Perspective on judgment and choice: Mapping bounded rationality. American Psychologist 58 (2003) 697-720
41. Kardash C.M., and Scholes R.J. Effects of pre-existing beliefs, epistemological beliefs, and need for cognition on interpretation of controversial issues. Journal of Educational Psychology 88 (1996) 260-271
42. Kirkpatrick L., and Epstein S. Cognitive-experiential self-theory and subjective probability: Evidence for two conceptual systems. Journal of Personality and Social Psychology 63 (1992) 534-544
43. Klaczynski P.A. Bias in adolescents' everyday reasoning and its relationship with intellectual ability, personal theories, and self-serving motivation. Developmental Psychology 33 (1997) 273-283
44. Klaczynski P.A. Analytic and heuristic processing influences on adolescent reasoning and decision making. Child Development 72 (2001) 844-861
45. Klaczynski P.A., and Gordon D.H. Self-serving influences on adolescents' evaluations of belief-relevant evidence. Journal of Experimental Child Psychology 62 (1996) 317-339
46. Klaczynski P.A., and Lavallee K.L. Domain-specific identity, epistemic regulation, and intellectual ability as predictors of belief-based reasoning: A dual-process perspective. Journal of Experimental Child Psychology 92 (2005) 1-24
47. Klaczynski P.A., and Robinson B. Personal theories, intellectual ability, and epistemological beliefs: Adult age differences in everyday reasoning tasks. Psychology and Aging 15 (2000) 400-416
48. Klauer K.C., Musch J., and Naumer B. On belief bias in syllogistic reasoning. Psychological Review 107 (2000) 852-884
49. Kokis J., Macpherson R., Toplak M., West R.F., and Stanovich K.E. Heuristic and analytic processing: Age trends and associations with cognitive ability and cognitive styles. Journal of Experimental Child Psychology 83 (2002) 26-52
50. Kuhn D. Education for thinking (2005), Harvard University Press, Cambridge, MA
51. Kuncel N.R., Crede M., and Thomas L.L. The validity of self-reported grade point averages, class ranks, and test scores: A meta-analysis and review of the literature. Review of Educational Research 75 (2005) 63-82
52. Lehman D.R., Lempert R.O., and Nisbett R.E. The effect of graduate training on reasoning. American Psychologist 43 (1988) 431-442
53. Levesque H.J. Making believers out of computers. Artificial Intelligence 30 (1986) 81-108
54. Levesque H.J. Logic and the complexity of reasoning. In: Thomason R.H. (Ed). Philosophical logic and artificial intelligence (1989), Kluwer Academic, Dordrecht, the Netherlands 73-107
55. Lichtenstein S., and Slovic P. The construction of preference (2006), Cambridge University Press, Cambridge, England
56. Macpherson R., and Stanovich K.E. Cognitive ability, thinking dispositions, and instructional set as predictors of critical thinking. Learning and Individual Differences 17 (2007) 115-127
57. Margolis H. Patterns, thinking, and cognition (1987), University of Chicago Press, Chicago
58. Markovits H., and Nantel G. The belief-bias effect in the production and evaluation of logical conclusions. Memory & Cognition 17 (1989) 11-17
59. Moshman D. From inference to reasoning: The construction of rationality. Thinking and Reasoning 10 (2004) 221-239
60. Moshman D. Adolescent psychological development: Rationality, morality, and identity. 2nd ed. (2005), Erlbaum, Mahwah, NJ
61. Moshman, D. (in press). The development of rationality. In H. Siegel (Ed.), Oxford handbook of philosophy of education. Oxford, England: Oxford University Press.
62. Myers D.G. Intuition: Its powers and perils (2002), Yale University Press, New Haven, CT
63. Nickerson R.S. Cognition and chance: The psychology of probabilistic reasoning (2004), Erlbaum, Mahwah, NJ
64. Norris S.P., and Ennis R.H. Evaluating critical thinking (1989), Midwest, Pacific Grove, CA
65. Over D.E. Rationality and the normative/descriptive distinction. In: Koehler D.J., and Harvey N. (Eds). Blackwell handbook of judgment and decision making (2004), Blackwell Publishing, Malden, MA 3-18
66. Parker A.M., and Fischhoff B. Decision-making competence: External validation through an individual differences approach. Journal of Behavioral Decision Making 18 (2005) 1-27
67. Pedhazur E.J. Multiple regression in behavioral research: Explanation and prediction. 3rd ed. (1997), Harcourt Brace, Fort Worth, TX
68. Perkins D.N. Outsmarting IQ: The emerging science of learnable intelligence (1995), Free Press, New York
69. Perkins D.N., Farady M., and Bushey B. Everyday reasoning and the roots of intelligence. In: Voss J., Perkins D., and Segal J. (Eds). Informal reasoning and education (1991), Erlbaum, Hillsdale, NJ 83-105
70. Piaget J. Intellectual evolution from adolescence to adulthood. Human Development 15 (1972) 1-12
71. Reyna V.F. Class inclusion, the conjunction fallacy, and other cognitive illusions. Developmental Review 11 (1991) 317-336
72. Reyna V.F. How people make decisions that involve risk. Current Directions in Psychological Science 13 (2004) 60-66
73. Reyna V.F., and Brainerd C.J. The origins of probability judgment: A review of data and theories. In: Wright G., and Ayton P. (Eds). Subjective probability (1994), Wiley, New York 239-272
74. Reyna V.F., and Brainerd C.J. Numeracy, ratio bias, and denominator neglect in judgments of risk and probability. Learning and Individual Differences 17 (2007) 147-159
75. Reyna V.F., and Farley F. Risk and rationality in adolescent decision making. Psychological Science in the Public Interest 7 (2006) 1-44
76. Reyna V.F., and Lloyd F.J. Physician decision making and cardiac risk: Effects of knowledge, risk perception, risk tolerance, and fuzzy processing. Journal of Experimental Psychology: Applied 12 (2006) 179-195
77. Reyna V.F., Lloyd F.J., and Brainerd C.J. Memory, development, and rationality: An integrative theory of judgment and decision making. In: Schneider S.L., and Shanteau J. (Eds). Emerging perspectives on judgment and decision research (2003), Cambridge University Press, New York 201-245
78. Sá W., West R.F., and Stanovich K.E. The domain specificity and generality of belief bias: Searching for a generalizable critical thinking skill. Journal of Educational Psychology 91 (1999) 497-510
79. Samuels R., and Stich S.P. Rationality and psychology. In: Mele A.R., and Rawling P. (Eds). The Oxford handbook of rationality (2004), Oxford University Press, Oxford, England 279-300
80. Schommer M. Effects of beliefs about the nature of knowledge on comprehension. Journal of Educational Psychology 82 (1990) 498-504
81. Siegel H. Educating reason: Rationality, critical thinking, and education (1988), Routledge, London
82. Siegel H. Rationality redeemed? Further dialogues on an educational ideal (1997), Routledge, London
83. Sloman S.A., Over D., Slovak L., and Stibel J.M. Frequency illusions and other fallacies. Organizational Behavior and Human Decision Processes 91 (2003) 296-309
84. Slugoski B.R., Shields H.A., and Dawson K.A. Relation of conditional reasoning to heuristic processing. Personality and Social Psychology Bulletin 19 (1993) 158-166
85. Stanovich K.E. Who is rational? Studies of individual differences in reasoning (1999), Erlbaum, Mahwah, NJ
86. Stanovich K.E. The robot's rebellion: Finding meaning in the age of Darwin (2004), University of Chicago Press, Chicago
87. Stanovich K.E. Distinguishing the reflective, algorithmic, and autonomous minds: Is it time for a tri-process theory?. In: Evans J., and Frankish K. (Eds). In two minds: Dual processes and beyond (2008), Oxford University Press, Oxford, England
88. Stanovich K.E. The psychology of rational thought: What intelligence tests miss (2008), Yale University Press, New Haven, CT
89. Stanovich, K. E. (in press). Rationality and the reflective mind: Toward a tri-process model of cognition. New York: Oxford University Press.
90. Stanovich K.E., Toplak M.E., and West R.F. The development of rational thought: A taxonomy of heuristics and biases. Advances in Child Development and Behavior 36 (2008) 251-285
91. Stanovich K.E., and West R.F. Reasoning independently of prior belief and individual differences in actively open-minded thinking. Journal of Educational Psychology 89 (1997) 342-357
92. Stanovich K.E., and West R.F. Individual differences in rational thought. Journal of Experimental Psychology: General 127 (1998) 161-188
93. Stanovich K.E., and West R.F. Discrepancies between normative and descriptive models of decision making and the understanding/acceptance principle. Cognitive Psychology 38 (1999) 349-385
94. Stanovich K.E., and West R.F. Individual differences in reasoning: Implications for the rationality debate?. Behavioral and Brain Sciences 23 (2000) 645-726
95. Stanovich K.E., and West R.F. Natural myside bias is independent of cognitive ability. Thinking & Reasoning 13 (2007) 225-247
96. Stanovich K.E., and West R.F. On the relative independence of thinking biases and cognitive ability. Journal of Personality and Social Psychology 94 (2008) 672-695
97. Stein E. Without good reason: The rationality debate in philosophy and cognitive science (1996), Oxford University Press, Oxford, England
98. Sternberg R.J. Thinking styles (1997), Cambridge University Press, Cambridge, England
99. Sternberg R.J. Why schools should teach for wisdom: The balance theory of wisdom in educational settings. Educational Psychologist 36 (2001) 227-245
100. Sternberg R.J. Wisdom, intelligence, and creativity synthesized (2003), Cambridge University Press, Cambridge, England
101. Sunstein C.R. Risk and reason: Safety, law, and the environment (2002), Cambridge University Press, Cambridge, England
102. Sunstein C.R. Moral heuristics. Behavioral and Brain Sciences 28 (2005) 531-573
103. Toplak M., Liu E., Macpherson R., Toneatto T., and Stanovich K.E. The reasoning skills and thinking dispositions of problem gamblers: A dual-process taxonomy. Journal of Behavioral Decision Making 20 (2007) 103-124
104. Toplak M., and Stanovich K.E. The domain specificity and generality of disjunctive reasoning: Searching for a generalizable critical thinking skill. Journal of Educational Psychology 94 (2002) 197-209
105. Tversky A., and Kahneman D. Judgment under uncertainty: Heuristics and biases. Science 185 (1974, September 27) 1124-1131
106. Tversky A., and Kahneman D. Causal schemas in judgments under uncertainty. In: Fishbein M. (Ed). Progress in social psychology (1979), Erlbaum, Hillsdale, NJ
107. Tversky A., and Kahneman D. The framing of decisions and the psychology of choice. Science 211 (1981, January 30) 453-458
108. Tversky A., and Kahneman D. Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment. Psychological Review 90 (1983) 293-315
109. Tversky A., and Kahneman D. Rational choice and the framing of decisions. Journal of Business 59 (1986) 251-278
110. Unsworth N., and Engle R.W. The nature of individual differences in working memory capacity: Active maintenance in primary memory and controlled search from secondary memory. Psychological Review 114 (2007) 104-132
111. U.S. Department of Health and Human Services, Office of the Assistant Secretary for Planning and Evaluation. Trends in the well-being of America's children and youth, 2003 (2003). http://aspe.hhs.gov/HSP/03trends/index.htm Retrieved June 10, 2006, from http://aspe.hhs.gov/HSP/03trends/index.htm
112. Wason P.C. Reasoning. In: Foss B. (Ed). New horizons in psychology (1966), Penguin, Harmonsworth, England 135-151
113. Watson G., and Glaser E.M. Watson-Glaser Critical Thinking Appraisal (1980), Psychological Corp, New York
114. West R.F., and Stanovich K.E. The incidental acquisition of information from reading. Psychological Science 2 (1991) 325-330