One size fits all? The limitations of standardised assessment in critical thinking

Assessment and Evaluation in Higher Education

Volumn 44, Issue 5, 2019, Pages 664-675

  Rear, David ^a  

^a CHUO UNIVERSITY   (Japan)

Author keywords

critical thinking; critical thinking assessment; standardised testing; validity

Indexed keywords

EID: 85055756905     PISSN: 02602938     EISSN: 1469297X     Source Type: Journal    
DOI: 10.1080/02602938.2018.1526255     Document Type: Article

References (57)

1. Abrami, P. C., R. M., Bernard, E., Borokhovski, A., Wade, M. A., Surkes, R., Tamim, and D., Zhang. 2008. “Instructional Interventions Affecting Critical Thinking Skills and Dispositions: A Stage 1 Meta-Analysis.” Review of Educational Research 78 (4):1102–34.
2. Anderson, L., and D., Krathwohl. 2001. A Taxonomy for Learning, Teaching and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. New York: Longman.
3. Association of American Colleges and Universities. 2011. The LEAP Vision for Learning: Outcomes, Practices, Impact, and Employers’ View. Washington, DC: Author.
4. Bailin, S. 2002. “Critical Thinking and Science and Education.” Science and Education 11 (4):361–75.
5. Bailin, S., R., Case, J. R., Coombs, and L. B., Daniels. 1999. “Conceptualizing Critical Thinking.” Journal of Curriculum Studies 31 (3):285–302.
6. Barnet, S., and H., Bedau. 2011. Critical Thinking, Reading, and Writing: A Brief Guide to Argument. 7th ed. Boston, MA: Bedford.
7. Bernard, R., D., Zhang, P., Abrami, F., Sicoly, E., Borokhovski, and M., Surkes. 2008. “Exploring the Structure of the Watson–Glaser Critical Thinking Appraisal: One Scale or Many Subscales?” Thinking Skills and Creativity 3 (1):15–22.
8. Bloom, B. 1956. Taxonomy of Educational Objectives: The Classification of Educational Goals. Handbook 1: Cognitive Domain. New York: McKay.
9. California Critical Thinking Skills Test Homepage. Accessed 12 August 2018.https://www.insightassessment.com/Products/Products-Summary/Critical-Thinking-Skills-Tests/California-Critical-Thinking-Skills-Test-CCTST
10. Davies, M. 2016. “What is Critical Thinking? And Do Universities Really Teach It?” The Conversation, November 2016. Accessed 9 April 2018. http://theconversation.com/what-is-critical-thinking-and-do-universities-really-teach-it-69046
11. Dewey, J. 1909, 1998. How We Think. Mineola, NY: Dover Publications.
12. Ennis, R. H. 1985. “A Logical Basis for Measuring Critical Thinking Skills.” Educational Leadership 43 (2):44–8.
13. Ennis, R. H. 1987. “A Taxonomy of Critical Thinking Dispositions and Abilities.” In Teaching Thinking Skills: Theory and Practice, edited by J., Baron and R.J., Sternberg, 9–26. New York: W. H. Freeman and Company
14. Ennis, R. H. 1989. “Critical Thinking and Subject Specificity: Clarification and Needed Research.” Educational Researcher 18 (3):4–10.
15. Ennis, R. H. 2005. Supplement to the Test/Manual Entitled the Ennis–Weir Critical Thinking Essay Test. Urbana: Department of Educational Policy Studies, University of Illinois at Urbana–Champaign.
16. Ennis, R. H., and E., Weir. 1985. The Ennis–Weir Critical Thinking Essay Test. Pacific Grove, CA: Midwest Publications.
17. Ennis, R. H., J., Millman, and T. N., Tomko. 1985. Cornell Critical Thinking Tests. Pacific Grove, CA: Midwest Publications.
18. Facione, P. A. 1990a. The California Critical Thinking Skills Test-College Level. Technical report #2. Factors Predictive of CT Skills. Millbrae, CA: California Academic Press.
19. Facione, P. A. 1990b. Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instructions. Research Findings and Recommendations. Millbrae, CA: California Academic Press.
20. Facione, P. A., and N. C., Facione. 1992. The California Critical Thinking Dispositions Inventory. Millbrae, CA: California Academic Press.
21. Facione, P. A. 2000. “The Disposition toward Critical Thinking: Its Character, Measurement, and Relation to Critical Thinking Skill.” Informal Logic 20 (1):61–84.
22. Gellin, A. 2003. “The Effect of Undergraduate Student Involvement on Critical Thinking: A Meta-Analysis of the Literature 1991–2000.” Journal of College Student Development 44 (6):746–62.
23. Halpern, D. F. 1998. “Teaching Critical Thinking for Transfer across Domains: Dispositions, Skills, Structure Training, and Metacognitive Monitoring.” American Psychologist 53 (4):449–55.
24. Halpern, D. F. 2007. Halpern Critical Thinking Assessment Using Everyday Situations: Background and Scoring Standards. Claremont, CA: Claremont McKenna College.
25. Halpern Critical Thinking Assessment homepage 2018. Accessed 12 August 2018. https://sites.google.com/site/dianehalperncmc/home/research/halpern-critical-thinking-assessment
26. Hills, G. 1999. From Beggars to Choosers: University Funding for the Future. London: Politeia.
27. Jankowski, N., J., Timmer, J., Kinzie, and G., Kuh. 2018. Assessment That Matters: Trending toward Practices That Document Authentic Student Learning. Urbana, IL: National Institute for Learning Outcomes Assessment.
28. Ku, K. Y. 2009. “Assessing Students’ Critical Thinking Performance: Urging for Measurements Using Multi-Response Format.” Thinking Skills and Creativity 4 (1):70–6.
29. Kuh, G. D., N., Jankowski, S. O., Ikenberry, and J., Kinzie. 2014. Knowing What Students Know and Can Do: The Current State of Student Learning Outcomes Assessment in U.S. Colleges and Universities. Champaign, IL: National Institute for Learning Outcomes Assessment.
30. Kuncel, N. R. 2011. “Measurement and Meaning of Critical Thinking.” Paper Presented at the National Research Council’s 21st Century Skills Workshop, Irvine, CA, January 6–8.
31. Lai, E. 2011. Critical Thinking: A Literature Review. Pearson Research Report.
32. Leppa, C. J. 1997. “Standardized Measures of Critical Thinking: Experience with the California Critical Thinking Tests.” Nurse Education 22 (5):29–33.
33. Liu, O. L. 2008. Measuring Learning Outcomes in Higher Education Using the Measure of Academic Proficiency and Progress (MAPP) (Research Report No. RR-08-47). Princeton, NJ: Educational Testing Service.
34. Liu, O. L., L., Frankel, and K., Roohr. 2014. Assessing Critical Thinking in Higher Education: Current State and Directions for Next-Generation Assessment (Research Report No. RR-08-47). Princeton, NJ: Educational Testing Service.
35. Liu, O. L., L., Mao, L., Frankel, and J., Xu. 2016. “Assessing Critical Thinking in Higher Education: The HEIghten™ Approach and Preliminary Validity Evidence.” Assessment & Evaluation in Higher Education 41 (5):677–94.
36. Loo, R., and K., Thorpe. 1999. “A Psychometric Investigation of Scores on the Watson-Glaser Critical Thinking Appraisal New Forms.” Educational and Psychological Measurement 59 (6):995–1003.
37. Macpherson, R., and K. E., Stanovich. 2007. “Cognitive Ability, Thinking Dispositions, and Instructional Set as Predictors of Critical Thinking.” Learning and Individual Differences 17 (2):115–27.
38. McMillan, J. H. 1987. “Enhancing College Students’ Critical Thinking: A Review of Studies.” Research in Higher Education 26 (1):3–29.
39. McPeck. J. E. 1981. Critical Thinking and Education. New York: St Martin’s Press.
40. McPeck, J. E. 1990. “Critical Thinking and Subject Specificity: A Reply to Ennis.” Educational Researcher 19 (4):10–2.
41. Moore, T. 2011. Critical Thinking and language: The Challenge of Generic Skills and Disciplinary Discourse. London: Bloomsbury.
42. Nichols, S. L., G. V., Glass, and D. C., Berliner. 2006. “High-Stakes Testing and Student Achievement: Does Accountability Pressure Increase Student Learning?” Education Policy Analysis Archives 14:1–9. [online]. Accessed April 2018. http://hub.mspnet.org/index.cfm/12605
43. Nickerson, R. S. 1988. “On Improving Thinking through Instruction.” Review of Research in Education 15:3–57.
44. Norris, S. P. 1989. “Can We Test Validly for Critical Thinking?” Educational Researcher 18 (9):21–6.
45. O’Hare, L., and C., McGuinness. 2015. “The Validity of Critical Thinking Tests for Predicting Degree Performance: A Longitudinal Study.” International Journal of Educational Research 72:162–72.
46. Osborn, M. 2006. “Changing the Context of Teachers’ Work and Professional Development: A European Perspective.” International Journal of Educational Research 45 (4-5):242–53.
47. Pascarella, E. T., and P. T., Terenzini. 2005. How College Affects Students: A Third Decade of Research. San Francisco: Jossey-Bass.
48. Paul, R. 1992. “Critical Thinking: What, Why, and How?” New Directions for Community Colleges 1992 (77):3–24.
49. Paul, R., and L., Elder. 2009. Critical Thinking: Concepts & Tools. Dillon Beach, CA: The Foundation for Critical Thinking.
50. Perkins, D., E., Jay, and S., Tishman. 1993. “Beyond Abilities: A Dispositional Theory of Thinking.” Merrill-Palmer Quarterly 39 (1):1–21.
51. Ralston, P., and C., Bays. 2015. “Critical Thinking Development in Undergraduate Engineering Students: From Freshman through Senior Year: A 3-Cohort Longitudinal Study.” American Journal of Engineering Education (AJEE) 6 (2):85–98.
52. Renaud, R., and H., Murray. 2008. “A Comparison of a Subject-Specific and a General Measure of Critical Thinking.” Thinking Skills and Creativity 3 (2):85–93.
53. Siller, T. 2001. “Sustainability and Critical Thinking in Civil Engineering Curriculum.” Journal of Professional Issues in Engineering Education and Practice 127 (3):104–8.
54. Taube, K. T. 1997. “Critical Thinking Ability and Disposition as Factors of Performance on a Written Critical Thinking Test.” Journal of General Education 46:129–64.
55. Van Gelder, T. 2005. “Teaching Critical Thinking: Some Lessons from Cognitive Science.” College Teaching 53 (1):41–8.
56. Watson, G., and E. M., Glaser. 1980. Watson–Glaser Critical Thinking Appraisal, Forms A and B Manual. San Antonio, TX: The Psychological Corporation.
57. Williams, R. L., R., Oliver, and S., Stockdale. 2004. “Psychological versus Generic Critical Thinking as Predictors and Outcome Measures in a Large Undergraduate Human Development Course.” Journal of General Education 53 (1):37–58.