The validity of higher-order questions as a process indicator of educational quality

Research in Higher Education

Volumn 48, Issue 3, 2007, Pages 319-351

  Renaud, Robert D ^a   Murray, Harry G ^b  

^a UNIVERSITY OF MANITOBA   (Canada)

^b UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

College; Critical thinking; Educational quality; Higher order; Performance indicators; Process indicators; University

Indexed keywords

EID: 33847254515     PISSN: 03610365     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11162-006-9028-1     Document Type: Article

References (58)

1. Astin, A. W. (1970). The methodology of research on college input, Part one. Sociology of Education 43: 223-254.
2. Astin, A. W. (1971). Open admissions and programs for the disadvantaged. Journal of Higher Education 42: 629-647.
3. Astin, A. W., and Henson, J. W. (1977). New measures of college selectivity. Research in Higher Education 6: 1-9.
4. Astin, A. W., and Panos, R. J. (1969). The Educational and Vocational Development of College Students, American Council on Education, Washington, D. C.
5. Ball, R., and Halwachi, J. (1987). Performance indicators in higher education. Higher Education 16: 393-405.
6. Barnes, C. (1983). Questioning in the college classrooms. In: Ellner, C., and Barnes, C. (eds.), Studies in College Teaching: Experimental Results, Theoretical Interpretations and New Perspectives, D. C. Heath, Lcxington, MA.
7. Bercuson, D. J., Bothwell, R., and Granatstein, J. L. (1984). The Great Brain Robbery: Universities on the Road to Ruin, McClellend and Stewart Limited, Toronto, Canada.
8. Bercuson, D. J., Bothwell, R., and Granatstein, J. L. (1997). The Crisis in Canada's Universities: Petrified Campus, Random House of Canada, Toronto, Canada.
9. Bloom, B. S. (1956). Taxonomy of Educational Objectives: Cognitive Domain, McKay, New York.
10. Borden, V. M. H., and Bottrill, K. V. (1994). Performance indicator: history, definitions, and methods. In: Borden, V. M. H., and Banta, T. W. (eds.), Using Performance Indicators to Guide Strategic. Decision Making, Jossey-Bass, San Francisco.
11. Braxton, J. M. (1990). Course-level academic processes as indicators of the quality of undergraduate education. Instructional Developments 1: 8-10.
12. Braxton, J. M. (1993). Selectivity and rigor in research universities. Journal of Higher Education 64: 657-675.
13. Braxton, J. M., and Nordvall, R. C. (1985). Selective liberal arts colleges: Higher quality as well as higher prestige? Journal of Higher Education 56: 536-554.
14. Braxton, J. M., and Nordvall, R. C. (1988). Quality of graduate department origin of faculty and its relationship to undergraduate course examination questions. Research in Higher Education 28: 145-159.
15. Bruncau, W., and Savage, D. C. (2002). Counting out the scholars: How performance indicators undermine universities and colleges, Lorimar, Toronto.
16. Conrad, C. F., and Blackburn, R. T. (1985). Program quality in higher education: A review and critique of literature and research. In: J. C., Smart (ed.), Higher Education: Handbook of Theory and Research (Vol. 1), Agathon, New York, pp. 283-308.
17. Dressel, P. L., and Mayhew, L. B. (1954). General education: Explorations in evaluation, American Council on Education, Washington, D. C.
18. Ennis, R. H. (1985). A logical basis for measuring critical thinking skills. Educational Leadership 43: 44-48.
19. Ewell, P. T. (1989). Institutional characteristics and faculty/administrator perceptions of outcomes: An exploratory analysis. Research in Higher Education 30: 113-136.
20. Facione, P. A. (ed.) (1990). Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction, American Philosophical Association, ERIC ID 315 423.
21. Ferguson, N. B. L. (1986). Encouraging responsibility, active participation, and critical thinking in general psychology students. Teaching of Psychology 13: 217-218.
22. Foster, P. (1983). Verbal participation and outcomes in medical education: A study of third-year clinical-discussion groups. In: Ellner, C., and Barnes, C. (eds.), Studies in College Teaching: Experimental Results, Theoretical Interpretations and New Perspectives, D. C. Heath, Lexington, MA.
23. Furedy, C., and Furedy, J. (1985). Critical thinking: Toward research and dialogue. In: Donald, J., and Sullivan, A. (eds.), Using Research to Improve Teaching (New Direction for Teaching and Learning No. 23), Jossey-Bass, San Francisco.
24. Gadzella, B. M., Ginther, D. W., and Bryant, G. W. (1996). Teaching and Learning Critical Thinking Skills. Paper Presented at the International Congress of Psychology (26th, Montreal, Quebec, August, 1996).
25. Gage, N. L., and Berliner, D. C. (1998). Educational Psychology (6th Ed.), Houghton Mifflin Company, Boston.
26. Gareis, K. C. (1995). Critiquing articles cited in the introductory textbook: A writing assignment. Teaching of Psychology 22: 233-235.
27. Halpern, D. F. (1996). Thought and Knowledge: An Introduction to Critical Thinking, (3th Ed.), Erlbaum, Mahwah NJ.
28. Halpern, D. F. (1998). Teaching critical thinking for transfer across domains. American Psychologist 53: 449-455.
29. Halpern, D. F. (2001). Assessing the effectiveness of critical thinking instruction. The Journal of General Education 50: 270-286.
30. Hossler, D. (2000). The problem with college rankings. About Campus 5: 20-24.
31. Keeley, S. M., Ali, R., and Gebing, T. (1998). Beyond the sponge model: Encour aging students' questioning skills in abnormal psychology. Teaching of Psychology 25: 270-274.
32. King, A. (1989). Effects of self-questioning training on college students' comprehension of lectures. Contemporary Educational Psychology 14: 1-16.
33. King, A. (1990). Enhancing peer interaction and learning in the classroom through reciprocal questioning. American Educational Research Journal 27: 664-687.
34. King, A. (1995). Inquiring minds really do want to know: Using questioning to teach critical thinking. Teaching of Psychology 22: 13-17.
35. Logan, G. H. (1976). Do sociologists teach students to think more critically? Teaching Sociology 4: 29-48.
36. McGuire, M. D. (1995). Validity issues for reputational studies. In: Walleri, R. D., and Moss, M. K. (eds.), Evaluating and Responding to College Guidebooks and Rankings, Jossey-Bass, San Francisco, pp. 45-59.
37. McMillan, J. H. (1987). Enhancing college students' critical thinking: A review of studies. Research in Higher Education 26: 3-29.
38. Nedwick, B. P., and Neal, J. E. (1994). Performance indicators and rational management tools: A comparative assessment of projects in North America and Europe. Research in Higher Education 35: 75-103.
39. Nordvall, R. C., and Braxton, J. M. (1996). An alternative definition of quality of undergraduate education: Toward usable knowledge for improvement. Journal of Higher Education 67: 483-497.
40. Pascarella, E. T., and Terenzini, P. T. (2005). How College Affects Students: A Third Decade of Research, (Vol. 2), Jossey-Bass, San Francisco.
41. Paul, R. (1993). Critical Thinking: How to Prepare Students for a Rapidly Changing World, (3th Ed.), Sonoma State University Center for Critical Thinking and Moral Critique, Rohnert Park, CA.
42. Prentice, D. A., and Miller, D. T. (1992). When small effects are impressive. Psychological Bulletin 112: 160-164.
43. Scheirer, M. (1994). Designing and using process evaluation. In: Wholey, J. S., Hatry, H. P., and Newcomer, K. E. (eels.), Handbook of Practical Program Evaluation, Jossey-Bass, San Fransisco.
44. Smith, D. G. (1977). College classroom interactions and critical thinking. Journal of Educational Psychology 69: 180-190.
45. Smith, D. G. (1980). College instruction: Four empirical views. Instruction and outcomes in an undergraduate setting. Paper Presented at the Annual Meeting of the American Educational Research Association, Boston, April, 1980.
46. Solmon, L. C. (1973). The definition and impact of college quality. In: Solmon, L., and Taubman, P. (eds.), Does College Matter? Academic Press, New York, pp. 77-105.
47. Solmon, L. C. (1975). The definition of college quality and its impact on earnings. Explorations in Economic Research 2: 537-587.
48. Stalker, R. G. (1986). Is the quality of university education declining? Survey of faculty attitudes and longitudinal comparison of undergraduate honours theses. Unpublished Honours Thesis, University of Western Ontario, London, Canada.
49. Tan, D. L. (1986). The assessment of quality in higher education: A critical review of the literature and research. Research in Higher Education 24: 223-265.
50. Tsui, L. (1999). Courses and instruction affecting critical thinking. Research in Higher Education 40: 185-200.
51. Tsui, L. (2002). Fostering critical thinking through effective pedagogy: Evidence from four case studies. Journal of Higher Education 73: 740-763.
52. Watson, G. B., and Glaser, E. M. (1980). Watson-Glaser Critical Thinking Appraisal, The Psychological Corporation, San Antonio.
53. Webster, D. (1992). Are they any good? Rankings of undergraduate education in U. S. News and World Report and Money. Change 24: 19-31.
54. Williams, R. L., Oliver, R., Allin, J. L., Winn, B., and Booher, C. S. (2003). Psychological critical thinking as a course predictor and outcome variable. Teaching of Psychology 30: 220-223.
55. Williams, R. L., Oliver, R., and Stockdale, S. (2004). Psychological versus generic critical thinking as predictors and outcome measures in a large undergraduate human development course. Journal of General Education 53: 37-58.
56. Williams, R. L., and Stockdale, S. L. (2003). High performing students with low critical thinking skills. Journal of General Education 52: 199-225.
57. Willis, S. A. (1992). Integrating levels of critical thinking into writing assignments for introductory psychology students. Paper presented at the annual meeting of the American Psychological Association, Washington, DC, August 1992.
58. Winne, P. H. (1979). Experiment relating teachers' use of higher cognitive questions to students achievement. Review of Educational Research 49: 13-50.