An approach to measuring cognitive outcomes across higher education institutions

Research in Higher Education

Volumn 46, Issue 3, 2005, Pages 251-276

  Klein, Stephen P ^a   Kuh, George D ^b   Chun, Marc ^c   Hamilton, Laura ^a   Shavelson, Richard ^d  

^a RAND CORPORATION   (United States)

^b INDIANA UNIVERSITY   (United States)

^c Council for Aid to Education ^*  (United States)

^d STANFORD UNIVERSITY   (United States)

Author keywords

Assessment; Measuring student outcomes; Value added

Indexed keywords

EID: 14944373897     PISSN: 03610365     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11162-004-1640-3     Document Type: Article

References (79)

1. A. W. Astin 1968 Undergraduate achievement and institutional ΓÇ£excellenceΓÇ¥ Science 161 661 668
2. A. W. Astin 1977 Four Critical Years: Effects of College on Beliefs, Values, and Knowledge Jossey-Bass San Francisco
3. A. W. Astin 1991 Assessment for Excellence: The Philosophy and Practice of Assessment and Evaluation in Higher Education American Council on Education/Macmillan New York
4. A. W. Astin 1993 What Matters in College? Four Critical Years Revisited Jossey-Bass San Francisco
5. T. W. Banta J. P. Lund F. W. Oblander 1996 Assessment in Practice: Putting Principles to Work on College Campuses Jossey-Bass San Francisco
6. R. Benjamin R. H. Hersh 2002 Measuring the difference college makes: The RAND/CAE value added assessment initiative Peer Review 4 7 10
7. S. Black 1993 Portfolio Assessment The Executive Educator 15 28 31
8. L. Bohr E. Pascarella A. Nora B. Zusman M. Jacobs M. Desler C. Bulakowski 1994 Cognitive effects of two-year and four-year institutions: a preliminary study Community College Review 22 1 411
9. J. D. Bransford A. L. Brown L. L. Cocking 1999 How People Learn: Brain, MindExperienceand School National Academy Press Washington, DC
10. J. C. Burke H. Minassians 2002 Performance Reporting: The Preferred ΓÇ£No CostΓÇ¥ Accountability Program (2001). The Nelson A. Rockefeller Institute of Government Albany
11. P. M. Callan J. E. Finney 2002 Assessing educational capital: an imperative for policy Change 34 25 31
12. Carini R., Kuh G. and Klein S. 2004 Student engagement and student learning: insights from a construct validation study. San Diego California: Paper presented at the meetings of the American Educational Research Association
13. J. B. Carroll 1993 Human Cognitive Abilities A Survey of Factor-Analytic Studies Cambridge University Press CambridgeEngland
14. A. W. Chickering Z. F. Gamson 1987 Seven principles for good practice in undergraduate education American Association for Higher Education Bulletin 39 7 3 7
15. J. J. K. Cole M. T. Nettles S. Sharp 1997 Assessment of teaching and learning for improvement and accountability: state governing, coordinating board and regional accreditation association policies and practices University of Michigan, National Center for Postsecondary Improvement Ann Arbor
16. L. J. Cronbach 2000 Remaking the Concept of Aptitude: Extending the Legacy of Richard E. Snow Erlbaum Mahway, NJ
17. E. Dey S. Hurtado B. Rhee K. K. Inkelas L. A. Wimsatt F. Guan 1997 Improving Research on Postsecondary Outcomes:A Review of the Strengths and Limitations of National Data Sources National Center for Postsecondary Improvement StanfordCA
18. T. D. Erwin K. W. Schrell 2003 Assessment of critical thinking: New Jersey's tasks in critical thinking The Journal of General Education 52 50 70
19. P. T. Ewell 1984 The Self-regarding Institution: Information for Excellence National Center for Higher Education Management Systems BoulderCO
20. Ewell P. T. 1987. Establishing a campus-based assessment program. In D. F. Halpern. Student outcomes assessment: what institutions stand to gain. New Directions for Higher Education 59: 9-24.
21. P. T. Ewell 1988 Outcomes, assessmentand academic improvement: In search of usable knowledge J. C. Smart Higher Education: Handbook of Theory and Research Agathon Press New York 53 108 Vol. IV
22. P. T. Ewell 1994 A Policy Guide for Assessment: Making Good Use of the Tasks in Critical Thinking Educational Testing Service Princeton, NJ
23. L. Flowers S. J. Osterlind E. T. Pascarella C. T. Pierson 2001 How much do students learn in colleges? The Journal of Higher Education 72 5 565 583
24. B. Fong 1988 Assessing the departmental major J. H. McMillan Assessing Students' Learning. New Directions for Teaching and Learning Jossey-Bass San Francisco 71 83 Vol. 34
25. Forrest A. 1990 Time Will Tell: Portfolio-assisted Assessment of General Education. The AAHE Assessment Forum, American Association for Higher Education.
26. S. M. Gates C. Augustine R. Benjamin T. Bikson E. Derghazarian T. Kaganoff D. Levy J. Moini R. Zimmer 2001 Ensuring the quality and productivity of education and professional development activities: a review of approaches and lessons for DoD National Defense Research InstituteRAND Santa MonicaCA
27. K. M. Gentemann J. J. Fletcher D. L. Potter 1994 Refocusing the academic program review on student learning M. K. Kinnick Providing useful information for deans and department chairs, New Directions for Institutional Research No. 84 Jossey-Bass San Francisco 31 46
28. W. E. Gill 1993 Conversations about accreditation: Middle States Association of Colleges and Schools: Focusing on outcomes assessment in the accreditation process Paper presented at Double Feature Conference on Assessment and Continuous Quality Improvement of the American Association for Higher Education ChicagoIL (ERIC Document Reproduction Service No. ED 358 792).
29. Graham, A., and Thompson, N. (2001). Broken ranks: U.S. News' college rankings measure everything but what matters. And most universities do not seem to mind. The Washington monthly. Available at: www.washingtonmonthly.com/ features/2001/0109.graham.thompson.html.
30. J. E. Gustafsson J. O. Undheim 1996 Individual differences in cognitive functions Calfee R. Berliner D. Handbook of Educational Psychology Macmillan New York 186 242
31. D. F. Halpern 1987 Recommendations and caveats Halpern D. F. Student Outcomes Assessment: What Institutions Stand to Gain. New directions for higher education Jossey-Bass San Francisco 109 111 Vol. 59
32. Hutchings P. 1989. Behind outcomes: contexts and questions. The AAHE Assessment Forum, American Association for Higher Education.
33. J. Immerwahl 2000 Great Expectations: How Californians View Higher Education National Center for Public Policy and Higher Education and Public Agenda San JoseCA (Table 3 National Column).
34. M. Jacobi A. Astin F. Ayala 1987 College student outcomes assessment: a talent development perspective Association for the Study of Higher Education Washington, DC (ASHE-ERIC Higher Education Report No. 7).
35. R. Johnson R. D. McCormick J. S. Prus J. S. Rogers 1993 Assessment options for the college major Banta T. W. Making a Difference: Outcomes of a Decade of Assessment in Higher Education Jossey-Bass San Francisco 151 167
36. S. Klein 1996 The costs and benefits of performance testing on the bar examination The Bar Examiner 65 3 13 20
37. Klein, S. and Hamilton L. 1998. The validity of the U.S. News and World Report ranking of ABA law schools. Report commissioned by the Association of American Law Schools (available on the web at http://www.aals.org/validity.html) .
38. S. Klein 2001 Rationale and plan for assessing higher education outcomes with direct constructed response measures of student skills Council for Aid to Education, Higher Education Policy Series New York, NY Number 3.
39. S. Klein 2002 Direct assessment of cumulative student learning Peer Review 4 26 28
40. Klein, S., Kuh, G., Chun, M., Hamilton, L., and Shavelson R. 2003. The search for Value-Added: Assessing and validating selected higher education outcomes. Paper presented at the meetings of the American Educational Research Association. Chicago, Illinois
41. Klein, S., Shavelson, R., Hamilton, L. and Chun M. 2004. Characteristics of hand and machine-assigned scores to college students' answers to open-ended tasks (unpublished report).
42. P.C. Kyllonen V.J. Shute 1989 A taxonomy of learning skills P.ΓÉúL. Ackerman R. J. Sternberg R. Glaser Learning and Individual Differences: Advances in Theory and Research Freeman New York 117 163
43. G. D. Kuh 2001 Assessing what really matters to student learning: inside the National Survey of Student Engagement Change 33 3 10 17 66
44. G. D. Kuh 2003 What we're learning about student engagement from NSSE Change 35 2 24 32
45. O. T. Lenning 1988 Use of noncognitive measures in assessment T. W. Banta Implementing Outcomes Assessment: Promise and Perils. New Directions for Institutional Research Jossey-Bass San Francisco 41 51 Vol. 59
46. A. Machung 1995 Changes in college rankings: How real are they? Paper presented at the 35th Annual AIR Forum Boston, MA
47. M. E. Martinez 2000 Education as the Cultivation of Intelligence Erlbaum Mahway, NJ
48. D. F. McCaffrey J. R. Lockwood D. M. Koretz L. S. Hamilton 2003 Evaluating Value-added Models for Teacher Accountability RAND Santa MonicaCA
49. M. D. McGuire 1995 Validity issues for reputational studies R. D. Walleri M. K. Moss Evaluating and Responding to College Guidebooks and Rankings. New Directions for Institutional Research Jossey-Bass San Francisco Vol. 88.
50. S. Messick 1984 The Psychology of Educational Measurement Journal of Educational Measurement 21 3 215 237
51. J. A. Muffo M. A. Bunda 1993 Attitude and Opinion Data T Banta Making a difference: Outcomes of a decade of assessment in higher education Jossey-Bass San Francisco 139 150
52. National Center for Higher Education Management Systems (NCEMS) 1994 A preliminary study of the feasibility and utility for national policy of instructional and good practice indicators in undergraduate education National Center for Higher Education Management Systems BoulderCO Contractor Report for the National Center for Education Statistics.
53. National Center for Higher Education Management Systems (NCEMS) 1996 The National Assessment of College Student Learning: An Inventory of State-level Assessment Activities National Center for Higher Education Management Systems BoulderCO
54. National Opinion Research Center. 1997. A review of the methodology for the U.S. News and World Report's rankings of undergraduate colleges and universities. Report by the National Opinion Research Center.
55. National Postsecondary Education Cooperative. 2000a The NPEC sourcebook on assessmentvolume 1: Definitions and assessment methods for critical thinking, problem solving, and writing. Center for Assessment and Research Studies, James Madison University, Harrisonburg, VAunder the sponsorship of the National Center for Education Statistics, U.S. Department of Education.
56. National Postsecondary Education Cooperative. 2000b. The NPEC sourcebook on assessmentvolume 2: Selected institutions utilizing assessment results. Center for Assessment and Research Studies, James Madison University, Harrisonburg, VA, under the sponsorship of the National Center for Education Statistics, U.S. Department of Education
57. B. A. Naughton A. Y. Suen R. J. Shavelson 2003 Accountability for what? Understanding the learning objectives in state higher education accountability programs Paper presented at the annual meetings of the American Educational Research Association Chicago
58. S. S. Obler J. Slark L. Umbdenstock 1993 Classroom assessment T. W. Banta Making a difference: Outcomes of a decade of assessment in higher education Jossey-Bass San Francisco 211 226
59. C. R. Pace 1990 The undergraduates; A report of their activities and progress in college in the 1980's Center for the Study of Evaluation, University of CaliforniaLos Angeles Los Angeles
60. C. A. Palomba T. W. Banta 1999 Assessment essentials: Planning, implementing, and improving assessment in higher education Jossey-Bass San Francisco
61. E. T. Pascarella P. T. Terenzini 1991 How college affects students: Findings and insights from twenty years of research Jossey-Bass San Francisco
62. E. T. Pascarella L. Bohr A. Nora P.T. Terenzini 1996 ΓÇ £Is differential exposure to college linked to the development of critical thinking?ΓÇ¥ Research in Higher Education 37 159 174
63. E. T. Pascarella 2001 Cognitive growth in college Change 33 21 27
64. J. W. Pellegrino N. Chudowsky R. Glaser 2001 Knowing What Students Know: The Science and Design of Educational Assessment National Academy Press Washington, DC
65. J. L. Ratcliff E. A. Jones D. S. Guthrie D. Oehler 1991 The effect of coursework patterns, advisementand course selection on the development of generalΓÉúlearned abilities of college graduates The Pennsylvania StateΓÉúUniversity, National Center on Postsecondary Teaching, Learning, and Assessment University Park
66. J. L. Ratcliff E. A. Jones 1997 Turning results into improvement strategies The Pennsylvania State University, National Center on Postsecondary Teaching, Learning, and Assessment University Park
67. Riggs, M. L., and Worthley, J. S. (1992). Baseline Characteristics of Successful Program of Student Outcomes AssessmentERIC document ED353285.
68. R.J. Shavelson R.W. Roeser H. Kupermintz S. Lau C. Ayala A. Haydel S. Schultz G. Quihuis L. Gallagher 2002 Richard E. Snow's remaking of the concept of aptitude and multidimensional test validity: introduction to the special issue Educational Assessment 8 2 77 100
69. R.J. Shavelson L. Huang 2003 Responding responsibly to the frenzy to assess learning in higher education Change 35 1 10 19
70. M. K. Smith J. L. Bradley G. F. Draper 1993 A National Survey on Assessment Practices University of TennesseeKnoxvilleClearinghouse for Higher Education Assessment Instruments KnoxvilleTN
71. R. E. Snow 1994 Abilities in Academic Tasks R. J. Sternberg R. K. Wagner Mind in Context: Interactionist Perspectives on Human Intelligence Cambridge University Press CambridgeEngland 337
72. R. E. Snow D. F. Lohman 1989 Implications of cognitive psychology for educational measurement R. Linn Educational Measurement 3rd ed. Macmillan New York 263 331
73. J. M. Steele D. A. Lutz 1995 Report of ACT's research on postsecondary assessment needs American College Testing Program Iowa City, IA
74. Suen H. K., Parkes J. 1996. Challenges and opportunities for student assessment in distance education. Distance Education Online Symposium. 6(7): [On-line serial]. Available: Internet: ACSDE@PSUVM.PSU.EDU
75. P. T. Terenzini T. Wright 1987 Influences on students' academic growth during four years of college Research in Higher Education 26 161 179
76. P. T. Terenzini 1989 Assessment with open eyes: pitfalls in studying student outcomes Journal of Higher Education 60 644 664
77. Vandament W. E. 1987. A state university perspective on student outcomes assessment In Halpern, D. F. Student outcomes assessment: what institutions stand to gain. New Directions for Higher Education 59: 25 - 28
78. C. J. Waluconis 1993 Student self-evaluation B. Trudy Making a difference: Outcomes of a decade of assessment in higher education Jossey-Bass San Francisco 244 255
79. D. G. Winter D. C. McClelland A. J. Stewart 1981 A new case for the liberal arts Jossey-Bass San Francisco