Measuring Learning Outcomes in Higher Education: Motivation Matters

Educational Researcher

Volumn 41, Issue 9, 2012, Pages 352-362

  Liu, Ou Lydia ^a   Bridgeman, Brent ^a   Adler, Rachel M ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

accountability; assessment; higher education; motivation; outcomes assessment; regression analyses

Indexed keywords

EID: 84870915520     PISSN: 0013189X     EISSN: 1935102X     Source Type: Journal    
DOI: 10.3102/0013189X12459679     Document Type: Article

References (41)

1. Arum R.,Cho E.,Kim J.,Roksa J.Documenting uncertain times: Post-graduate transitions of the academically adrift cohort. Brooklyn, NY: Social Science Research Council; 2012:.
2. Arum R.,Roksa J.Academically adrift: Limited learning on college campuses. Chicago, IL: University of Chicago Press; 2011:.
3. AstinA. W. (2011, February14). In "Academically Adrift," data don't back up sweeping claim. The Chronicle of Higher Education. Retrieved from http://chronicle.com/article/Academically-Adrift-a/126371.
4. Banta T.Trying to clothe the emperor. Assessment Update. 2008;20:3 16-4 17.
5. Barry C. L.,Horst S. J.,Finney S. J.,Brown A. R.,Kopp J.Do examinees have similar test-taking effort? A high-stakes question for low-stakes testing.International Journal of Testing. 2010;10 (4): 342-363.
6. Baumert J.,Demmrich A.Test motivation in the assessment of student skills: The effects of incentives on motivation and performance.European Journal of Psychology of Education. 2001;16:441-462.
7. Belcheir M. J.Academic profile results for selected nursing students. Boise, ID: Boise State University; 2002:.
8. Braun H.,Kirsch I.,Yamamoto K.An experimental study of the effects of monetary incentives on performance on the 12th grade NAEP reading assessment.Teachers College Record. 2011;113:2309-2344.
9. Cole J. S.,Osterlind S. J.Investigating differences between low- and high-stakes test performance on a general education exam.The Journal of General Education. 2008;57:119-130.
10. Duckworth A. L.,Quinn P. D.,Lynam D. R.,Loeber R.,Stouthamer-Loeber M.Role of test motivation in intelligence testing.Proceedings of the National Academy of Sciences. 2011;108:7716-7720.
11. Market research of institutions that use outcomes assessment. Princeton, NJ: Author; 2010:.
12. Haladyna T. M.,Downing S. M.Construct-irrelevant variance in high-stakes testing.Educational Measurement: Issues and Practice. 2004;23:17-27.
13. Hendel D. D.Evidence of convergent and discriminant validity in three measures of college outcomes.Educational and Psychological Measurement. 1991;51:351-358.
14. KleinS.LiuO. L.SconingJ.BolusR.BridgemanB.Kugelmass SteedleJ. (2009). Test validity study report. Retrieved from http://www.voluntarysystem.org/docs/reports/TVSReport_Final.pdf.
15. Kuh G. D.,Ikenberry S. O.More than you think, less than we need: Learning outcomes assessment in American higher education. Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment; 2009:.
16. Kuh G. D.,Kinzie J.,Buckley J. A.,Bridges B. K.,Hayek J. C.What matters to student success: A review of the literature. Washington, DC: National Postsecondary Education Cooperative; 2006:.
17. Lakin J.,Elliott D.,Liu O. L.Investigating the impact of ELL status on higher education outcomes assessment.Educational and Psychological Measurement. in press.
18. Liu O. L.Measuring learning outcomes in higher education using the Measure of Academic Proficiency and Progress (MAPP™). Princeton, NJ: Educational Testing Service; 2008:.
19. Liu O. L.An overview of outcomes assessment in higher education.Educational Measurement: Issues and Practice. 2011a;30:2-9.
20. Liu O. L.Value-added assessment in higher education: A comparison of two methods.Higher Education. 2011b;61:445-461.
21. Livingston S. A.,Antal J.A case of inconsistent equatings: How the man with four watches decides what time it is.Applied Measurement in Education. 2010;23 (1): 49-62.
22. Marr D.Validity of the academic profile. Princeton, NJ: Educational Testing Service; 1995:.
23. Messick S.Validity of psychological assessment: Validation of references from persons' responses and performances on scientific inquiry into score meaning.American Psychologist. 1995;50:741-749.
24. OchoaE. M. (2011, March). Higher education and accreditation: The view from the Obama administration. Career Education Review. Retrieved from http://www.careereducationreview.net/featured-articles/docs/2011/CareerEducationReview_Ochoa0311.pdf.
25. O'Neil H. F.,Abedi J.,Miyoshi J.,Mastergeorge A.Monetary incentives for low-stakes tests.Educational Assessment. 2005;10:185-208.
26. O'Neil H. F.,Sugrue B.,Baker E. L.Effects of motivational interventions on the National Assessment of Educational Progress mathematics performance.Educational Assessment. 1995/1996;3:135-157.
27. Pintrich P. R.,Schunk D. H.Motivation in education: Theory, research, and applications. 2002). Motivation in education: Theory, research, and applications (2nd ed.). Upper Saddle River, NJ: Prentice Hall.Upper Saddle River, NJ: Prentice Hall; 2002:.
28. Steedle J.Selecting value-added models for postsecondary institutional assessment.Assessment and Evaluation in Higher Education. 2011;:1-16.
29. Sundre D. L. Differential examinee motivation and validity: A dangerous combination. Paper presented at the annual meeting of the American Educational Research Association; 1997 Chicago, IL; 1997.
30. Sundre D. L. Does examinee motivation moderate the relationship between test consequences and test performance?. Paper presented at the annual meeting of the American Educational Research Association; 1999Montreal; 1999.
31. Sundre D. L.,Kitsantas A. L.An exploration of the psychology of the examinee: Can examinee self-regulation and test-taking motivation predict consequential and non-consequential test performance?.Contemporary Educational Psychology. 2004;29 (1): 6-26.
32. Sundre D. L.,Wise S. L. Motivation filtering: An exploration of the impact of low examinee motivation on the psychometric quality of tests Paper presented at the annual meeting of the National Council on Measurement in Education; 2003Chicago, IL; 2003.
33. A test of leadership: Charting the future of American higher education. Washington, DC: Author; 2006:.
34. Information on learning outcomes measures. Author; 2008:.
35. Wise S. L.,DeMars C. E.Low examinee effort in low-stakes assessment: Problems and potential solutions.Educational Assessment. 2005;10 (1): 1-17.
36. Wise S. L.,DeMars C. E.An application of item response time: The effort-moderated IRT model.Journal of Educational Measurement. 2006;43 (1): 19-38.
37. Wise S. L.,DeMars C. E.Examinee noneffort and the validity of program assessment results.Educational Assessment. 2010;15:27-41.
38. Wise S. L.,Kong X.Response time effort: A new measure of examinee motivation in computer-based tests.Applied Measurement in Education. 2005;18 (2): 163-183.
39. WiseV. L. (2004). The effects of the promise of test feedback on examinee performance and motivation under low-stakes testing conditions (Unpublished doctoral dissertation). University of Nebraska-Lincoln, Lincoln, NE.
40. Wise V. L.,Wise S. L.,Bhola D. S.The generalizability of motivation filtering in improving test score validity.Educational Assessment. 2006;11 (1): 65-83.
41. Wolf L. F.,Smith J. K.The consequence of consequence: Motivation, anxiety, and test performance.Applied Measurement in Education. 1995;8:227-242.