Objective curricular evaluation: Applying the Rasch model to a cumulative examination

American Journal of Pharmaceutical Education

Volumn 68, Issue 2, 2004, Pages 1-12

  Draugalis, JoLaine Reierson ^a   Jackson, Terrence R ^b  

^a UNIVERSITY OF ARIZONA   (United States)

^b UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

Author keywords

Curriculum; Examination; Rasch model; Student evaluation

Indexed keywords

ARTICLE; CALIBRATION; CURRICULUM; PHARMACY; SCALE UP; STUDENT; TASK PERFORMANCE; VOLUNTEER;

EID: 14644420943     PISSN: 00029459     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (33)

1. Downing SM. Assessment of knowledge with written test forms. In: Geoff RN, Van der Vleuten CPM, Newble DI, eds. International Handbook of Research in Medical Education. Vol 2, Dordrecht, The Netherlands: Kluwer Academic Publishers; 2002:647-72.
2. Jackson T, Draugalis J, Smith E, Zachry W, III, Slack M. Hierarchical structure evaluation of Bloom's Taxonomy and Marzano's New Taxonomy using Rasch analysis. Am J Pharm Educ. 2002;66:108S.
3. United States Medical Licensing Examination. 2003 USMLE Bulletin of Information. United States Medical Licensing Examination. Available at: http://www.usmle.org/bulletin/2003/Overview.htm. Accessed July 27, 2003.
4. Ryan GJ, Nykamp D. Use of cumulative exams at US schools of pharmacy. Am J Pharm Educ. 2000;64:409-412.
5. Griffith PL, Rose J, Ryan JM. Student-curriculum maps: Applying the Rasch model to curriculum and instruction. J Res Educ. 1992;2:13-22.
6. Masters GN, Adams R, Lokan J. Mapping student achievement. Int J Educ Res. 1990;21:595-610.
7. Downing SM. Test item development: Validity evidence from quality assurance procedures. Appl Meas Educ. 1997;10:61-82.
8. Messick S. Validity. In: Linn RL, ed. Educational Measurement. New York, NY: American Council on Education and Macmillan; 1989:13-104.
9. American Educational Research Association. American Psychological Association, National Council on Measurement in Education. Validity. Standards for Educational and Psychological Testing. Washington DC: American Educational Research Association; 1999:9-24.
10. Pray WS, Popovich NG. The development of a standardized competency examination for doctor of pharmacy student. Am J Pharm Educ. 1985;49:1-9.
11. Smythe MA, Slaughter RL, Sudekum MJ. Development of a comprehensive examination for baccalaureate pharmacy students prior to experiential teaching. J Pharm Teach. 1992;3:53-62.
12. Downing SM. Threats to the validity of locally developed multiple-choice tests in medical education: Construct-irrelevant variance and construct underrepresentation. Adv Health Sci Educ. 2002;7:235-241.
13. Smith EV, Jr. Evidence for the reliability of measures and validity of measure interpretation: A Rasch measurement perspective. J Appl Meas. 2001;2:281-311.
14. Jackson TR, Draugalis JR, Slack MK, Zachry WM, III, D'Agostino J. Validation of authentic performance assessment: A process suited for Rasch modeling. Am J Pharm Educ. 2002;66:233-242.
15. Draugalis JR, Slack MK, Sauer KA, Haber SL, Vaillancourt RR. Creation and implementation of a learning outcomes document for a Doctor of Pharmacy curriculum. Am J Pharm Educ. 2002;66:253-260.
16. American Council on Pharmaceutical Education. Accreditation Standards and Guidelines for the Professional Program in Pharmacy Leading to the Doctor of Pharmacy Degree. Chicago, Ill: The American Council on Pharmaceutical Education Inc; 1997.
17. American Association of Colleges of Pharmacy. Educational Outcomes. Alexandria, VA: Center for the Advancement of Pharmaceutical Education Advisory Panel on Educational Outcomes, AACP; 1998.
18. Marzano RJ. Designing a New Taxonomy of Educational Objectives. Thousand Oaks, Calif: Corwin Press, Inc; 2001.
19. Jackson TR, Draugalis JR, Smith EV, Zachry WM, III, Slack MK. Hierarchical Structure Evaluation of Bloom's Taxonomy and Marzano's New Taxonomy Using Rasch Analysis. Am J Pharm Educ. 2002;66:108S.
20. Haladyna TM, Downing SM, Rodriguez MC. A review of multiple-choice item-writing guidelines for classroom assessment. Appl Meas Educ. 2002;15:309-334.
21. Rasch G. Probabilistic Models for Some Intelligence and Attainment Tests. Copenhagen: Danish Institute for Educational Research. Reprinted, University of Chicago Press; 1980.
22. Wright BD, Stone MH. The Measurement Model. Best Test Design: Rasch Measurement. Chicago Ill: Mesa Press; 1979:1-24.
23. Wolfe EW, Chiu CWT. Measuring pretest-posttest change with a Rasch rating scale model. J Outcome Meas. 1999;3:134-161.
24. Winsteps [computer program]. Version 3.45. Chicago, Ill: Mesa Press; 2003.
25. Wiggins G. Creating tests worth taking. Educ Leadersh. 1992;49:26-32.
26. Wright BD, Stone MH. Designing Tests. Best Test Design: Rasch Measurement. Chicago, Ill: Mesa Press; 1979:129-40.
27. Millman J, Greene J. The Specification and Development of Tests of Achievement and Ability. In: Linn RL, ed. Educational Measurement. 3rd edition. Phoenix, Az: The Oryx Press; 1993:335-66.
28. Linacre JM. Sample size and item calibration stability. Rasch Measurement Transactions. 1994;7:328.
29. United States Medical Licensing Examination. USMLE Clinical Skills Examination: a Fact Sheet. United States Medical Licensing Examination. May 31, 2002. Available at: http://www.usmle.org/ news/newscse.htm. Accessed September 24, 2002.
30. Institute of Medicine (US) Committee on Quality Health Care in America. Setting performance standards and expectations for patient safety. In: Kohn LT, Corrigan JM, Donaldson MS, eds. To Err is Human: Building a Safer Health System. Washington, DC: National Academy Press; 2000:132-54.
31. Angoff WH, ed. Scales, norms, and equivalent scores. Washington DC: American Council on Education; 1971. Thorndike RL, ed. Educational Measurement.
32. Norcini JJ, Lipner RS, Langdon LO, Strecker CA. A comparison of three variations on a standard-setting method. J Educ Meas. 1987;24:56-64.
33. Institute for Objective Measurement Inc. Available at: http:// www.rasch.org. Accessed September 24, 2002.