Twelve tips for assessing medical knowledge with open-ended questions: Designing constructed response examinations in medical education

Medical Teacher

Volumn 42, Issue 8, 2020, Pages 880-885

  Hauer, Karen E ^a   Boscardin, Christy ^a   Brenner, Judith M ^b   van Schaik, Sandrijn M ^a   Papp, Klara K ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b DONALD AND BARBARA ZUCKER SCHOOL OF MEDICINE AT HOFSTRA NORTHWELL   (United States)

^c CASE WESTERN RESERVE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; HUMAN; HUMAN EXPERIMENT; LEARNING; MEDICAL EDUCATION; MEDICAL STUDENT; CURRICULUM; EDUCATION; PROBLEM BASED LEARNING; UNIVERSITY;

CURRICULUM; EDUCATION, MEDICAL; EDUCATION, MEDICAL, UNDERGRADUATE; EDUCATIONAL MEASUREMENT; FACULTY; HUMANS; PROBLEM-BASED LEARNING; STUDENTS, MEDICAL;

EID: 85068727506     PISSN: 0142159X     EISSN: 1466187X     Source Type: Journal    
DOI: 10.1080/0142159X.2019.1629404     Document Type: Article

References (22)

1. Beattie V, Collins B, McInnes B. 1997. Deep and surface learning: a simple or simplistic dichotomy? Accoun Educ. 6:1–12.
2. Biggs J. 2003. Aligning teaching and assessing to course objectives. Teach Learn Higher Educ. 1–9.
3. Black P, Wiliam D. 2009. Developing the theory of formative assessment. Educ Asse Eval Acc. 21:5.
4. Boscardin C, Hauer K, Kruidering M, van Schaik S, Fulton T. 2017. Bringing your exam questions to bloom: writing effective open-ended questions to test higher-level thinking. iCollaborative [Internet]. [cited 2018 Nov 21]. https://icollaborative.aamc.org/resource/4430/.
5. Brenner JM, Bird JB, Willey JM. 2017. Formative assessment in an integrated curriculum: identifying at-risk students for poor performance on USMLE step 1 using NBME custom exam questions. Acad Med. 92:S21–S25.
6. Case SM, Swanson DB. 2001. Constructing written test questions for the basic and clinical sciences [Internet]. [cited 2018 Nov 8]. https://www.researchgate.net/publication/242759434_Constructing_Written_Test_Questions_For_the_Basic_and_Clinical_Sciences.
7. Dunlosky J, Rawson KA, Marsh EJ, Nathan MJ, Willingham DT. 2013. Improving students’ learning with effective learning techniques: promising directions from cognitive and educational psychology. Psychol Sci Public Interest. 14:4–58.
8. Ebel RL, Frisbie DA. 1991. Essentials of educational measurement. Englewood Cliffs (NJ): Prentice Hall.
9. Hamdy H. 2006. Blueprinting for the assessment of health care professionals. Clin Teach. 3:175–179.
10. Hays R. 2013. Blueprinting. Clin Teach. 10:413–416.
11. Hift RJ. 2014. Should essays and other “open-ended”-type questions retain a place in written summative assessment in clinical medicine? BMC Med Educ. 14:249. [Internet]. [cited 2018 Nov 8]; http://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-014-0249-2.
12. Item Writing Manual | Publications | NBME. 2016 [cited 2019 Apr 15]. https://www.nbme.org/publications/item-writing-manual.html.
13. Jonsson A, Svingby G. 2007. The use of scoring rubrics: reliability, validity and educational consequences. Educ Res Rev. 2:130–144.
14. Krathwohl DR. 2002. A revision of bloom’s taxonomy: an overview. Theory Pract. 41:212–218.
15. Kulasegaram K, Mylopoulos M, Tonin P, Bernstein S, Bryden P, Law M, Lazor J, Pittini R, Sockalingam S, Tait GR, et al. 2018. The alignment imperative in curriculum renewal. Med Teach. 40:443–448.
16. Livingston SA. 2009. Constructed-response test questions: why we use them; how we score them. R&D connections. Number 11 [Internet]. [place unknown]: educational testing service; [cited 2018 Nov 8]. https://eric.ed.gov/?id=ED507802.
17. Norcini J, Anderson MB, Bollela V, Burch V, Costa MJ, Duvivier R, Hays R, Mackay MFP, Roberts T, Swanson D. 2018. 2018 consensus framework for good assessment. Med Teach. 40:1102–1109.
18. Roediger HL, Butler AC. 2011. The critical role of retrieval practice in long-term retention. Trends Cogn Sci. 15:20–27.
19. Schumacher DJ, Englander R, Carraccio C. 2013. Developing the master learner: applying learning theory to the learner, the teacher, and the learning environment. Acad Med. 88:1635–1645.
20. Schuwirth LW, van der Vleuten CP, Donkers HH. 1996. A closer look at cueing effects in multiple-choice questions. Med Educ. 30:44–49.
21. Shepard LA. 2000. The role of assessment in a learning culture. Educ Res. 29:4–14.
22. Taylor DCM, Hamdy H. 2013. Adult learning theories: implications for learning and teaching in medical education: AMEE Guide No. 83. Med Teach. 35:e1561–1572.