Guide to developing high-quality, reliable, and valid multiple-choice assessments

Journal of Chemical Education

Volumn 91, Issue 9, 2014, Pages 1426-1431

  Towns, Marcy H ^a  

^a PURDUE UNIVERSITY   (United States)

Author keywords

Curriculum; First Year Undergraduate General; Second Year Undergraduate; Student Centered Learning; Testing Assessment; Upper Division Undergraduate

Indexed keywords

EID: 84916639854     PISSN: 00219584     EISSN: 19381328     Source Type: Journal    
DOI: 10.1021/ed500076x     Document Type: Article

References (25)

1. Pienta, N. Striking a Balance with Assessment J. Chem. Educ. 2011, 88, 1199-1200
2. Bretz, S. L. Navigating the Landscape of Assessment J. Chem. Educ. 2012, 89, 689-691
3. Raker, J. R.; Emenike, M. E.; Holme, T. A. Using Structural Equation Modeling to Understand Chemistry Faculty Familiarity of Assessment Terminology: Results from a National Survey J. Chem. Educ. 2013, 90, 981-987
4. Bloom, B. S.; Krathwohl, D. R. The classification of educational goals, by a committee of college and university examiners. Taxonomy of educational objectives. Handbook 1: Cognitive domain. Longman: New York, 1956.
5. Anderson, L. W.; Krathwohl, D. R., Eds.; A taxonomy for learning, teaching and assessing: A revision of Bloom's taxonomy of educational objectives, complete edition; Longman: New York, 2001.
6. A Model of Learning Objectives, Iowa State Center for Excellence in Learning and Teaching, http://www.celt.iastate.edu/teaching/RevisedBlooms1.html?utm-source=rss&utm-medium=rss&utm-campaign=a-model-of-learning-objectives (accessed July 2014).
7. Cooper, M. M.; Klymkowsky, M.; Bryfczynski, S.; Hester, J. beSocratic, http://besocratic.chemistry.msu.edu (accessed July 2014).
8. Scalise, K. Computer-Based Assessment: Intermediate Constraint" Questions and Tasks for Technology Platforms, http://pages.uoregon.edu/kscalise/taxonomy/taxonomy.html (accessed July 2014).
9. Haladyna, T. M.; Downing, S. M. A taxonomy of multiple-choice item-writing rules.A Taxonomy of Multiple-Choice Item-Writing Rules Appl. Meas. Educ. 1989a, 2 (1) 37-50
10. Haladyna, T. M.; Downing, S. M. Validity of a Taxonomy of Multiple-Choice Item-Writing Rules Appl. Meas. Educ. 1989b, 2 (1) 51-78
11. Haladyna, T. M.; Downing, S. M.; Rodriguez, M. C. A Review of Multiple-Choice Item-Writing Guidelines for classroom Assessment Appl. Meas. Educ. 2002, 15 (3) 309-334
12. Case, S. M.; Swanson, D. B. Constructing Written Test Questions For the Basic and Clinical Sciences, 3 rd ed., 2002, National Board of Medical Examiners, Philadelphia, PA, http://www.nbme.org/publications/item-writing-manual.html (accessed Jul 2014).
13. Cooper, M. M.; Grove, N.; Underwood, S. M.; Klymkowsky, M. W. Lost in Lewis Structures: An Investigation of Student Difficulties in Developing Representational Competence J. Chem. Educ. 2010, 87 (8) 869-874
14. Cooper, M. M.; Underwood, S. M.; Hilley, C. Z.; Klymkowsky, M. W. Development and Assessment of a Molecular Structure and Properties Learning Progression J. Chem. Educ. 2012, 89, 1351-1357
15. Rodriguez, M. C. Three options are optimal for multiple-choice items: A meta-analysis of 80 years of research Educ. Meas. Issues Pract. 2005, 24 (2) 3-13
16. Tarrant, M.; Ware, J.; Mohammed, A. M. An Assessment of Functioning and Non-Functioning Distractors in Multiple-Choice Questions: A Descriptive Analysis. BMC Med. Educ. 2009, 9 (40), 10.1186/1472-6920-9-40.
17. Attali, Y.; Bar-Hillel, M. Guess Where: The Position of Correct Answers in Multiple-Choice Test Items as a Psychometric Variable J. Educ. Meas. 2003, 40 (2) 109-128
18. Bar-Hillel, M.; Attali, Y. Seek Whence: Answer Sequences and Their Consequences in Key Balanced Multiple-Choice Texts Am. Stat. 2002, 56, 299-303
19. Bar-Hillel, M.; Budescu, D.; Attali, Y. Scoring and Keying Multiple Choice Tests: A Case Study in Irrantionality Mind Soc. 2005, 4, 3-12
20. Schroeder, J.; Murphy, K.; Holme, T. A. Investigating Factors That Influence Item Performance on ACS Exams J. Chem. Educ. 2012, 89, 346-350
21. Pentecost, T.; Barbera, J. Measuring Learning Gains in Chemical Education: A Comparison of Two Methods J. Chem. Educ. 2013, 90, 839-845
22. Kelley, T. L. The selection of upper and lower groups for the validation of test items J. Educ. Psychol. 1939, 30, 17-24
23. Cooper, M. M. Science 2007, 317, 1171 10.1126/science.317.5842.1171
24. Towns, M. H. Developing Learning Objectives and Assessment Plans at a Variety of Institutions: Examples and Case Studies J. Chem. Educ. 2010, 87 (1) 91-96
25. Emenike, M. E.; Schroeder, J.; Murphy, K.; Holme, T. A. Results from a National Needs Assessment Survey: A View of Assessment Efforts within Chemistry Departments J. Chem. Educ. 2013, 90, 561-567