Faculty development on item writing substantially improves item quality

Advances in Health Sciences Education

Volumn 17, Issue 3, 2012, Pages 369-376

  Naeem, Naghma ^a,b   van der Vleuten, Cees ^a   Alfaris, Eiad Abdelmohsen ^a  

^a KING SAUD UNIVERSITY   (Saudi Arabia)

^b AGA KHAN UNIVERSITY   (Pakistan)

Author keywords

Assessment; Evaluation; Faculty development; Quality; Test items

Indexed keywords

ARTICLE; CHECKLIST; EDUCATION; HUMAN; MEDICAL EDUCATION; MEDICAL SCHOOL; PAKISTAN; PERSONNEL MANAGEMENT; STANDARD; WRITING;

CHECKLIST; EDUCATION, MEDICAL, UNDERGRADUATE; EDUCATIONAL MEASUREMENT; FACULTY, MEDICAL; HUMANS; PAKISTAN; STAFF DEVELOPMENT; WRITING;

EID: 84862697360     PISSN: 13824996     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10459-011-9315-2     Document Type: Article

References (23)

1. Abate, M. A., Stamatakis, M. K., & Haggett, R. R. (2003). Excellence in curriculum development and assessment. American Journal of Pharmaceutical Education, 67(3) Article 89. http://www. xula. edu/cop/documents/Assessment-Curriculum/Excellence%20in%20Curriculum%20Development%20and%20Assessment. pdf. Accessed on June 12, 2011.
2. Case, S., & Swanson, D. (2001). Constructing written test questions for the basic and clinical sciences (pp. 19-29). Philadelphia: National Board of Medical Examiners.
3. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Earlbaum Associates.
4. Darling-Hammond, L. (1997). School reform at the crossroads: Confronting the central issues of teaching. Educational Policy, 11(2), 151-166.
5. Darling-Hammond, L. (1999). Teacher quality and student achievement: A review of state policy evidence. Seattle, WA: University of Washington, Center of Teaching and Policy.
6. Downing, S., & Haladyna, T. (1997). Test item development: validity evidence from quality assurance procedures. Applied Measurement Education, 10(1), 61-82.
7. Downing, S., & Haladyna, T. (2006). Handbook of test development. Hillsdale, NJ: Lawrence Erlbaum Associates.
8. Fitzgerald, C. (2005). Risk management: Calculating the bottom line of developing a certification or licensure exam. From http://www. caveon. com/articles/fitzgerald3. htm. Accessed on 13 June 2010.
9. Frary, R. B. (1995). More multiple-choice item writing do's and don'ts. Practical Assessment, Research and Evaluation, 4(11). From http://pareonline. net/getvn. asp?v=4&n=11. Accessed June 13, 2011.
10. Frey, B., Petersen, S., Edwards, L., et al. (2005). Item-writing rules: Collective wisdom. Teaching and Teacher Education, 21, 357-364.
11. Fullan, M., & Stiegelbauer, S. (1991). The new meaning of educational change (2nd ed.). New York: Teachers College Press.
12. Haladyna, T. (1995). Developing and validating multiple-choice test items. Applied Psychological Measurement, 19, 205-207.
13. Hill, H. C. (2007). Learning in the teaching workforce. The Future of Children, 17(1), 111-128.
14. Jozefowicz, R. F., Koeppen, B. M., Case, S., Galbraith, R., Swanson, D., & Glew, R. (2002). The quality of in-house medical school examinations. Academic Medicine, 77(2), 156-161.
15. Kim, J., Chi, Y., Huensch, A., Jun, H., Li, H., & Roullion, V. (2010). A case study on an item writing process: Use of test specifications, nature of group dynamics, and individual item writers' characteristics. Language Assessment Quarterly, 7(2), 160-174.
16. Mayenga, C. (2009). Mapping item writing tasks on the item writing ability scale. From http://www. ocs. sfu. ca/fedcan/index. php/csse2009/csse2009/paper/viewFile/1966/625. Accessed on June 13, 2010.
17. Norman, G. R. (2003). RCT = results confounded and trivial: The perils of grand educational experiments. Medical Education, 37, 582-584.
18. Rodriguez, M. C. (1997). The art and science of item-writing: A meta-analysis of multiple-choice item format effects. From http://www. edmeasurement. net/aera/papers/artandscience. pdf. Accessed on June 13, 2010.
19. Schmeiser, C. B., & Welch, C. J. (2006). Test development. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 307-353). Washington, DC: The National Council on Measurement in Education and The American Council on Education.
20. Steinart, Y., Mann, K., Centeno, A., Dolmans, D., Spencer, J., Gelula, M., et al. (2006). A systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education: BEME guide no. 8. Medical Teacher, 28(6), 497-526.
21. Tunk, J. (2001). The effect of training on test item writing on test performance of junior high students. Educational Studies, 27, 129-142.
22. Wallach, P. M., Crespo, L. M., Holtzman, K. Z., Galbraith, R. M., & Swanson, D. B. (2010). Use of a committee review process to improve the quality of course. Examinations. Advances in Health Sciences Education, 11(1), 61-68.
23. Ward, A., & Murray-Ward, M. (1994). Guidelines for the development of item banks. Educational measurement: Issues and practice, 13, 34-39.