Development of a reliable, valid annual skills mastery assessment examination

American Journal of Pharmaceutical Education

Volumn 74, Issue 5, 2010, Pages 1-10

  Alston, Gregory L ^a   Love, Bryan L ^a  

^a WINGATE UNIVERSITY   (United States)

Author keywords

Ability based outcomes; Assessment; Examination; Progress examination; Skill mastery

Indexed keywords

ARTICLE; EDUCATION; HUMAN; METHODOLOGY; PROFESSIONAL COMPETENCE; REPRODUCIBILITY; VALIDATION STUDY;

EDUCATION, PHARMACY; EDUCATIONAL MEASUREMENT; HUMANS; PROFESSIONAL COMPETENCE; REPRODUCIBILITY OF RESULTS;

EID: 77954705601     PISSN: 00029459     EISSN: 15536467     Source Type: Journal    
DOI: 10.5688/aj740580     Document Type: Article

References (29)

1. Accreditation Council for Pharmacy Education. Accreditation Standards and Guidelines for the Professional Program in Pharmacy Leading to the Doctor of Pharmacy Degree. http://www.acpe-accredit.org/pdf/ACPE_Revised_PharmD_Standards_Adopted_J an152006.pdf. Accessed April 20, 2010.
2. Plaza CM. Progress examinations in pharmacy education. Am J Pharm Educ. 2007;71(4):Article 66.
3. Haladyna TM. Writing Test Items to Evaluate Higher Order Thinking. Needham Heights, MA: Allyn & Bacon, A Pearson Education Company; 1997.
4. American Educational Research Association. Position statement on high stakes testing in pre-K - 12 education. http://www.aera.net/?id5378. Accessed April 20, 2010.
5. Downing SM, Haladyna TM. Test item development: validity evidence from quality assurance procedures. Appl Meas Educ. 1997;10(1):61-82.
6. Supernaw R, Mehvar R. Method for the assessment of competence and the definition of deficiencies of students in all levels of the curriculum. Am J Pharm Educ. 2002;66(1):1-4.
7. Mehvar R, Supernaw R. Outcome assessment in a PharmD program: the Texas Tech experience. Am J Pharm Educ. 2002;66(3):243-253.
8. Case SM, Swanson DB. Constructing written test questions for the basic and clinical sciences. Natl Board Med Examiners http://www.nbme.org/publications/ Accessed April 20, 2010.
9. Haladyna T, Downing S, Rodriguez M. A review of multiplechoice item-writing guidelines for classroom assessment. Appl Meas Educ. 2002;15(3):309-334.
10. Kehoe J. Writing multiple-choice test items. ERIC Clearinghouse on Assessment and Evaluation, The Catholic University of America, Department of Education, O'Boyle Hall, Washington, DC http://www.eric.ed.gov/ED398236. Accessed April 20, 2010.
11. Kehoe J. Basic item analysis for multiple-choice tests. ERIC Clearinghouse on Assessment and Evaluation, The Catholic University of America, Department of Education, O'Boyle Hall, Washington, DC http://www.eric.ed.gov/ED398237. Accessed April 20, 2010.
12. Green K, Sax G. Test reliability by ability level of examinees. Annual Conference of the National Council on Measurement in Education. April 11-17, 1981; Los Angeles, CA.
13. Taylor AK. Violating conventional wisdom in multiple choice test construction. Coll Stud J. 2005;39(1):141-148.
14. Bond LA. Norm- and criterion-referenced testing. ERIC Clearinghouse on Assessment and Evaluation, 210 O'Boyle Hall, The Catholic University of America, Washington, DC. http://www.eric.ed.gov. Accessed April 20, 2010.
15. Bloom BS, Engelhart MD, Furst EJ, Hill WH, Krathwohl DR. Taxonomy of Educational Objectives, Handbook 1: The Cognitive Domain. New York, NY: Longman; 1956.
16. Impara JCP, Barbara S. A comparison of cut scores using multiple standard setting methods. Annual Meeting of the American Educational Research Association. April 24-28, 2000. New Orleans, LA.
17. Feldt LS. The relationship between the distribution of item difficulties and test reliability. Appl Meas Educ. 1993;6(1): 37-48.
18. National Association of Boards of Pharmacy on February 24, 2009. Statistical Analysis of Naplex Passing Rates for First-Time Candidates Per Pharmacy School from 2004 to 2008. National Association of Boards of Pharmacy. http://www.nabp.net/. Accessed April 20, 2010.
19. Rudner LM, Schafer, William D. Reliability. ERIC Clearinghouse on Assessment and Evaluation. http://www.eric.ed.gov/ED458213. Accessed April 20, 2010.
20. Gardner E. Five Common Misuses of Tests. ERIC Clearinghouse on Assessment and Evaluation. http://www.eric.ed.gov/ED315429. Accessed April 20, 2010.
21. Haladyna T. Roles and importance of validity studies in test development. In: Downing S, Haladyna T, eds. Handbook of Test Development. Mahwah, NJ: Lawrence Erlbaum Associates; 2006: 739-755.
22. Kane MT. Content-related validity evidence in test development. In: Downing S, Haladyna T, eds. Handbook of Test Development. Mahwah, NJ: Lawrence Erlbaum Associates; 2006: 131-150.
23. Brualdi A. Traditional and Modern Concepts of Validity. ERIC Clearinghouse on Assessment and Evaluation, 1129 Shriver, University of Maryland, College Park, MD. http://www.eric.ed.gov/ED435714. Accessed April 20, 2010.
24. Szilagyi JE. Curricular progress assessments: the Milemarker. Am J Pharm Educ. 2008;72(5):101.
25. Banta TW, Schneider JA. Using locally developed comprehensive examinations for majors to assess and improve academic program quality. Paper presented at the 70th Annual Meeting of the American Educational Research Association. April 16-20, 1986; San Francisco, CA.
26. Newble DI. The effect of assessments and examinations on the learning of medical students. Med Educ. 1983;17(3):165-171.
27. Abate MA, Stamatakis MK, Haggett RR. Excellence in curriculum development and assessment. Am J Pharm Educ. 2003;67(3):Article 89.
28. Roediger HL III, Marsh EJ. The positive and negative consequences of multiple-choice testing. J Exp Psychol. 2005;31(5):1155-1159.
29. Banta TW. Moving assessment forward: enabling conditions and stumbling blocks. New Dir High Educ. 1997;25(4):79.