Contemporary test validity in theory and practice: A primer for discipline-based education researchers

CBE Life Sciences Education

Volumn 15, Issue 1, 2016, Pages

  Reeves, Todd D ^a   Marbach Ad, Gili ^b  

^a NORTHERN ILLINOIS UNIVERSITY   (United States)

^b University of Maryland   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BIOLOGY; CHEMISTRY; EDUCATION; HUMAN; LEARNING; PERSONNEL; PHYSICS; PROCEDURES; PSYCHOLOGY; REPRODUCIBILITY; SCIENCE; STUDENT; TEACHING; UNIVERSITY;

BIOLOGY; CHEMISTRY; EDUCATION; EDUCATIONAL MEASUREMENT; FACULTY; HUMANS; LEARNING; PHYSICS; PSYCHOLOGY; REPRODUCIBILITY OF RESULTS; RESEARCH PERSONNEL; SCIENCE; STUDENTS; TEACHING;

EID: 84971002555     PISSN: None     EISSN: 19317913     Source Type: Journal    
DOI: 10.1187/cbe.15-08-0183     Document Type: Article

References (45)

1. American Association for the Advancement of Science (2011). Vision and Change in Undergraduate Biology Education: A Call to Action, Washington, DC.
2. American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (2014). Standards for Educational and Psychological Testing, Washington, DC.
3. Anderson DL, Fisher KM, Norman GJ (2002). Development and evaluation of the conceptual inventory of natural science. J Res Sci Teach 39, 952-978.
4. Andrich DA (1978). A rating formulation for ordered response categories. Psychometrika 43, 561-573.
5. Angoff WH (1988). Validity: an evolving concept. In: Test Validity, ed. H Wainer and H Braun, Hillsdale, NJ: Erlbaum, 19-32.
6. Auchincloss LC, Laursen SL, Branchaw JL, Eagan K, Graham M, Hanauer DI, Lawrie G, McLinn CM, Palaez N, Rowland S, et al. (2014). Assessment of course-based undergraduate research experiences: a meeting report. CBE Life Sci Educ 13, 29-40.
7. Berliner D (2011). Rational responses to high stakes testing: the case of curriculum narrowing and the harm that follows. Cambridge J Educ 41, 287-302.
8. Bollen KA (2002). Latent variables in psychology and the social sci- ences. Annu Rev Psychol 53, 605-634.
9. Boyer Commission on Educating Undergraduates in the Research University (1998). Reinventing Undergraduate Education: A Blueprint for America’s Research Universities, Stony Brook: State University of New York.
10. Brownell SE, Tanner KD (2012). Barriers to faculty pedagogical change: lack of training, time, incentives, and tensions with professional identity. CBE Life Sci Educ 11, 339-346.
11. Campbell CE, Nehm RH (2013). A critical analysis of assessment quality in genomics and bioinformatics education research. CBE Life Sci Educ 12, 530-541.
12. DeChenne SE, Enochs LG, Needham M (2012). Science, technology, engineering, and mathematics graduate teaching assistants teaching self-efficacy. J Scholarship Teach Learn 12, 102-123.
13. Denofrio LA, Russell B, Lopatto D, Lu Y (2007). Linking student interests to science curricula. Science 318, 1872-1873.
14. Embretson SE, Reise SP (2013). Item Response Theory, Mahwah, NJ: Lawrence Erlbaum Associates.
15. Fives H, DiDonato-Barnes N (2013). Classroom test construction: the power of a table of specifications. Pract Assess Res Eval 18, 2-7.
16. Freeman S, Eddy SL, McDonough M, Smith MK, Wenderoth MP, Okoroafor N, Jordt H (2014). Active learning increases student performance in science, engineering, and mathematics. Proc Natl Acad Sci USA 111, 8410-8415.
17. Greene RL (2000). The MMPI-2: An Interpretive Manual, Boston, MA: Allyn & Bacon.
18. Harman HH (1960). Modern Factor Analysis, Oxford, UK: Universi- ty of Chicago Press.
19. Hattie J, Cooksey RW (1984). Procedures for assessing the validities of tests using the “known-groups” method. Appl Psychol Meas 8, 295-305.
20. Kane MT (1992). An argument-based approach to validity. Psychol Bull 112, 527-535.
21. Linn RL (1991). Complex, performance-based assessment: expectations and validation criteria. Educ Researcher 20, 15-21.
22. Lissitz RW, Samuelsen K (2007). A suggested change in terminology and emphasis regarding validity and education. Educ Researcher 36, 437-448.
23. Marbach-Ad G, Briken V, El-Sayed NM, Frauwirth K, Fredericksen B, Hutcheson S, Gao LY, Joseph S, Lee VT, McIver KS, et al. (2009). Assessing student understanding of host patho- gen interactions using a concept inventory. J Microbiol Biol Educ 10, 43-50.
24. Marbach-Ad G, McAdams K, Benson S, Briken V, Cathcart L, Chase M, El-Sayed N, Frauwirth K, Fredericksen B, Joseph S, et al. (2010). A model for using a concept inventory as a tool for students’ assessment and faculty professional development. CBE Life Sci Educ 9, 408-436.
25. Mayr E (1982). The Growth of Biological Thought: Diversity, Evolution and Inheritance, Cambridge, MA: Harvard University Press.
26. Messick S (1994). The interplay of evidence and consequences in the validation of performance assessments. Educ Researcher 23, 13-23.
27. Messick S (1995). Standards of validity and the validity of standards in performance assessment. Educ Meas 14, 5-8.
28. Mislevy RJ, Steinberg LS, Almond RG (2003). On the structure of educational assessments. Measurement 1, 3-62.
29. National Research Council (2003). BIO2010: Transforming Under- graduate Education for Future Research Biologists, Washington, DC: National Academies Press.
30. Nehm RH, Schonfeld IS (2008). Measuring knowledge of natural selection: a comparison of the CINS, an open-response instrument, and an oral interview. J Res Sci Teach 45, 1131-1160.
31. Opfer JE, Nehm RH, Ha M (2012). Cognitive foundations for science assessment design: knowing what students know about evolution. J Res Sci Teach 49, 744-777.
32. Prieto LR, Altmaier EM (1994). The relationship of prior training and previous teaching experience to self-efficacy among graduate teaching assistants. Res High Educ 35, 481-497.
33. Prieto LR, Meyers SA (1999). Effects of training and supervision on the self-efficacy of psychology graduate teaching assistants. Teach Psychol 26, 264-266.
34. Rasch G (1960). Probabalistic Models for Some Intelligence and Achievement Tests, Copenhagen: Danish Institute for Educational Research.
35. Rupp AA, Templin JL (2008). Unique characteristics of diagnostic classification models: a comprehensive review of the current state- of-the-art. Measurement 6, 219-262.
36. Schussler EE, Reed Q, Marbach-Ad G, Miller K, Ferzli M (2015). Preparing biology graduate teaching assistants for their roles as instructors: an assessment of institutional approaches. CBE Life Sci Educ 14, ar31.
37. Singer SR, Nielsen NR, Schweingruber HA (2012). Discipline-based Education Research: Understanding and Improving Learning in Undergraduate Science and Engineering, Washington, DC: National Academies Press.
38. Sirum K, Humburg J (2011). The Experimental Design Ability Test (EDAT). Bioscene 37, 8-16.
39. Smith MK, Jones FHM, Gilbert SL, Wieman CE (2013). The Class- room Observation Protocol for Undergraduate STEM (COPUS): A new instrument to characterize university STEM classroom practices. CBE Life Sci Educ 12, 618-627.
40. Smith MK, Wood WB, Knight JK (2008). The Genetics Concept Assessment: a new concept inventory for gauging student understanding of genetics. CBE Life Sci Educ 7, 422-430.
41. Webb N (2006). Identifying content for student achievement tests. In: Handbook of Test Development, ed. SM Downing and TM Haladyna, Mahwah, NJ: Erlbaum, 155-180.
42. Wiggins GP, McTighe J (2005). Understanding by Design, Alexandria, VA: Association for Supervision and Curriculum Development.
43. Willis GB (1999). Cognitive Interviewing: A “How To” Guide, Research Triangle Park, NC: Research Triangle Institute.
44. Wright BD, Masters GN (1982). Rating Scale Analysis, Chicago, IL: MESA.
45. Zucker S, Sassman S, Case BJ (2004). Cognitive Labs. http://images.pearsonassessments.com/images/tmrs/tmrs_rg/CognitiveLabs.pdf (accessed 29 August 2015).