Assessing the cultural validity of assessment practices: An introduction

Cultural Validity in Assessment: Addressing Linguistic and Cultural Diversity

Volumn , Issue , 2011, Pages 3-21

  Solano Flores, Guillermo ^a  

^a UNIVERSITY OF COLORADO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84862262439     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (55)

1. Abedi, J., Hofstetter, C.H., & Lord, C. (2004). Assessment accommodations for English language learners: Implications for policy-based empirical research. Review of Educational Research, 74(1), 1-28.
2. Abedi, J., Lord, C., Hofstetter, C., & Baker, E. (2001). Impact of accommodation strategies on English language learners' test performance. Educational Measurement: Issues and Practice, 19(3), 16-26.
3. AERA, NCME, & APA (1999). Standards for Educational and Psychological Testing. Washington, DC: Author.
4. Baxter, G.P., Elder, A.D., & Glaser, R. (1996). Knowledge-based cognition and performance assessment in the science classroom. Educational Psychologist, 31(2), 133-140.
5. Brennan, R.L. (1992). Elements of generalizability theory. Iowa City, IA: The American College Testing Program.
6. Brenner, M.E. (1998). Meaning and money. Educational Studies in Mathematics, 36, 123-155.
7. Cole, M. (1999). Culture-free versus culture-based measures of cognition. In R.J. Sternberg (Ed.), The nature of cognition (pp. 645-664). Cambridge, MA: MIT Press.
8. Cronbach, L.J., Gleser, G.C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements. New York, NY: Wiley.
9. Crystal, D. (1997). A dictionary of linguistics and phonetics (4th edition). Cambridge, MA: Blackwell.
10. Ericsson, K.A., & Simon, H.S. (1993). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.
11. Fishman, J.A. (1965). Who speaks what language to whom and when? La Linguistique, 2, 67-88.
12. Gay, G. (2000). Culturally responsive teaching: Theory, research, & practice. New York, NY: Teachers College Press.
13. Gay, G. (2001). Preparing for culturally responsive teaching. Journal of Teacher Education, 53(2), 106-116.
14. Hambleton, R.K. (2005). Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In R.K. Hambleton, P.F. Merenda, & C.D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment. Mahwah, NJ: Lawrence Erlbaum Associates, Publishers.
15. Hamilton, L.S., Nussbaum, E.M., & Snow, R.E. (1997). Interview procedures for validating science assessments. Applied Measurement in Education, 10, 181-200.
16. Hood, S., Hopson, R., & Frierson, H. (2005). The role of culture and cultural context: A mandate for inclusion, the discovery of truth, and understanding in evaluative theory and practice. Greenwich, CT: Information Age Publishing Inc.
17. Kirkhart, K.E. (1995). Seeking multicultural validity: A postcard from the road. Evaluation Practice, 16(1), 1-12.
18. Ladson-Billings, G. (1995). Making mathematics meaningful in multicultural contexts. In W.G. Secada, E. Fennema, & L.B. Adjian (Eds.), New directions for equity in mathematics education (pp. 126-145). Cambridge: Cambridge University Press.
19. Lee, O. (1999). Science knowledge, world views, and information sources in social and cultural contexts: Making sense after a natural disaster. American Educational Research Journal, 36(2), 187-219.
20. Li, M., Solano-Flores, G., Kwon, M., & Tsai, S.P. (2008). "It's asking me as if I were the mother": Examining how students from different groups interpret test items. Paper presented at the annual meeting of the National Association for Research in Science Teaching, Baltimore, MD, April.
21. Megone, M.E., Cai, J., Silver, E.A., & Wang, N. (1994). Validating the cognitive complexity and content quality of a mathematics performance assessment. International Journal of Educational Research, 21(3), 317-340.
22. Messick, S. (1995). Validity of psychological assessments: Validation of inferences from persons' responses and performances as scientific inquiry into scoring meaning. American Psychologist, 50, 741-749.
23. Miller, K.F., & Stigler, J.W. (1987). Counting in Chinese: Cultural variation in a basic cognitive skill. Cognitive Development, 2, 279-305.
24. Muzzi, A. (2001). Challenges in localization. The ATA Chronicle, 30(11), 28-31.
25. National Assessment of Educational Progress (1996). Mathematics items public release. Washington, DC: Author.
26. Nguyen-Le, K. (2010). Personal and formal backgrounds as factors which influence linguistic and cultural competency in the teaching of mathematics. Doctoral dissertation, Educational Equity and Cultural Diversity Program, University of Colorado at Boulder.
27. Norris, S.P. (1990). Effect of eliciting verbal reports of thinking on critical thinking test performance. Journal of Educational Measurement, 27(1), 41-58.
28. Pellegrino, J.W., Chudowsky, N., & Glaser, R. (2001). Knowing what students know: The science and design of educational assessment. Washington, DC: National Academy Press.
29. Prosser, R.R., & Solano-Flores, G. (2010). Including English language learners in the process of test development: A study on instrument linguistic adaptation for cognitive validity. Paper presented at the Annual Conference of the National Council of Measurement in Education, Denver, Colorado, April 29-May 3.
30. Rivera, C., & Collum, E. (Eds.) (2006). State assessment policy and practice for English language learners: A national perspective. Mahwah, NJ: Lawrence Erlbaum Associates.
31. Rogoff, B. (1995). Observing sociocultural activity on three planes: participatory appropriation, guided participation, and apprenticeship. In J.V. Wertsch, P. del Río, & A. Alvarez (Eds.), Sociocultural studies of mind. New York, NY: Cambridge University Press.
32. Roseberry, A., Warren, B., & Conant, F. (1992). Appropriating scientific discourse: Findings from language minority classrooms (Working paper 1-92). Cambridge, MA: TERC.
33. Ruiz-Primo, M.A., Shavelson, R.J., Li, M., & Schultz, S.E. (2001). On the validity of cognitive interpretations of scores from alternative concept-mapping techniques. Educational Assessment, 7(2), 99-141.
34. Sexton, U., & Solano-Flores, G. (2001). A comparative study of teachers' cultural perspectives across different cultures. Poster presented at the annual meeting of the American Educational Research Association, Seattle, WA, April 2-6.
35. Shavelson, R.J., & Webb, N.M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage.
36. Shavelson, R.J., & Webb, N.M. (2009). Generalizability theory and its contribution to the discussion of the generalizability of research findings. In K. Ercikan & W.M. Roth (Eds.), Generalizing from educational research (pp. 13-32). New York, NY: Routledge.
37. Solano-Flores, G. (2001). World views and test views: the relevance of cultural validity. Paper presented at the European Association of Research in Learning and Instruction, Fribourg, Switzerland, August 28-September 1.
38. Solano-Flores, G. (2006). Language, dialect, and register: Sociolinguistics and the estimation of measurement error in the testing of English-language learners. Teachers College Record, 108(11), 2354-2379.
39. Solano-Flores, G. (2008a). Cultural validity and student performance on science assessments. Paper presented at the Symposium, Culture and Context in Large-Scale Assessments: Obstacles or Opportunities? organized by Sharon Nelson-Barber and Larry Sutter. Annual meeting of the American Educational Research Association, New York, NY, April 24-28.
40. Solano-Flores, G. (2008b). Who is given tests in what language by whom, when, and where? The need for probabilistic views of language in the testing of English language learners. Educational Researcher, 37(4), 189-199.
41. Solano-Flores, G. (2009). The testing of English language learners as a stochastic process: Population misspecification, measurement error, and overgeneralization. In K. Ercikan & W.M. Roth (Eds.), Generalizing from educational research (pp. 33-50). New York, NY: Routledge.
42. Solano-Flores, G., & Gustafson, M. (in press). Assessment of English language learners: A critical, probabilistic, systemic view. In M. Simon, K. Ercikan, & M. Rousseau (Eds.), Handbook on large-scale assessments and secondary analyses.
43. Solano-Flores, G., & Li, M. (2006). The use of generalizability (G) theory in the testing of linguistic minorities. Educational Measurement: Issues and Practice, 25(1), 13-22.
44. Solano-Flores, G., & Li, M. (2008). Examining the dependability of academic achievement measures for English-Language Learners. Assessment for Effective Intervention, 333, 135-144.
45. Solano-Flores, G., & Li, M. (2009). Language variation and score variation in the testing of English language learners, native Spanish speakers. Educational Assessment, 14, 1-15.
46. Solano-Flores, G., Li, M., Speroni, C., Rodriguez, J., Basterra, M.R., & Dovholuk, G. (2007). Comparing the properties of teacher-adapted and linguistically-simplified test items for English language learners. Paper presented at the annual meeting of the American Educational Research Association, Chicago, IL, April 9-13.
47. Solano-Flores, G., & Nelson-Barber, S. (2001). On the cultural validity of science assessments. Journal of Research in Science Teaching, 38(5), 553-573.
48. Solano-Flores, G., Speroni, C., & Sexton, U. (2005). The process oftest translation: Advantages and challenges of a socio-linguistic approach. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Quebec, Canada, April 11-15.
49. Solano-Flores, G., & Trumbull, E. (2003). Examining language in context: The need for new research and practice paradigms in the testing of English-language learners. Educational Researcher, 32(2), 3-13.
50. Solano-Flores, G., & Trumbull, E. (2008). In what language should English language learners be tested? In R.J. Kopriva (Ed.), Improving testing for English language learners. New York, NY: Routledge.
51. Tillman, L.C. (2002). Culturally sensitive research approaches: An African-American perspective. Educational Researcher, 31(9), 3-12.
52. Wardhaugh, R. (2002). An introduction to sociolinguistics (fourth edition). Oxford: Blackwell Publishing.
53. Winter, P.C., Kopriva, R., Chen, C.S., & Emick, J. (2006). Exploring individual and item factors that affect assessment validity for diverse learners: Results from a large-scale cognitive lab. Learning and Individual Differences, 16, 267-276.
54. Wolfram, W., Adger, C.T., & Christian, D. (1999). Dialects in schools and communities. Mahwah, NJ: Lawrence Erlbaum Associates.
55. WorldLingo (2004). Glossary of terms. www.worldlingo.com/resources/glossary.html. Retrieved May 24, 2004.