On the cultural validity of science assessments

Journal of Research in Science Teaching

Volumn 38, Issue 5, 2001, Pages 553-573

  Solano Flores, Guillermo ^a   Nelson Barber, Sharon ^a  

^a WestEd   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0035334537     PISSN: 00224308     EISSN: None     Source Type: Journal    
DOI: 10.1002/tea.1018     Document Type: Article

References (86)

1. Aikenhead, G.S., & Jegede, O.J. (1999). Cross-cultural science education: A cognitive explanation of a cultural phenomenon. Journal of Research in Science Teaching, 36, 269-287.
2. August, D., & Hakuta, K. (Eds.). (1997). Improving schooling for language-minority children: A research agenda. Committee on Developing a Research Agenda on the Education of Limited-English-Proficient and Bilingual Students, Board on Children, Youth, and Families. Washington, DC: National Acaddemy Press.
3. Bartolomé, L. (1994). Beyond the methods fetish: Toward a humanizing pedagogy. Harvard Educational Review, 64, 173-194.
4. Baxter, G.P., Elder, A.D., & Glaser, R. (1996). Knowledge-based cognition and performance assessment in the science classroom. Educational Psychologist, 31, 133-140.
5. Baxter, G.P., & Glaser, R. (1998). Investigating the cognitive complexity of science assessments. Educational Measurement: Issues and Practice, 17, 37-45.
6. Baxter, G.P., Shavelson, R.J., Goldman, S.R., & Pine, J. (1992). Evaluation of procedure-based scoring for hands-on science assessment. Journal of Educational Measurement, 29, 1-17.
7. Bradley-Kawagley, C. (1998). Star navigation: An NSF-sponsored module with an emphasis on geometry. Developed in cooperation with the project, "Adapting Yup'ik elders' knowledge: pre-K to 6th grade instructional materials development." Fairbanks, AK: University of Alaska, Fairbanks.
8. Brown, J.H., & Shavelson, R.J. (1996). Assessing hands-on science: A teacher's guide to performance assessments. Thousand Oaks, CA: Corwin Press.
9. Camilli, G., & Shepard, L. A. (1994). Methods for identifying biased items. Thousand Oaks, California: Sage.
10. Chi, M.T.H., Feltovich, P.J., & Glaser, R. (1981). Categorization and representation of physics problems by experts and novices. Cognitive Science, 5, 121-152.
11. Cronbach, L.J., Gleser, G.C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements. New York: Wiley.
12. Darling-Hammond, L. (1995). Inequality and access to knowledge. In J.A. Banks & C.A.M. Banks (Eds.), Handbook of research in multicultural education. New York: Simon & Schuster Macmillan.
13. Darling-Hammond, L. (1997). The right to learn: A blueprint for creating schools that work. San Francisco: Jossey-Bass.
14. Delpit, L. (1988). The silenced dialogue: Power and pedagogy in educating other people's children. Harvard Educational Review, 58, 280-298.
15. Denny, J.P. (1986). Cultural ecology of mathematics: Ojibway and Inuit hunters. In M.P. Closs (Ed.), Native American mathematics (pp. 129-180). Austin, TX: University of Texas Press.
16. Durán, R.P. (1989). Testing of linguistic minorities. In R.L. Linn (Ed.), Educational Measurement (3rd Ed., pp. 573-587). New York: Macmillan.
17. Ercikan, K. (1998). Translation effects in international assessment. International Journal of Educational Research, 29, 543-553.
18. Ericsson, K.A., & Simon, H.S. (1993). Protocol analysis: Verbal reports as data. Cambridge, Massachusetts: MIT Press.
19. Estrin, E. (1993). Alternative assessment: Issues in language, culture and equity. Knowledge Brief No. 11. San Francisco: Far West Laboratory.
20. Fradd, S.H., & Lee, O. (1999). Teachers' roles in promoting science inquiry with students from diverse language backgrounds. Educational Researcher, 28, 14-20.
21. Figueroa, R.A. (1980). Intersection of special education and bilingual education. In J.E. Alatis (Ed.), Georgetown University roundtable on languages and linguistics (pp.147-161). Washington, DC: Georgetown University Press.
22. García, G.E., & Pearson, P.D. (1994). Assessment and diversity. Review of Research in Education, 20, 337-390.
23. Greenfield, P.M. (1997a). Culture as process: Empirical methods for cultural psychology. In J.W. Berry, Y.H. Poortinga, & J. Pandey (Eds.), Handbook of cross-cultural psychology (2nd Ed), Vol. 1: Theory and method, (pp. 301-346). Needham Heights, MA: Allyn & Bacon.
24. Greenfield, P.M. (1997b). You can't take it with you: Why ability assessments don't cross cultures. American Psychologist, 52, 1115-1124.
25. Greenfield, P.M., Quiroz, B., & Raeff, C. (1998). Cross-cultural conflict and harmony in the social construction of the child. In S. Harkness, C. Raeff, & C.M. Super (Eds.), The social construction of the child: Nature and sources of variability. New directions in child psychology. San Francisco: Jossey-Bass.
26. Hambleton, R.K. (1994). Guidelines for adapting educational and psychological tests: A progress report. European Journal of Psychological Assessment, 10, 229-244.
27. Hamilton, L. (1998). Gender differences on high school science achievement tests: Do format and content matter? Educational Evaluation and Policy Analysis, 20, 179-195.
28. Hamilton, L.S., Nussbaum, E.M., & Snow, R.E. (1997). Interview procedures for validating science assessments. Applied Measurement in Education, 10, 181-200.
29. Hidalgo, N.M., Bright, J.A., Siu, S.-F., Swap, S.M., & Epstein, J.L. (1995). Research on families, schools, and communities: A multicultural perspective. In J.A. Banks & C.A.M. Banks (Eds.), Handbook of research in multicultural education (pp. 498-524). New York: Simon & Schuster Macmillan.
30. Hively, W., Patterson, H.L., & Page, S.H. (1968). A "universe-defined" system of arithmetic achievement tests. Journal of Educational Measurement, 5, 275-290.
31. Jovanovic, J., Solano-Flores, G., & Shavelson, R.J. (1994). Science performance assessments: Will gender make a difference? Education and Urban Society, 26, 352-366.
32. Kawagley, A.O. (1995). A Yupiaq worldview: A pathway to ecology and spirit. Prospect Heights, IL: Waveland Press.
33. Knapp, M.S., Shields, P.M., & Turnbull, B.J. (1995). Academic challenge in high-poverty classrooms. Phi Delta Kappan, 76, 770-776.
34. Koelsch, N., Estrin, E.T., & Farr, B. (1995). Guide to analyzing linguistic and cultural assumptions in assessment. San Francisco: Far West Laboratory for Educational Research and Development.
35. Kopriva, R. (1999, April 19-23). A conceptual framework for the valid and comparable measurement of all students. Paper presented at the American Educational Research Association annual meeting, Montreal, Canada.
36. Kopriva, R. (2000). Ensuring accuracy in testing for English language learners. Washington, DC: Council of Chief State School Officers.
37. Kopriva, R., & Saez, S. (1997). Guide to scoring LEP student responses to open-ended mathematics items. Washington, DC: Council of Chief State School Officers.
38. Kopriva, R., & Sexton, U.M. (1998). Guide to scoring LEP student responses to open-ended science items. Washington, DC: Council of Chief State School Officers.
39. Kusimo, P., Ritter, M.G., Busick, K., Ferguson, C., Trumbull, E., & Solano-Flores, G. (2000). Making assessment work for everyone: How to build on student strengths. San Francisco: Regional Educational Laboratories.
40. Lee, O. (1999a). Equity implications based on the conceptions of science achievement in major reform documents. Review of Educational Research, 69, 83-115.
41. Lee, O. (1999b). Science knowledge, world views, and information sources in social and cultural contexts: Making sense after a natural disaster. American Educational Research Journal, 36, 187-219.
42. Lee, O., & Fradd, S.H. (1998). Science for all, including students from non-English language backgrounds. Educational Researcher, 27, 12-21.
43. Lee, O., Fradd, S.H., & Sutman, F.X. (1995). Science knowledge and cognitive strategy use among culturally and linguistically diverse students. Journal of Research in Science Teaching, 32, 797-816.
44. Linn, R.L., Baker, E.L., & Dunbar, S.B. (1991). Complex performance-based assessment: Expectations and validation criteria. Educational Researcher, 20, 5-21.
45. Lipka, J. (1991). Toward a culturally based pedagogy: A case study of one Yup'ik Eskimo teacher. Anthropology and Education Quarterly, 22, 203-223.
46. Lipka, J. (1994). Culturally-negotiated schooling: Toward a Yup'ik mathematics. Journal of American Indian Education, 33, 14-30.
47. Lipka, J. (1998). Transforming the culture of schools: Yup'ik Eskimo examples. Mahwah, NJ: Erlbaum.
48. Lipka, J. (2000). Adapting Yup'ik elders knowledge: Pre-K to 6th math and instructional materials development. Fairbanks, AK: University of Alaska, Fairbanks.
49. Magone, M.E., Cai, J., Silver, E.A., & Wang, N. (1994). Validating the cognitive complexity and content quality of a mathematics performance assessment. International Journal of Educational Research, 21, 317-340.
50. Messick, S. (1989). Validity. In R.L. Linn (Ed.), Educational measurement (3rd Ed., pp. 13-103). Washington, DC: American Council on Education & National Council on Measurement in Education.
51. Messick, S. (1995). Standards of validity and the validity of standards in performance assessment. Educational Measurement: Issues and Practice, 14, 5-8.
52. Miles, M.B., & Huberman, A.M. (1994). Qualitative Data Analysis (2nd Ed.). Thousand Oaks, CA: Sage.
53. National Assessment of Educational Progress. (1996). The nation's report card: Assessment science-public release. www.ed.gov/NCES/NAEP.
54. National Council of Teachers of Mathematics (2000). Principles and standards for school mathematics. Reston, VA: Author.
55. National Research Council. (1996). National science education standards. Washington, DC: National Academy Press.
56. Nelson-Barber, S., & Estrin, E. (1996). Culturally responsive mathematics and science education for native students. San Francisco: Far West Laboratory for Educational Research and Development.
57. Oakes, J. (1985). Keeping track: How schools structure inequality. New Haven, CT: Yale University Press.
58. Oakes, J. (1990). Multiplying inequalities: The effects of race, social, class, and tracking on opportunities to learn mathematics and science. Santa Monica, CA: RAND.
59. Olson, J.F., & Goldstein, A.A. (1997). The inclusion of students with disabilities and limited English proficient students in large-scale assessments: A summary of recent progress. Washington, DC: U.S. Department of Education.
60. Pellegrino, J.W, Jones, L.R., & Mitchell, K.J. (Eds.) (1999). Grading the nation's report card: Evaluating NAEP and transforming the assessment of educational progress. Washington, DC: Committee on the Evaluation of National and State Assessments of Educational Progress. National Academy Press.
61. Popham, W.J. (1997). Consequential validity: Right concern - wrong concept. Educational Measurement: Issues and Practice, 16, 9-13.
62. Ross, M.J. (1999). Mathematics problem solving strategies and the bilingual student: A study of strategy usage between monolingual and bilingual mathematics students. Unpublished master's thesis, City University School of Education.
63. Ruiz-Primo, M.A., Shavelson, R.J., Li, M., & Schultz, S.E. (in press). On the cognitive validity of interpretations of scores from alternative concept-mapping techniques. Educational Assessment.
64. Shavelson, R.J. (1995). On the romance of science curriculum and assessment reform in the United States. In D.K. Sharpes & A.-L. Leino (Eds.), The dynamic concept of curriculum: Invited papers to honour the memory of Paul Hellgren (Research Bulletin 90). (pp. 57-76). Helsinki, Finland: University of Helsinki Department of Education.
65. Shavelson, R.J., & Webb, N.M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage.
66. Shavelson. R.J., Brown, J., Solano-Flores, G., & Ruiz-Primo, M.A. (1993, December). Development of performance assessments in science. Staff development workshop. University of California, Santa Barbara, and National Science Resources Center, Smithsonian Institution, Washington, DC.
67. Shaw, J. (1997). Threats to the validity of science performance assessments for English language learners. Journal of Research in Science Teaching, 34, 721-743.
68. Shepard, L.A. (1997). The centrality of test use and consequences for test validity. Educational Measurement: Issues and Practice, 16, 5-8, 13, 24.
69. Snow, C.E. (1983). Literacy and language: relationships during the preschool years. Harvard Educational Review, 53, 165-169.
70. Solano-Flores, G. (2000). Astronomy tasks that promote geometrical, contextualized reasoning. Unpublished manuscript.
71. Solano-Flores, G., & Nelson-Barber, N. (1999a, March 28-31). Developing culturally-responsive science assessments. Workshop paper presented at the 1999 Meeting of the National Association for the Research of Science Teaching. Boston, Massachusetts.
72. Solano-Flores, G., & Nelson-Barber, N. (1999b, January 20-23). Promoting equity and fairness in testing from the start: Developing culturally-responsive assessments. Presented at the 1999 meeting of the Center for Research of Students Placed at Risk, El Paso, Texas.
73. Solano-Flores, G., Ruiz-Primo, M.A., Baxter, G.P., & Shavelson, R.J. (1991). Science performance assessment with language minority students. Santa Barbara, CA: University of California, Santa Barbara.
74. Solano-Flores, G., & Shavelson, R.J. (1997). Development of performance assessments in science: Conceptual, practical and logistical issues. Educational Measurement: Issues and Practice, 16, 16-25.
75. Solano-Flores, G., Trumbull, E., & Nelson-Barber, S. (2000, April). Evaluation of a model for the concurrent development of two language versions (English and Spanish) of a mathematics assessment in a bilingual program. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA.
76. Steele, C. (1992, April). Race and the schooling of Black Americans. Atlantic Monthly, 269, 68-76.
77. Steele, C. (1997). A threat in the air: How stereotypes shape intellectual identity and performance. American Psychologist, 52, 613-629.
78. Steele, C., & Aronson, J. (1995). Stereotype threat and the intellectual test performance of African Americans. Journal of Personality and Social Psychology, 69, 797-811.
79. Tanzer, N.K. (1999). Developing tests for use in multiple languages and cultures: A plea for simultaneous development. In R. Hambleton, P. Merenda, & C.D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment. Hillsdale, NJ: Erlbaum.
80. Van de Vivjer, F., & Hambleton, R.K. (1996). Translating tests: Some practical guidelines. European Psychologist, 1, 89-99.
81. Van de Vivjer, F., & Leung, K. (1997). Methods and data analysis of comparative research. In J.W. Berry, Y.H. Poortinga, & J. Pandey (Eds.), Handbook of cross-cultural psychology (2nd Ed.). Vol. 1: Theory and method (pp. 257-301). Needham Heights, MA: Allyn & Bacon.
82. Van de Vivjer, F., & Poortinga, Y.H. (1997). Towards an integrated analysis of bias in cross-cultural assessment. European Journal of Psychological Assessment, 13, 29-37.
83. Van de Vivjer, F., & Tanzer, N.K. (1998). Bias and equivalence in cross-cultural assessment: An overview. European Review of Applied Psychology, 47, 263-279.
84. Vygotsky, L.S. (1978). Mind in society: The development of higher psychological processes. Cambridge, MA: Harvard University Press.
85. Wertsch, J.V. (1985). Vygotsky and the social formation of mind. Cambridge, MA: Harvard University Press.
86. Wertsch, J.V., Del Río, P., & Alvarez, A. (Eds.). (1995). Sociocultural studies of mind. New York: Cambridge University Press.