On the Psychometrics of Assessing Science Understanding

Assessing Science Understanding

Volumn , Issue , 2005, Pages 303-341

  Shavelson, Richard I ^a   Araceli Ruiz Primo, Maria ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84882502070     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-012498365-6/50015-9     Document Type: Chapter

References (62)

1. Baxter G.P., Glaser R. Investigating the cognitive complexity of science assessment. Educational Measurement: Issues and Practice 1998, 17(3):37-45.
2. Baxter G.P., Shavelson R.J. Science performance assessments: Benchmarks and sur-rogates. International Journal of Educational Research 1994, 21(3):279-298.
3. Baxter G.P., Shavelson R.J., Herman S.J., Brown K., Valadez J.R. Mathematics per-formance assessment: Technical quality and diverse student impact. Journal of Research in Mathematics Education 1993, 24:41-53.
4. Baxter G.P., Elder A.D., Glaser R. Knowledge-based cognition and performance assessment in the science classroom. Educational Psychologist 1996, 31:133-140.
5. Beaton A.E., Mullis I.V.S., Martin M.O., Gonzalez E.J., Kelly D.L., Smith T.A. Mathematics achievement in the middle school years: IEA's third international mathematics and science study 1996, Chesnut Hill, MA, Center for the Study of Testing, Evaluation, and Educational Policy, Boston College.
6. Brennan R.L. Elements of generalizability theory 1992, ACT, Iowa City. IA. 2nd ed.
7. Brennan R.L., Harris D.J., Hanson B.A. The bootstrap and other procedures for examining variability of estimated variance components in testing contexts. Paper presented at the Annual Meeting of the National Council on Measurement in Education 1987.
8. Candell G.L., Ercikan K. On the generalizability of school level performance assess-ment scores. International journal of Educational Research 1994, 21(3):267-278.
9. Chi M.T.H., Feltovich P.J., Glaser R. Categorization and representation of physics problems by experts and novices. Cognitive Science 1981, 5(2):121-152.
10. Chi M.T.H., Glaser R., Farr M.J.dy1988 The nature of expertise 1981, Lawrence Erlbaum, Hillsdale, NJ.
11. Cronbach L.J. Test Validation. Educational measurement 1971, 443-507. American Council on Education, Washington, DC. 2nd ed. R. L. Thorndike (Ed.).
12. Cronbach L.J. Essentials of psychological testing 1984, Harper & Row. 4th ed. plNew York.
13. Cronbach L.J., Gleser G.C., Nanda H., Rajaratnam N. The dependability of behavioral measurements 1972, Wiley, New York.
14. Cronbach L.J., Linn R.L., Brennan R.L., Haertel E.H. Generalizability analysis for performance assessments of student achievement or school effectiveness. Educational and Psychological Measurement 1997, 57:373-399.
15. Dunbar S.B., Koretz D.M., Hoover H.D. Quality control in the development and use of performance assessment. Applied Measurement in Education 1991, 4:289-303.
16. Fitzpatrick R., Morrison E.J. Performance and product evaluation. Educational Measurement 1971, 237-270. American Council Education, Washington, DC. R. L. Thorndike (Ed.).
17. Gao X., Shavelson R.J., Baxter G.P. Generalizability of large-scale performance assessments in science: Promises and problems. Applied Measurement in Education 1994, 7:323-342.
18. Glaser R. Expertise and assessment. Testing and cognition 1991, 17-30. Prentice Hall, Englewood Cliffs, NJ. M. C. Wittrock, E. L. Baker (Eds.).
19. Glaser R., Baxter G.P. Improving the theory and practice of achievement testing. Paper presented at the conference, Science Education Standards.The Assessment of Science Meets the Science of Assessment 1997, February.
20. Goldsmith T.E, Johnson P.J., Acton W.H. Assessing structural knowledge. Journal of Educational Psychology 1991, 83:88-96.
21. Hamilton L.S., Nussbaum M., Snow R.E. Interview procedures for validating sci-ence assessments. Applied Measurement in Education 1997, 10(2):181-200.
22. Hein G.E., Price S. Active assessment for active science: A guide for elementary school teachers 1994, Heinemann, Portsmouth, NH.
23. Jovanovic J., Solano-Flores G., Shavelson R.J. Science performance assessments. Will gender make a difference?. Education and Urban Society 1994, 26(4):352-366.
24. Kane M.T. A sampling model of validity. Applied Psychological Measurement 1982, 6:126-160.
25. Klein S.P..Jovanovic.J., Stecher B.M., McCaffrey D., Shavelson R.J., Haertel E., Solano-Flores G., Comfort K. Gender and racial/ethnic differences on gender and racial/ethnic differences on performance assessments in science. Educational Evaluation and Policy Analysis 1997, 19(2):83-97.
26. Klein S.P., Shavelson R.J., Stecher B.M., McCaffrey D., Haertel E., Baxter G.P., Comfort K., Solano-Flores G. Sources of task sampling variability 1997, Manuscript submitted for publication.
27. Messick S. Validity. Educational measurement 1989, 13-104. Macmillan, New York. 3rd ed. R. L. Linn (Ed.).
28. Messick S. The interplay of evidence and consequences in the validation of perfor-mance assessments. Educational Researcher 1994, 23(2):13-23.
29. Messick S. Validity of psychological assessment: Validation of inferences from person's responses and performances as scientific inquiry into score meaning. American Psychologist 1995, 50(9):741-749.
30. National Research Council National science education standards 1996, National Academy Press, Washington, DC.
31. Novak J.D. Concept mapping: A useful tool for science education. Journal of Research in Science Teaching 1990, 27(10):937-949.
32. Novak.J.D., Gowin D.B. Learning how to learn 1984, Cambridge University Press, New York.
33. Othman A.R. Examining task sampling variability in science performance assessments 1995, January, Unpublished doctoral dissertation, University of California, Santa Barbara.
34. Ruiz-Primo M.A., Shavelson R.J. Problems and issues in the use of concept maps in science assessment. Journal of Research in Science Teaching 1996, 33:569-600.
35. Ruiz-Primo M.A., Shavelson R.J. Rhetoric and reality in science performance assessments: An update. Journal of Research in Science Teaching 1996, 33:1045-1063.
36. Ruiz-Primo M.A., Baxter G.P., Shavelson R.I. On the stability of performance assessments. Journal of Educational Measurement 1993, 30:41-53.
37. Ruiz-Primo M.A., Schultz S.E., Shavelson R.I. Concept map-based assessment in science: An exploratory study. Paper presented at the annual meeting of the American Educational Research Association 1996, April.
38. Ruiz-Primo M.A., Shavelson R.J., Schultz S.E. On the validity of concept-mapbased assessment interpretations: An experiment testing the assumption of hierarchical concept maps in science. Paper presented at the annual meeting of the American Educational Research Association 1997, March.
39. Ruiz-Primo M.A., Schultz S.E., Li M., Shavelson R.I. Comparison of the reliability and validity of scores from two mapping techniques. Paper presented at the annual meeting of the American Educational Research Association 1998, April.
40. Sadler P.M. Psychometric models of student conceptions in science: Reconciling qual-itative studies and distractor-driven assessment instruments. Journal of Research in Science Teaching 1998, 35(3):265-296.
41. Searle S.R., Casella G., McCulloch C.E. Variance components 1992, Wiley, New York.
42. Shavelson R.J. Some aspects of the correspondence between content structure and cognitive structure in physics instruction. Journal of Educational Psychology 1972, 63:225-234.
43. Shavelson R.J. Methods for examining representations of a subject-matter structure in a student's memory. Journal of Research in Science Teaching 1974, 11:231-249.
44. Shavelson R.J., Ruiz-Primo M.A. Leistungsbewertung im naturwissenschaftlichen Unterricht. Unterrichtswissenschaft. Zeitschrift für Lernforschung 1999, 27(2):102-127.
45. Shavelson R.J., Stanton G.C. Construct validation: Methodology and application to three measures of cognitive structure. Journal of Educational Measurement 1975, 12:67-85.
46. Shavelson R.J., Webb N.M. Generalizability theory: 1973-1980. British journal of Math-ematical and Statistical Psychology 1981, 34:133-166.
47. Shavelson R.J., Webb N.M. Generalizability theory: A primer 1991, Sage, Newbury Park, CA.
48. Shavelson R.J., Webb N.M., Rowley G. Generalizability theory. American Psychologist 1989, 44(6):922-932.
49. Shavelson R.J., Baxter G.P., Pine J. Performance assessments in science. Applied Mea-surement in Education 1991, 4(4):347-362.
50. Shavelson R.J., Baxter G.P., Gao X. Sampling variability of performance assessments. Journal of Educational Measurement 1993, 30:215-232.
51. Shavelson R.J., Gao X., Baxter G.P. On the content validity of performance assessments: Centrality of domain specification. Alternatives in assessment of achievements, learning processes and prior knowledge 1996, Kluwer Academic, Boston, MA. M. Birembaum, F. J. R. C. Dochy (Eds.).
52. Shavelson R.J., Solano-Flores G., Ruiz-Primo M.A. Toward a science performance assessment technology. Evaluation and Program Planning 1998, 21(2):171-184.
53. Shavelson R.J., Ruiz-Primo M.A., Wiley E. Note on sources of sampling variability in science performance assessments. Journal of Educational Measurement 1999, 36(1):61-71.
54. Sokal R.R., Sneath P.H.A. Principles of numerical taxonomy 1963, W. H. Freeman, San Francisco.
55. Solano-Flores G., Shavelson R.J. Development of performance assessments in sci-ence: Conceptual, practical, and logistical issues. Educational Measurement: Issues and Practice 1997, 16(3):16-25.
56. Solano-Flores G., Shavelson R.J., Ruiz-Primo M.A., Schultz S.E., Wiley E., Brown J. On the development and scoring of classification and observation science performance assessments. Paper presented at the annual meeting of the American Educational Research Association 1997.
57. Solano-Flores G..Jovanovic.J., Shavelson R.J. On the development and evaluation of a shell for generating science performance assessments. International Journal of Science Edu-cation 1999, 21(3):293-315.
58. Stecher B.M., Klein S.P. The cost of science performance assessments in large-scale testing programs. Educational Evaluation and Policy Analysis 1997, 19:1-14.
59. Stecher, B. M., Klein, S. P., Solano-Flores, G., McCaffrey, D., Robyn, A., Shavelson, R. J., & Haertel, E. (In press). The effects of content, format, and inq.
60. Wallace J.D., Mintzes.J.J. The concept map as a research tool: Exploring conceptual change in biology. Journal of Research in Science Teaching 1990, 27(10):1033-1052.
61. Wandersee.J.H. Concept mapping and the cartography of cognition. Journal of Research in Science Teaching 1990, 27(10):923-936.
62. Performance assessments in the work place 1991, Vol. 1. National Academy Press, Washington, DC. A.K. Wigdor, B.F. Green (Eds.).