Reasonable decisions in portfolio assessment: Evaluating complex evidence of teaching

Education Policy Analysis Archives

Volumn 12, Issue , 2004, Pages

  Schutz, Aaron ^a   Moss, Pamela A ^b  

^a UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 4644229514     PISSN: 10682341     EISSN: None     Source Type: Journal    
DOI: 10.14507/epaa.v12n33.2004     Document Type: Review

References (58)

1. AERA, APA, & NCME (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
2. Arminen, I. (1999). Conversation analysis: A quest for order in social interaction and language use. Acta Sociologica, 42, 251-257.
3. Bruner, J. (1986). Actual minds, possible worlds. Cambridge: Harvard University Press.
4. Bruner, J. (1990). Acts of Meaning. Cambridge: Harvard University Press.
5. Collins, K. C., Moss, P. A, & Schutz, A. (1997). INTASC candidate interviews: Final summary report to INTASC. Unpublished manuscript, University of Michigan.
6. Coulon, A. (1995). Ethnomethodology (J. Coulon & J. Katz, Trans.). Thousand Oaks: SAGE.
7. Davies, B. (2000). Grice's cooperative principle: Getting the meaning across. In D. Nelson & P. Foulkes (Eds.), Leeds Working Papers in Linguistics 8, 1-26.
8. Davies, B. & Harre, R. (1990). Positioning: The discursive production of selves. Journal for the Theory of Social Behavior, 20(1), 43-63.
9. Delandshere, G., & Petrosky, A. R. (1994). Capturing teachers' knowledge. Educational Researcher, 23 (5), 11-18.
10. Educational Testing Service (ETS) (1998). NBPTS technical analysis report, 1996-97 administration. Southfield, MI: NBPTS.
11. Engelhard, G. (1994). Examining rater errors in the assessment of written composition with a many faceted Rasch model. Journal of Educational Measurement, 31(2), 93-112.
12. Engelhard, G. ( 2001). Monitoring raters in performance assessments. In Tindal & Haladyna (Eds.), Large scale assessment programs for all students (pp. 261-287). Mahway, NJ: Lawrence Erlbaum.
13. Erickson, F. (1986). Qualitative methods in research on teaching. In M. C. Wittrock (Ed.), Handbook of research on teaching (pp. 119-161). New York: Macmillan.
14. Freedman, S.W. & Calfee, R.C. (1983). Holistic assessment of writing: Experimental design and cognitive theory. In P. Mosenthal, L. Taymor & S. A. Walmsley (Eds.), Research on writing: Principles and method (pp.75-98). New York: Longman.
15. Gadamer, H. G.. (1994/1975). Truth and method. New York: Seabury.
16. Gadamer, H. G. (1987). The problem of historical consciousness. In P. Rabinow, & W.M. Sullivan (Eds.), Interpretive social science: A second look (pp. 82-140). Berkeley: University of California Press.
17. Garfinkel, H. (1967). Studies in ethnomethodology. Englewood Cliffs: Prentice Hall.
18. Garfinkel, H. (2002). Ethnomethodology's program: Working out Durkheim's aphorism (A. W. Rawls, Ed.). Boulder: Roman & Littlefield.
19. Gee, J. P. (1990). Social linguistics and literacies. London: Taylor and Francis.
20. Gee, J. P. (1999). An introduction to discourse analysis theory and method. London: Routledge.
21. Gibbs, R. W. (1993). The intentionalist controversy and cognitive science. Philosophical Psychology, 6(2), 181-206.
22. Goodwin, C. & Goodwin, M. H. (1992). Assessments and the construction of context. In Duranti, A. & Goodwin, C. (Eds.), Rethinking context: Language as an interactive phenomenon (pp. 147-190). Cambridge: Cambridge University Press.
23. Habermas, J. (1993). Justification and application (C. P. Cronin, Trans.). Cambridge: MIT Press.
24. Habermas, J. (1996). Between facts and norms: Contributions to a discourse theory of law and democracy (W. Rehg, Trans.). Cambridge: MIT Press.
25. Haertel, E. H. (1991). New forms of teacher assessment. Review of Research in Education, 17, 3-29.
26. Heller, J.I., Sheingold, K. & Myford, C.M. (1998). Reasoning about evidence in portfolios: Cognitive foundations for valid and reliable assessment. Educational Assessment, 5(1), 5-40.
27. Heritage, J. (1984). Garfinkel and ethnomethodology. Albany: SUNY Press.
28. Hill, C. & Larsen, E. (2000). Children and reading tests. Stamford, CT: Ablex.
29. Kane, M., Crooks, T., & Cohen, A. (1999). Validating measures of performance. Educational Measurement: Issues and Practice, 18(2), 5-17.
30. Klein, S. P., McCaffrey, D., Strecher, B., & Koretz, D. (1995). The reliability of mathematics portfolio scores: Lessons from the Vermont experience. Applied Measurement in Education, 8 (3), 243-260.
31. Koziol, S. M. Jr., Burns, L., & Brass, J (2003). Four lenses for the analysis of teaching. Supporting beginning teachers' practice. Working paper, Michigan State University.
32. Kroeber, K. (1992). Rereading/retelling: The fate of storytelling in modern times. New Brunswick: Rutgers University Press.
33. Madaus, G. F. (1990). Legal and professional issues in teacher certification testing: A psychometric snark hunt. In J. V. Mitchell, Jr., S. L. Wise, & B. S. Plake (Eds.), Assessment of teaching (pp. 209-261). Hillsdale, NJ: Erlbaum.
34. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). New York: American Council on Education/Macmillan.
35. Mislevy, R. J., Almond, R., & Steinberg, L. (2003). On the structure of educational assessment. Measurement: Interdisciplinary Research and Perspectives, 1(1), 3-62.
36. Mink, L. O. (1987). Historical understanding. Ithaca: Cornell University Press.
37. Moss, P. A. (1992). Shifting conceptions of validity in educational measurement: Implications for performance assessment. Review of Educational Research, 62 (3), 229-258.
38. Moss, P. A., Beck, J. S., Ebbs, C., Herter, R., Matson, B., Muchmore, J., Steele, D., & Taylor [Clark], C. (1992). Portfolios, accountability, and an interpretive approach to validity. Educational Measurement. Issues and Practice, 3(11), 12-21.
39. Moss, P. A. & Schutz, A. (2001). Educational standards, assessment, and the search for "consensus." American Educational Research Journal, 38(1), 37-70.
40. Moss, P. A., Schutz, A. M., & Collins, K. M (1998). An Integrative approach to portfolio evaluation for teacher licensure. Journal of Personnel Evaluation in Education, 12(2), 139-161.
41. Moss, P. A., Schutz, A. M., Haniford, L., Coggshall J., & Miller, R. (in preparation). High stakes assessment as ethical decision making. University of Michigan.
42. Moss, P.A., Sutherland, L.M., Haniford, L, Miller, R., Johnson, D., Geist, P.K., Koziol, S.M., Star, J., & Pecheone, R.L. (in press). Interrogating the generalizability of portfolio assessments of beginning teachers: A Qualitative Study. Educational Policy Analysis Archives.
43. Myford, C. M. (1993). Formative studies of Praxis III: Classroom Performance Assessments--An overview. The Praxis Series: Professional Assessments for Beginning Teachers. Princeton, NJ, Educational Testing Service.
44. Myford, C. M., & Engelhard, G. (2001). Examining the psychometric quality of the national board for professional teaching standards early childhood/generalist assessment System. Journal of Personnel Evaluation in Education, 15(4), 253-285.
45. Myford, C. M., & Mislevy, R. J. (1995). Monitoring and improving a portfolio assessment system (Center for Performance Assessment Research Report). Princeton, NJ: Educational Testing Service.
46. National Research Council (2001a). Knowing what students know: The science and design of educational assessment. Washington, D.C.: National Academy Press.
47. National Research Council (2001b). Testing teacher candidates: The role of licensure tests in improving teacher quality. Washington, D.C.: National Academy Press.
48. Nystrand, M., Cohen, A. S., & Dowling, N. M. (1993). Addressing reliability problems in the portfolio assessment of college writing. Educational Assessment, 1(1), 53-70.
49. Peng, K. & Nesbitt, R. E. (1999). Culture, dialectics, and reasoning about contradiction. American Psychologist, 54(9), 741-755.
50. Pinker, S. (2002). The blank slate: The modern denial of human nature. New York: Viking.
51. Pollner, M. (1991). Left of ethnomethodology: The rise and decline of radical reflexivity. American Sociological Review, 56(3), 370-81.
52. Richards, R. J. (2002). "'The blank slate': The evolutionary war." New York Times, October 13. www.nytimes.c om, accessed 10/17/02.
53. Ruddell, R. B., & Unrau, N. J. (1994). Reading as a meaning-construction process: The reader, the text, and the teacher. In R. B. Ruddell, M. R. Ruddell, & H. Singer (Eds.), Theoretical models and processes of reading (4th ed.) (pp. 996-1056). Newark, DE: IRA.
54. Schegloff, E. A. (1999). 'Shegloff's texts' as 'Billig's data': A critical reply. Discourse and Society, 10(4), 558-572.
55. Smagorinsky, P. (2001). If meaning is constructed, what is it made from? Toward a cultural theory of reading. Review of Educational Research, 71(1), 133-169.
56. Swanson, D., Norman, G. R. & Linn, R. L. (1995). Performance-based assessment: Lessons from the health professions. Educational Researcher, 24(5), 5-11,35.
57. Wilson, M., & Case, H. (1997). An examination of variation in rater severity over time: A study in rater drift. Berkeley, CA: Berkeley Evaluation and Assessment Research (BEAR) Center.
58. Wolfe, E. Q. (1997). The relationship between essay reading style and scoring proficiency in a psychometric scoring system. Assessing Writing, 4(1), 83-106.