Establishing validity for performance-based assessments: An illustration for collections of student writing

Journal of Educational Research

Volumn 89, Issue 4, 1996, Pages 220-233

  Novak, John R ^a   Herman, Joan L ^b   Gearhart, Maryl ^b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0000226912     PISSN: 00220671     EISSN: 19400675     Source Type: Journal    
DOI: 10.1080/00220671.1996.9941207     Document Type: Article

References (48)

1. Baker, E. L., Gearhart, M. & Herman, J. L. (1991). The Apple Classrooms of Tomorrow. 1990 evaluation study. Report to Apple Computer, Inc. Los Angeles: University of California. Center for the Study of Evaluation
2. Brennan, R. L. (1983). Elements of generalize theory Iowa City, I A: ACT Publications
3. Calfee, R.C., & Perfumo, P. A. (1992). A survey of portfolio practices. Berkeley: University of California, Center for the Study of Writing
4. Camp, R. (1993). The place of portfolios in our changing views of writing assessment. In R, E. Bennett & W, C. Ward (Eds.), Construction versus choice in cognitive measurement: Issues in constructed response, performance testing, and portfolio assessment (pp. 183-212). Hillsdale. NJ: Erlbaum
5. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37-45
6. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory New York: Holt, Rinehart and Winston
7. Freedman, S. (1993). Linking large-scale testing and classroom portfolio assessments of student writing. Educational Assessment. 1(1), 27-52
8. Gearhart, M. & Herman, J. L. (1995, Winter). Portfolio assessment: Whose work is it? Issues in the use of classroom assignments for accountability. Evaluation Comment, 1-16
9. Gearhart, M., Herman, J.L., Novak, J. R., Wolf, S. A. & Abedi, J. (1994). Toward the instructional utility of large-scale writing assessment: Validation of a new narrative rubric (CSE Tech, Rep. No. 389). Los Angeles: University of California, Center for Research on Evaluation. Standards, and Student Testing
10. Gearhart, M., Herman, J.L., & Novak, J. R. (in press). Issues in portfolio assessment: The scorability of narrative collections. (CSE Tech. Rep.). Los Angeles: University of California, Center for Research on Evaluation, Standards, and Student Testing
11. Gearhart, M., Herman, J.L., Baker, E.L., & Whittaker, A. K. (1992). Writing portfolios at the elementary level: A study of methods for writing assessment (CSE Tech, Rep. No. 337). Los Angeles: University of California, Center for Research on Evaluation, Standards, and Student Testing
12. Gearhart, M. & Wolf, S. A. (1994). Engaging teachers in assessment of their students* writing: The role of subject matter knowledge. Assessing Writing, I. 67-90
13. Gearhart, M., Wolf, S.A., Burkey, B. & Whittaker A K. (1994). Engaging teachers in assessment of their students' narrative writing: Impact on teachers' knowledge and practice (CSE Tech. Rep. 377). Los Angeles: University of California, Center for Research on Evaluation, Standards, and Student Testing
14. Herman, J.L., Gearhart, M., & Aschbacher, P. R. (in press). Portfolios for classroom assessment: Design and implementation issues. In R, C. Calfee (Ed.), Portfolio assessment
15. Herman, J.L., Gearhart, M. & Baker, E. L. (1993). Assessing writing portfolios: Issues in the validity and meaning of scores. Educational Assessment, 7(3), 201-224
16. Herman, J.L., & Winters, L. (1994). Portfolio research: A slim collection. Educational Leadership, 52(2), 48-55
17. Hewitt, G. (1991). Leading and learning: A portfolio of change in Vermont schools (Technical Report). Vermont: Governor's Institutes
18. Hewitt, G. (1993, May-June). Vermont's portfolio-based writing assessment program: A brief history. Teachers and Writers, 24(5), 1-6
19. Hiebeit, F., & Calfee, R. C. (1992). Assessment of literacy: From standardized tests to performances and portfolios. In A, E. Fastrup & S, J. Samuels (Eds.), What research says about reading instruction (pp. 70-100). Newark, DE: International Reading Association
20. Hill, R. (1992, June). Assessments developed in support of educational reform in contrast to assessments developed in support of educational refinement. Paper presented at the Assessment Conference of the Education Commission of the States, Boulder. CO
21. Koretz, D., McCaffrey, D., Klein, S., Bell, R., & Stecher, B. (1993). The reliability of scores from the 1992 Vermont Portfolio Assessment Program (CSE Tech. Rep. 355). Los Angeles: University of California, Center for Research on Evaluation, Standards, and Student Testing
22. Koretz, D., Stecher, B., Klein, S., & McCaffrey, D. (in press). The Vermont Portfolio Assessment Program: Findings and implications. Educational Measurement: Issues and Practice, 75(3)
23. LeMahieu, P.G., Eresh, J. T. & Wallace, R. C. (1992, December). Using student portfolios for a public accounting. School Administrator, 49(11), 8-15
24. LeMahieu, P.G., Gitomer, D.H., & Eresh, J. T. (in press). Portfolios in large-scale assessment: Difficult but not impossible. Educational Measurement: Issues and Practice
25. Messick, S. (1992). Validity of test interpretation and use. In M. Alkin (Ed.), Encyclopedia of Educational Research (6th ed., pp. 1487-1495). New York: Macmillan
26. Mills, R.P., & Brewer, W. R. (1988). Working together to show results: An approach to school accountability in Vermont. Montpelier: Vermont Department of Education, October 18/November 10
27. Moss, P. A. (1992). Portfolios, accountability, and an interpretive approach to validity. Educational Measurement: Issues and Practice, 77(3), 12-21
28. Murphy, S., & Smith, M. (1990, Spring). Talking about portfolios. The Quarterly of the National Writing Project and the Center for the Study of Writing (University of California at Berkeley), 72(2), 1-3, 24-27
29. O'Neil, J. (1992). Putting performance assessment to the test. Educational Leadership, 49(8), 14-19
30. Paulson, F.L., Paulson, P.R., & Meyer, C. A. (1991, February). What makes a portfolio a portfolio? Educational Leadership, 48(5), 60-63
31. Reidy, E. (1992, June). What does a realistic state assessment program look like in the near term? Paper presented at the annual ECS/CDE meeting, Boulder. Colorado
32. Resnick, L.B., & Resnick, D. P. (1989). Assessing the thinking curriculum: New tools for educational reform. In B, R. Gifford & M, C. O'Conner (Eds.), Future assessments: Changing views of aptitude, achievement, and instruction (pp. 37-75). Boston, MA: Kluwer
33. Saylor, K., & Overton, J. (1993, March). Kentucky writing and math portfolios. Paper presented at the National Conference on Creating the Quality School
34. Shavelson, R.J., & Webb, N. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage
35. Sheingold, K. (1994, September). Designing a large-scale portfolio assessment system for classroom consequences. Presentation at the 1994 CRESST Conference: Getting Assessment Right! Los Angeles
36. Simmons, J. (1990). Portfolios as large-scale assessment. Language Arts, 67, 262-268
37. Tierney, R.J., Carter, M.A., & Desai, L. E. (1991). Portfolio assessment in the reading writing classroom. Norwood, MA: Christopher Gordon
38. Valencia, S. W., & Calfee, R. C. (1991). The development and use of literacy portfolios for students, classes, and teachers. Applied Educational Measurement, 4, 333-345
39. Vermont Department of Education. (1990, September). Vermont writing assessment: The pilot year. Montpelier, VT: Author
40. Vermont Department of Education. (1991a). "This is my best": Vermont's writing assessment program, pilot year 1990-1991. Montpelier, VT: Author
41. Vermont Department of Education. (1991b). Looking beyond "The Answer": The report of Vermont's Mathematics Portfolio Assessment Program. Montpelier, VT: Author [undatedj
42. Vermont Department of Education. (1991c). Vermont Mathematics Portfolio Project: Resource book. Montpelier, VT: Author
43. Vermont Department of Education. (1991d). Vermont Mathematics Portfolio Project: Teacher's guide. Montpelier, VT: Author
44. Wolf, D.P., Bixby, J., Glenn, J. & Gardner, H. (1991). To use their minds well: Investigating new forms of student assessment. In G. Grant (Ed.), Review of Research in Education (Vol. 17, pp. 31-74). Washington, DC: American Educational Research Association
45. Wolf, S.A., & Gearhart, M. (1993a). Writing What You Read: Assessment as a learning event (CSE Tech. Rep. 358). Los Angeles: University of California, Center foT Research on Evaluation, Standards, and Student Testing
46. Wolf, S.A., & Gearhart, M. (1993b). Writing What You Read: A guidebook for the assessment of children's narratives (CSE Resource Paper No. 10). Los Angeles: University of California, Center for Research on Evaluation, Standards, and Student Testing
47. Wolf, S.A., & Gearhart, M. (1994). Writing What You Read: A framework for narrative assessment. Language Arts, 71(6), 425-445
48. Wolf, S.A., & Gearhart, M. (1995, April). Engaging teachers in assessment of their students' narrative writing: Patterns of impact and implications for professional development. Presentation for the panel symposium entitled, "The impact of alternative assessments on teachers' knowledge and practice," annual meeting of the American Educational Research Association, San Francisco