Summative assessment of portfolios: An examination of different approaches to agreement over outcomes

Studies in Higher Education

Volumn 29, Issue 3, 2004, Pages 395-412

  Johnston, Brenda ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 2542620606     PISSN: 03075079     EISSN: None     Source Type: Journal    
DOI: 10.1080/03075070410001682646     Document Type: Article

References (67)

1. Adams St Pierre, E. (2000) Poststructural feminism in education: an overview, Qualitative Studies in Education, 13, 477-515.
2. Allen, M. (1995) Valuing differences: Portnet's first year. Assessing Writing, 2, 67-89.
3. Applebee, A., Langer, J. A. & Mullis, I. V. S. (1990) The Writing Report Card, 1984-1988: findings from the nation's Report Card (Princeton, NJ, National Assessment of Educational Progress).
4. Assessment in Education (1998) Editorial, Vol. 5, 301-307.
5. Baume, D. & Yorke, M. (2002) The reliability of assessment by portfolio on a course to develop and accredit teachers in higher education, Studies in Higher Education, 27, 7-25.
6. Becker, H., Geer, B. & Hughes, E. (1968) Making the grade: the academic side of college life (New York, John Wiley).
7. Berlin, J. (1994) The subversions of the portfolio, in: L. Black, D. Daiker, J. Sommers, & G. Stygall (Eds) New directions in portfolio assessment: reflective practice, critical theory and large-scale scoring (Portsmouth, NH, Boynton/Cook).
8. Black, L., Daiker, D., Sommers, J. & Stygall, G. (1994) Writing like a woman and being rewarded for it? Gender, assessment and reflective letters from Miami University's student portfolios, in: L. Black, D. Daiker, J. Sommers, & G. Stygall (Eds) New directions in portfolio assessment: reflective practice, critical theory and large-scale scoring (Portsmouth, NH, Boynton/Cook).
9. Black, P. & Wiliam, D. (1998) Assessment and classroom learning, Assessment in Education, 5, 7-74.
10. Bourdieu, P. (1997) The state nobility (Cambridge, Polity Press).
11. Britton, J., Burgess, T., Martin, N., Mcleod, A. & Rosen, H. (1975) The development of writing abilities (London, Macmillan).
12. Broad, B. (1994) 'Portfolio scoring': a contradiction in terms, in: L. Black, D. Daiker, J. Sommers, & G. Stygall (Eds) New directions in portfolio assessment: reflective practice, critical theory and large-scale scoring (Portsmouth, NH, Boynton/Cook).
13. Broad, B. (2000) Pulling your hair out: crises of standardization in communal writing assessment, Research in the Teaching of English, 35, 213-260.
14. Broadfoot, P. M. (1996) Education, assessment and society (Buckingham, Open University Press).
15. Brown, G., Bull, J. & Pendlebury, M. (1997) Assessing student learning in higher education (London, Routledge).
16. Centra, J. A. (1994) The use of the teaching portfolio and student evaluations for summative evaluation Journal of Higher Education, 65, 555-570.
17. Challis, M. (1999) AMEE [Association for Medical Education in Europe] Medical Education Guide No. 11 (revised): portfolio-based learning and assessment in medical education, Medical Teacher, 21, 370-386.
18. Chilisa, B. (2000) Towards equity in assessment: crafting gender-fair assessment, Assessment in Education, 7, 61-81.
19. Clifford, V. A. (2002) Does the use of journals as a form of assessment put into practice principles of feminist pedagogy? Gender and Education, 14, 109-121.
20. Condon, W. & Hamp-Lyons, L. (1994) Maintaining a portfolio based writing assessment: research that informs program development, in: L. Black, D. Daiker, J. Sommers & G. Stygall (Eds) New directions in portfolio assessment: reflective practice, critical theory and large-scale scoring (Portsmouth, NH, Boynton/Cook).
21. Darling, L. F. (2001) Portfolio as practice: the narratives of emerging teachers. Teaching and Teacher Education, 17, 107-121.
22. Delandshere, G. (2001) Implicit theories, unexamined assumptions and the status quo of educational assessment, Assessment in Education, 8, 113-133.
23. Durst, R., Roemer, M. & Schultz, L. (1994) Portfolio negotiation: acts in speech, in: L. Black, D. Daiker, J. Sommers & G. Stygall (Eds) New directions in portfolio assessment: reflective practice, critical theory and large-scale scoring (Portsmouth, NH, Boynton/Cook).
24. Edwards, A., & Knight, P. (Eds) (1995) Assessing competence (London, Kogan Page).
25. Eisner, E. W. (1984) The art of educational evaluation (London, Falmer Press).
26. Elton, L., & Laurillard, D. (1979) Trends in research on student learnings Studies in Higher Education, 4, 87-102.
27. Fenwick, A., Assiter A. & Nixon N. (1992) Profiling in higher education (London, Council for National Academic Awards).
28. Fish, S. (1980) Is there a text in this class? The authority of interpretive communities (Cambridge, MA, Harvard University Press).
29. Flynn, E. (1988) Composing as a woman, College Composition and Communication, 39, 423-435.
30. Fourali, C. (1997) Using fuzzy logic in educational measurement: the case of portfolio assessments, Evaluation and Research in Education, 11, 129-148.
31. Geerzt, C. (1973) Thick description: towards an interpretive theory of culture, in: C. Geertz (Ed.) The interpretation of culture (New York, Basic Books).
32. Giroux, H. (1992) Border crossings: cultural workers and the politics of education (New York, Routledge).
33. Gore, J. M. (1993) The struggle for pedagogies (New York, Routledge).
34. Guba, E. G., & Lincoln, V. (1989) Fourth generation evaluation (London, Sage).
35. Hanson, F. A. (1993) Testing, testing: social consequences of the examined life (Berkeley, CA, University of California Press).
36. Hartog, P & Rhodes, E. C. (1935) An examination of examinations (London, Macmillan).
37. Heller, J. I., Sheingold, K. & Myford C. M. (1998) Reasoning about evidence in portfolios: cognitive foundational for valid and reliable assessment. Educational Assessment, 5, 5-40.
38. Herman, J. & Winters, L. (1994) Portfolio research: a slim collection, Educational Leadership, 52, 48-55.
39. Heywood, J. (2000) Assessment in higher education: student learning, teaching, programmes and institutions (London, Jessica Kingsley).
40. Huot, B. (1996) Towards a new theory of writing assessment, College Composition and Communication, 47, 549-566.
41. Knight, P. (2002) Summative assessment in higher education: practices in disarray, Studies in Higher Education, 27, 275-286.
42. Kolb, D. A. (1984) Experiential learning (Chicago, IL, Prentice Hall).
43. Koretz, D. (1993) New report of the Vermont portfolio project documents challenges, National Council on Measurement in Education Quarterly Newsletter, 1, 1-2.
44. Kvale, S. (1993) Examinations re-examined: certification of students or certification of knowledge? in S. Chaiklin & J. Lave (Eds) Understanding practice: perspectives on activity and context (New York, Cambridge University Press).
45. LeMahieu, P. G., Gitomer, D. H. & Eresh, J. A. (1995) Portfolios in large-scale assessment: difficult but not impossible, Educational Measurement: issues and practice, 14, 11-16 and 25-28.
46. Marton, F. & Säljö, V. (1984) Approaches to learning, in: F. Marton, D. Hounsell & N. J. Entwistle (Eds) The experience of learning (Edinburgh, Scottish Academic Press).
47. Miller, M. D. & Legg, M. (1993) Alternative assessment in a high-stakes environment, Educational Measurement: issues and practice, 12, 9-15.
48. Moss, P. (1994) Can there be validity without reliability? Educational Researcher, 23, 5-12.
49. Murphy, S. (1994) Portfolios and curriculum reform: patterns in practice, Assessing Writing, 1, 175-206.
50. Musil, C. M. (1992) Students at the centre: feminist assessment (Washington DC, Association of American Colleges).
51. Newble, D. I., Hoare, J. & Sheldrake, P. F. (1980) The selection and training of examiners for clinical examinations, Medical Education, 14, 345-349.
52. Nystrand, M., Cohen, A. S. & Dowling, N. M. (1993) Addressing reliability problems in the portfolio assessment of college writing, Educational Assessment, 1, 53-70.
53. Payne, R. N., Bramhall, M. D., Lawson, J. S., Robinson, I. & Short, C. (1993) Portfolio assessment in practice in engineering, International Journal of Technology and Design Education, 3, 37-42.
54. Pitts, J., Coles, C. & Thomas, P. (1999) Educational portfolios in the assessment of general practice trainers: reliability of assessors, Medical Education, 33, 515-520.
55. Pitts, J., Coles, C. & Thomas, P. (2001) Enhancing reliability in portfolio assessment: 'shaping' the portfolio, Medical Teacher, 23, 351-355.
56. Reckase, M. D. (1995) Portfolio assessment: a theoretical estimate of score reliability. Educational Measurement: issues and practice, 14, 12-14, 31.
57. Reynolds, M. & Trehan, K. (2000) Assessment: a critical perspective, Studies in Higher Education, 25, 267-278.
58. Shapiro, J. P. (1992) What is feminist assessment? in: C. M. Musil (Ed.) Students at the centre: feminist assessment (Washington DC, Association of American Colleges).
59. Simons, H. (1987) Getting to know schools in a democracy: the politics and process of evaluation (Lewes, Falmer Press).
60. Sirc, G. (1989) Gender and 'writing formations' in first year narratives, Freshman English News, 18, 4-11.
61. Snadden, D. & Thomas, M. (1998) The use of portfolio learning in medical education, Medical Teacher, 20, 192-199.
62. Snyder, B. R. (1970) The hidden curriculum (Cambridge, MA, MIT Press).
63. Stake, R. E. & Kerr, D. (1994) Rene Magritte, constructivism, and the researcher as interpreter, paper presented to the Annual Meeting of the American Educational Research Association, New Orleans, April.
64. Supovitz, J., Macgowan, A. & Slattery, V. (1997) Assessing agreement: an examination of the interrater reliability of portfolio assessment in Rochester, New York, Educational Assessment, 4, pp .237-259.
65. Vygotsky, L. S. (1962) Thought and Language (Cambridge, MA, Massachusetts Institute of Technology).
66. Vygotsky, L. S. (1978) Mind in society: the development of higher psychological processes (M. Cole, V. John-Steiner, S. Scribner & E. Souberman, Eds) (Cambridge, MA, Harvard University Press).
67. White, E. (1994) Teaching and assessing writing (San Francisco, CA, Jossey Bass).