Reliability and validity of Web-based portfolio peer assessment: A case study for a senior high school's students taking computer course

Computers and Education

Volumn 57, Issue 1, 2011, Pages 1306-1316

  Chang, Chi Cheng ^a   Tseng, Kuo Hung ^b   Chou, Pao Nan ^c   Chen, Yi Hui ^a  

^a NATIONAL TAIWAN NORMAL UNIVERSITY   (Taiwan)

^b MEIHO UNIVERSITY   (Taiwan)

^c NATIONAL UNIVERSITY OF TAINAN   (Taiwan)

Author keywords

Learning portfolios; Peer assessment; Web based learning portfolios; Web based portfolio assessment

Indexed keywords

HIGH SCHOOL; LEARNING ACHIEVEMENT; LEARNING PORTFOLIO; PEER ASSESSMENT; RELIABILITY AND VALIDITY; WEB BASED LEARNING; WEB-BASED PORTFOLIO ASSESSMENT;

RATING; RELIABILITY; STUDENTS; TEACHING;

E-LEARNING;

EID: 79951945375     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2011.01.014     Document Type: Article

References (52)

1. R. Ballantyne, K. Hughes, and A. Mylonas Developing procedures for implementing peer assessment in large classes using an action research process Assessment & Evaluation in Higher Education 27 5 2002 427 441
2. S. Bloxham, and A. West Understanding the rules of the game: marking peer assessment as a medium for developing students' conceptions of assessment Assessment & Evaluation in Higher Education 29 6 2004 721 733
3. L. Bouzidi, and A. Jaillet Can online peer assessment be trusted? Educational Technology & Society 12 4 2009 257 268
4. C.B. Burch Inside the portfolio experience: the student's perspective English Education 32 1 1999 34 49
5. C.-C. Chang A study on the evaluation and effectiveness analysis of web-based learning portfolio (WBLP) British Journal of Educational Technology 32 4 2001 435 458 (Pubitemid 33670351)
6. C.-C. Chang Enhancing self-perceived effects using web-based portfolio assessment Computers in Human Behavior 24 3 2008 1753 1771
7. C.-C. Chang, and K.-H. Tseng Using a Web-based portfolio assessment system to elevate project-based learning performances Interactive Learning Environments 16 2 2009 25 37
8. C.-C. Chang, and K.-H. Tseng Use and performances of web-based portfolio assessment British Journal of Educational Technology 40 2 2009 358 370
9. C.-H. Chen The implementation and evaluation of a mobile self- and peer-assessment system Computers & Education 55 1 2010 229 236
10. K. Cho, C. Schunn, and R. Wilson Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives Journal of Educational Psychology 98 4 2006 891 901 (Pubitemid 44747846)
11. P. Davies Computerized peer assessment Innovations in Education and Training International 37 4 2000 346 355 (Pubitemid 33206616)
12. C. Derham, and J. Diperna Digital professional portfolios of preservice teaching: an initial study of score reliability and validity International Journal of Technology and Teacher Education 15 3 2007 363 381
13. ePortfolio Portal A generic rubric for evaluating ePortfolios from http://www.danwilton.com/eportfolios/rubric.php 2009 Retrieved February 22, 2010
14. N. Falchikov, and J. Goldfinch Student peer assessment in higher education: a meta-analysis comparing peer and teacher marks Review of Educational Research 70 3 2000 287 322 (Pubitemid 33282484)
15. C.C. Gadbury-Amyot, J. Kim, R.L. Palm, E. Mills, E. Noble, and P. Overman Validity and reliability of portfolio assessment of competency in a baccalaureate dental hygiene program Journal of Dental Education 67 9 2003 991 1002
16. Gadbury-Amyot, C. Validity and reliability of portfolio assessment of competency in a baccalaureate dental hygiene program. Unpublished doctoral dissertation. (2003) University of Missouri-Kansas City.
17. Gelinas, A. M. Issue of reliability and validity in using portfolio assessment to measure foreign language teacher performance. Unpublished doctoral dissertation. (1998) Ohio State University, Columbus, Ohio.
18. G. Gibbs How assessment frames student learning C. Bryan, K. Clegg, Innovative assessment in higher education 2006 Routledge London 23 36
19. M. Jenkins Unfulfilled promise: formative assessment using computer-aided assessment Learning and Teaching in Higher Education 1 2004 67 80
20. R.L. Johnson, F. McDaniel, and M.J. Willeke Using portfolios in program evaluation: an investigation of interrater reliability American Journal of Evaluation 21 1 2000 65 81
21. A.M.D. Lankes Portfolios: a new wave in assessment Technological Horizons in Education Journal 25 9 1998 18 19
22. J. Lenze Inter-rater reliability in the evaluation of electronic portfolios: a survey of empirical research results R. Ferdig, Proceedings of society for information technology & teacher education international conference 2004 2004 AACE Chesapeake, VA 164 169
23. S.-J. Lin, Z.-F. Liu, and S.-M. Yuan Web-based peer assessment: attitude and achievement IEEE Transactions on Education 44 2 2001 13
24. S.-J. Lin, Z.-F. Liu, and S.-M. Yuan Web-based peer assessment: feedback for students with various thinking-styles Journal of Computer Assisted Learning 17 4 2001 420 432
25. Liu, Z.-F. Studies of networked peer assessment. Unpublished doctoral dissertation. (2002) National Chiao Tung University: Hsinchu.
26. Z.-F. Liu, S.-J. Lin, C.-H. Chiu, and S.-M. Yuan Web-based peer review: the learner as both adapter and reviewer IEEE Transactions on Education 44 3 2001 246 251 (Pubitemid 32945776)
27. P.J. Miller The effect of scoring criteria specificity on peer and self-assessment Assessment & Evaluation in Higher Education 28 4 2003 383 394 (Pubitemid 36530227)
28. J.L. Morris Rubric for assessing electronic portfolios http://www.uvm.edu//%7Ejmorris/ 2007
29. C.-H. Ou Educational test and assessment 2002 Psychological Publishing Co. Taipei
30. O. Oskay, M. Schallies, and I. Morgil A closer look at findings from recent publication. H. U Journal of Education 35 2008 263 272
31. M. Price, and B. O'Donovan Improving performance through enhancing student understanding of criteria and feedback C. Bryan, K. Clegg, Innovative assessment in higher education 2006 Routledge London, UK 100 109
32. F.J. Prins, D.M.A. Sluijsmans, P.A. Kirschner, and J.-W. Strijbos Formative peer assessment in a CSCL environment: a case study Assessment & Evaluation in Higher Education 30 4 2005 417 444 (Pubitemid 40639783)
33. Rcampus iRubric: ePortfolio rubric 2010 University of New England from http://www.rcampus.com/rubricshowc.cfm?code%3DW38X23%26sp%3Dtrue%26 Retrieved February 22, 2010
34. Reckase, M. A. Portfolio define. Paper presented at the workshop of portfolio assessment (2002) Taipei, Taiwan.
35. R. Rice Composing the Internet-based electronic portfolio using "common" tools B.L. Cambridge, S. Kahn, D.P. Tompkins, K.B. Yancey, Electronic portfolios - Emerging practice in student, faculty, and institutional learning 2001 American Association for Higher Education Press Washington, DC 37 43
36. P. Sadler, and E. Good The impact of self- and peer-grading on student learning Educational Assessment 11 1 2006 1 31 (Pubitemid 43427490)
37. D. Sluijsmans, F. Dochy, and G. Moerkerke Creating a learning environment by using self-, peer-, and co-assessment Learning Environments Research 1 3 1999 293 319
38. J. Sulzen, M. Young, and R. Hannifin Reliability and validity of an ecologically-grounded student teacher electronic portfolio rubric K. McFerrin, Proceedings of society for information technology & teacher education international conference 2008 2008 AACE Chesapeake, VA 153 159
39. Y.-T. Sung, K.-E. Chang, S.-K. Chiou, and H.-T. Hou The design and application of a web-based self and peer-assessment system Computers & Education 45 2005 187 202 (Pubitemid 40423517)
40. Y.-T. Sung, C.-S. Lin, C.-L. Lee, and K.-E. Chang Evaluating proposals for experiments: an application of web-based self-assessment and peer-assessment Teaching of Psychology 30 4 2003 331 334 (Pubitemid 37514453)
41. R. Sweat-Guy, and N. Buzzetto-More A comparative analysis of common e-portfolio platforms and available features Issues in Informing Science and Information Technology Education 5 1 2007 327 342
42. K.J. Topping Peer assessment between students in colleges and universities Review of Educational Research 68 3 1998 249 276
43. K.J. Topping, E.F. Smith, I. Swanson, and A. Elliot Formative peer assessment of academic writing between postgraduate students Assessment & Evaluation in Higher Education 25 2 2000 149 169
44. C.-C. Tsai, and J.-C. Liang The development of science activities via on-line peer assessment: the role of scientific epistemological views Instructional Science 37 2009 293 310
45. C.-C. Tsai, S.J. Lin, and S.-M. Yuan Developing science activities through a networked peer assessment system Computers & Education 38 2002 241 252
46. S.-C. Tseng, and C.-C. Tsai On-line peer assessment and the role of the peer feedback: a study of high school computer course Computers & Education 49 4 2007 1161 1174 (Pubitemid 47284638)
47. University of Wisconsin-Stout Evaluating your portfolio http://www.uwstout.edu/art/artedportfolios/evaluating/portevaluatiorubric.html 2010 Retrieved February 22, 2010, from
48. L.M.C. Wen, and C.-C. Tsai University students' perceptions of and attitudes toward (online) peer assessment Higher Education 51 2006 27 44 (Pubitemid 43152866)
49. Worcester, T. (2000). Electronic portfolio scoring rubric. Retrieved February 7, 2011, from http://www.sv400.k12.ks.us/port/rubric.html.
50. K.B. Yancey General patterns and the future B.L. Cambridge, S. Kahn, D.P. Tompkins, K.B. Yancey, Electronic portfolios - Emerging practice in student, faculty, and institutional learning 2001 American Association for Higher Education Press Washington, DC 83 87
51. Y.-F. Yang, and C.-C. Tsai Conceptions of and approaches to learning through online peer assessment Learning and Instruction 20 2010 72 83
52. B.J. Zimmerman, S. Bonner, and R. Kovach Developing self-regulated learners: Beyond achievement to self-efficacy 1996 American Psychological Association Washington, DC