An evaluation of semi-automated, collaborative marking and feedback systems: Academic staff perspectives

Australasian Journal of Educational Technology

Volumn 27, Issue 7, 2011, Pages 1135-1154

  Burrows, Steven ^a   Shortis, Mark ^a  

^a RMIT UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 82755162047     PISSN: None     EISSN: 14495554     Source Type: Journal    
DOI: 10.14742/ajet.909     Document Type: Article

References (46)

1. Blackboard (2007). Blackboard SafeAssign Building Blocks Instructor Manual. [viewed 17 Apr 2009 at http://www.cmu.edu/blackboard/how-to/gradecenter/Blackboard_SafeAssign_Building_Blocks_Instructor_Manual.pdf, verified 6 Nov 2011 at https://behind.blackboard.com/s/faculty/refcenter/docs/details.Bb?DocumentID=3911&pid=100&rid=-1&dt=]
2. Blackboard (2011). About the Grade Center. [viewed 26 Oct 2011] http://help.blackboard.com/instructor/Content/_instructor_grade_center/grade_center_about.htm
3. Bull, J., Collins, C., Coughlin, E. & Sharp, D. (2001). Technical review of plagiarism detection software report. Luton, England: University of Luton Computer Assisted Assessment Centre. http://www.jisc.ac.uk/uploaded_documents/luton.pdf
4. Burrows, S. & D'Souza, D. (2005). Management of teaching in a complex setting. In Proceedings of the Second Melbourne Computing Education Conventicle. Melbourne, Australia. [verified 6 Nov 2011] http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.71.6199&rep=rep1&type=pdf
5. Campbell, A. (2005). Application of ICT and rubrics to the assessment process where professional judgement is involved: The features of an e-marking tool. Assessment and Evaluation in Higher Education, 30(5), 529-537. http://dx.doi.org/10.1080/02602930500187055
6. Chapman, O. L. & Fiore, M. A. (2001). Calibrated peer review - a writing and critical thinking instructional tool - the white paper: A description of CPR. Los Angeles: University of California.
7. Colbran, S. (2009). The ReMarks PDF Markup Editor. Canberra, Australia: Australian Learning and Teaching Council.
8. Cole, J. (2005). Workshops. In Using Moodle: Teaching with the popular open source course management system, 95-114. Sebastopol, California: O'Reilly Media.
9. Creative Technology (2009). MarkIn homepage. http://www.cict.co.uk/software/markin
10. Culwin, F. & Lancaster, T. (2000). A review of electronic services for plagiarism detection in student submissions. In Proceedings of the Eighth Annual Conference on the Teaching of Computing. Edinburgh, Scotland: LTSN Centre for Information and Computer Science. http://www.ics.heacademy.ac.uk/events/presentations/317_Culwin.pdf
11. Denton, P. (2003). Returning feedback to students via email using Electronic Feedback 9. Learning and Teaching in Action, 2(1), 1-9. http://www.celt.mmu.ac.uk/ltia/issue4/denton.shtml
12. Dingsdag, D., Armstrong, B. & Neil, D. (2000). Electronic assessment software for distance education students. In Learning to Choose - Choosing to Learn. Proceedings ASCILITE Coffs Harbour 2000. http://www.ascilite.org.au/conferences/coffs00/papers/don_dingsdag.pdf
13. Electronic Assignment Management Project (2011). Functional Requirements: Electronic Assignment Management Project: La Trobe University, Flinders University, Massey University, University of Canberra and University of Southern Queensland. Personal communication, 22 September 2011.
14. Ellis, R. K. (2009). A field guide to learning management systems. In Learning Circuits. Alexandria VA, USA: American Society for Training and Development. http://www.astd.org/NR/rdonlyres/12ECDB99-3B91-403E-9B15-7E597444645D/23395/LMS_fieldguide_20091.pdf
15. Fernandez, G. (2001). WebLearn: A common gateway interface (CGI)-based environment for interactive learning. Journal of Interactive Learning Research, 12(2), 261-276. http://www.editlib.org/p/8422
16. Freney, M. & Wood, D. (2005). CAFAS: An automated computer aided assessment tool for providing student feedback and managing assessment information. In Proceedings of the Fifth Evaluations and Assessment Conference. Curtin University of Technology. http://otl.curtin.edu.au/eac2006/papers/freneywood.pdf
17. Heinrich, E. (2009). Lightwork: Managing marking effectively. In Same places, different spaces. Proceedings ascilite Auckland 2009. http://www.ascilite.org.au/conferences/auckland09/procs/heinrich-poster.pdf
18. Heinrich, E., Milne, J., Crooks, T., Granshaw, B. & Moore, M. (2006). Literature review on the use of learning tools for formative essay-type assessment. In e-Learning Collaborative Development. Wellington, New Zealand: Tertiary Education Commission. http://etools.massey.ac.nz/documents/LitReview101006.pdf
19. Henderson, P. (2008). Electronic grading and marking: A note on Turnitin's GradeMark function. History Australia, 5(1), 11.1-11.2. http://journals.publishing.monash.edu/ojs/index.php/ha/article/download/275/288
20. Hepplestone, S., Holden, G., Irwin, B., Parkin, H. J. & Thorpe, L. (2011). Using technology to encourage student engagement with feedback: A literature review. Research in Learning Technology, 19(2), 117-127. http://dx.doi.org/10.1080/21567069.2011.586677
21. Higgins, R., Hartley, P. & Skelton, A. (2002). The conscientious consumer: Reconsidering the role of assessment feedback in student learning. Studies in Higher Education, 27(1), 53-64. http://dx.doi.org/10.1080/03075070120099368
22. iParadigms (2009). Turnitin GradeMark. [viewed 6 May 2009; not found 6 Nov 2011]. http://turnitin.com/static/grademark.html
23. iParadigms (2011). GradeMark. [viewed 26 Oct 2011]. https://turnitin.com/static/products/grademark.php
24. Jackson, D. & Usher, M. (1997). Grading student programs using ASSYST. In Proceedings of the Twenty-Eighth SIGCSE Technical Symposium on Computer Science Education. San Jose, California: ACM Press. http://dx.doi.org/10.1145/268084.268210
25. Joy, M. & Luck, M. (1998). Effective electronic marking for on-line assessment. In Proceedings of the Sixth Annual Conference on the Teaching of Computing and the Third Annual Conference on Integrating Technology into Computer science Education: Changing the Delivery of Computer Science Education. Dublin, Ireland: ACM Press. http://dx.doi.org/10.1145/282991.283096
26. Mason, D., Woit, D., Abdulla, A., Barakat, H., D'Souza, M. & Pires, C. (1999). Web-based evaluation for the convenience of students, markers, and faculty. In Proceedings of the Fifth International Conference on Web-Based Learning. Fredericton, Canada: WWW Courseware Developers. http://naweb.unb.ca/99/proceedings/mason/
27. McAlpine, I., Reidsema, C. & Allen, B. (2006). Educational design and online support for an innovative project-based course in engineering design. In Who's Learning? Whose Technology? Proceedings ASCILITE Sydney 2006. http://www.ascilite.org.au/conferences/sydney06/proceeding/pdf_papers/p168.pdf
28. McKenzie, S. (2004). Assessing quality of feedback in online marking databases: An opportunity for academic professional development or just Big Brother? In Beyond the comfort zone. Proceedings ASCILITE Perth 2004. http://www.ascilite.org.au/conferences/perth04/procs/mckenzie.html
29. Nicol, D. (2010). From monologue to dialogue: Improving written feedback processes in mass higher education. Assessment and Evaluation in Higher Education, 35(5), 501-517. http://dx.doi.org/10.1080/02602931003786559
30. Prechelt, L., Malpohl, G. & Philippsen, M. (2002). Finding plagiarisms among a set of programs with JPlag. Journal of Universal Computer Science, 8(11), 1016-1038. http://dx.doi.org/10.3217/jucs-008-11-1016
31. Price, M., Handley, K., Millar, J. & O'Donovan, B. (2010). Feedback: All that effort, but what is the effect? Assessment and Evaluation in Higher Education, 35(3), 277-289. http://dx.doi.org/10.1080/02602930903541007
32. Radcliffe, P. J. & Rudolph, H. (2007). Plagiarism: A survival strategy or recipe for disaster? In Proceedings of the Eighteenth Annual Conference of the Australasian Association for Engineering Education. Melbourne, Australia. http://www.aaee.com.au/conferences/papers/2007/paper_51.pdf
33. Savage, S. (2004). Staff and student responses to a trial of Turnitin plagiarism detection software. In Proceedings of the Third Australian Universities Quality Forum. Adelaide, Australia: Australian Universities Quality Agency. http://www.auqa.edu.au/files/publications/auqf2004_proceedings.pdf
34. Schleimer, S., Wilkerson, D. & Aiken, A. (2003). Winnowing: Local algorithms for document fingerprinting. In Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data. San Diego CA: ACM Press. http://dx.doi.org/10.1145/872757.872770
35. Sheader, E., Gouldsborough, I. & Grady, R. (2006). Staff and student perceptions of computerassisted assessment for physiology practical classes. Advances in Physiology Education, 30, 174-180. http://advan.physiology.org/content/30/4/174.full
36. Shortis, M. R. & Burrows, S. (2009). A review of the status of online, semi-automated marking and feedback systems. In ATN Assessment Conference 2009. Melbourne, Australia: RMIT University. http://emedia.rmit.edu.au/conferences/index.php/ATNAC/ATNAC09/paper/viewFile/205/46
37. Skeele, R. W., Carr, V. B., Martinelli, J. & Sardone, N. B. (2007). Innovation in e-assessment: Exploring a multidimensional tool. In Proceedings of the 2007 World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education. Quebec City, Canada. http://editlib.org/p/26368
38. Sondergaard, H. (2009). Personal communication.
39. Stevens, K. & Jamieson, R. (2002). The introduction and assessment of three teaching tools (WebCT, Mindtrail, EVE) into a post graduate course. Journal of Information Technology Education, 1(4), 233-252. http://jite.org/documents/Vol1/v1n4p233-252.pdf
40. Tahaghoghi, S. M. M. & Williams, H. E. (2004). The WebMark course management system. In International Conference on Computing in Education (ICCE). Melbourne, Australia.
41. Thomas, P. & Taylor, D. (2000). Reducing the distance in distance education. In Proceedings of the Fourth Computer-Assisted Assessment Conference. Loughborough, England: Loughborough University. http://hdl.handle.net/2134/1786
42. Thompson, D. (2007). Integrating graduate attributes with student self-assessment. In Proceedings of the Connected 2007 International Conference on Design Education. Sydney, Australia. http://hdl.handle.net/10453/3008
43. UTS (2009). CommentManager: An online system for commenting on students' work. [viewed 6 May 2009; not found 6 Nov 2011]. http://www.iml.uts.edu.au/assessment/feedback/commentmanager.html
44. Valenti, S., Neri, F. & Cucchiarelli, A. (2003). An overview of current research on automated essay grading. Journal of Information Technology Education, 2, 319-330. http://jite.org/documents/Vol2/v2p319-330-30.pdf
45. Willey, K. & Gardner, A. (2009). Assessment for learning: Using minor assessment to promote major learning. In ATN Assessment Conference 2009, RMIT University. http://epress.lib.uts.edu.au/research/handle/10453/11389
46. Willis, H., Gravestock, P. & Jenkins, M. (2006). Throwing a pebble into the pond: E-portfolios and student engagement. In Who's Learning? Whose Technology? Proceedings ASCILITE Sydney 2006. http://www.ascilite.org.au/conferences/sydney06/proceeding/pdf_papers/p68.pdf