Marking extended essays on screen: Exploring the link between marking processes and comprehension

E-Learning and Digital Media

Volumn 9, Issue 1, 2012, Pages 50-68

  Johnson, Martin ^a   Hopkin, Rebecca ^a   Shiell, Hannah ^a  

^a University of Cambridge Local Examinations Syndicate   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84863419591     PISSN: 17418887     EISSN: 20427530     Source Type: Journal    
DOI: 10.2304/elea.2012.9.1.50     Document Type: Article

References (60)

1. Anderson, T.H. & Armbruster, B.B. (1982) Reader and Text-Studying Strategies, in W. Otto & S. White (Eds) Reading Expository Material. London, Academic Press.
2. Benson, P.J. (2001) The More Things Change... Paper Is Still with Us, Journal of Electronic Publishing, 7(2). http://www.press.umich.edu/jep/07-02/benson0702.html (accessed 25 August 2005).
3. Chang, S.L. & Ley, K. (2006) A Learning Strategy to Compensate for Cognitive Overload in Online Learning: learner use of printed online materials, Journal of Interactive Online Learning, 5(1), 104-117.
4. Coniam, D. (2009) A Comparison of Onscreen and Paper-Based Marking in the Hong Kong Public Examination System, Educational Research and Evaluation, 15(3), 243-263. http://dx.doi.org/10.1080/13803610902972940
5. Coniam, D. (2010) A Qualitative Examination of the Attitudes of Liberal Studies Markers towards Onscreen Marking in Hong Kong, British Journal of Educational Technology. http://dx.doi.org/10.1111/j.1467-8535.2010.01136.x
6. Coniam, D. (2011) The Comparability of Marking On Screen and On Paper: the case of liberal studies in Hong Kong, Journal of Educational Technology Systems, 39(4), 453-469. http://dx.doi.org/10.2190/ET.39.4.g
7. Creed, A., Dennis, I. & Newstead, S. (1987) Proof-Reading on VDUs, Behaviour and Information Technology, 6(1), 3-13. http://dx.doi.org/10.1080/01449298708901814
8. Crisp, V. & Johnson, M. (2007) The Use of Annotations in Examination Marking: opening a window into markers' minds, British Educational Research Journal, 33(6), 943-961. http://dx.doi.org/10.1080/01411920701657066
9. Dillon, A. (1994) Designing Usable Electronic Text. London: Taylor & Francis. http://dx.doi.org/10.4324/9780203470343
10. Fowles, D. (2008) Does Marking Images of Essays on Screen Retain Marker Confidence and Reliability? Paper presented at the International Association for Educational Assessment Annual Conference, 7-12 September, Cambridge.
11. Fowles, D. & Adams, C. (2005) How does Assessment Differ when e-Marking Replaces Paper-Based Marking? Paper presented at the 31st International Association for Educational Assessment Conference, 4-9 September, Abuja, Nigeria.
12. Gibson, J.J. (1979) The Ecological Approach to Visual Perception. Boston, MA: Houghton Mifflin.
13. Gould, J.D. & Grischowsky, N. (1984) Doing the Same Work with Hard Copy and with Cathode-Ray Tube (CRT) Computer Terminals, Human Factors, 26, 323-337.
14. Guthrie, J. (1998) Locating Information in Documents: examination of a cognitive model, Reading Research Quarterly, 23, 178-199. http://dx.doi.org/10.2307/747801
15. Hansen, W.J. & Haas, C. (1988) Reading and Writing with Computers: a framework for explaining differences in performance, Communications of the ACM, 31(9), 1080-1089. http://dx.doi.org/10.1145/48529.48532
16. Harpster, J.L. (1989) Visual Performance on CRT Screens and Hard Copy Displays, Human Factors, 31(3), 247-257.
17. Hartley, J. (2002) Notetaking in Non-academic Settings, Applied Cognitive Psychology, 16, 559-574. http://dx.doi.org/10.1002/acp.814
18. Hartley, J. & Davies, I.K. (1978) Note-Taking: a critical review, Innovation in Education and Teaching International, 15(3), 207-224.
19. Holsti, O.R. (1969) Content Analysis for the Social Sciences and Humanities. Menlo Park, CA: Addison Wesley.
20. Hornbæk, K. & Frøkjær, E. (2001) Reading Electronic Documents: the usability of linear, fisheye, and overview detail interfaces, Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI Letters, 3(1), 293-300.
21. Hsieh, G., Wood, K.R. & Sellen, A. (2006) Peripheral Display of Digital Handwritten Notes, CHI 2006 Proceedings, Montréal, Québec.
22. Huot, B. (1990) Reliability, Validity and Holistic Scoring: what we know and what we need to know, College Composition and Communication, 41, 210-213. http://dx.doi.org/10.2307/358160
23. Inhoff, A.W. & Weger, U.W. (2005) Memory for Word Location during Reading: eye movements to previously read words are spatially selective but not precise, Memory and Cognition, 33(3), 447-461. http://dx.doi.org/10.3758/BF03193062
24. Johnson, M. & Greatorex, J. (2008) Judging Text Presented on Screen: implications for validity, E-Learning, 5(1), 40-50. http://dx.doi.org/10.2304/elea.2008.5.1.40
25. Johnson, M., Hopkin, R., Shiell, H. & Bell, J.F. (forthcoming) Extended Essay Marking on Screen: is examiner marking accuracy influenced by marking mode? Educational Research and Evaluation.
26. Johnson, M. & Nádas, R. (2009a) An Investigation into Marker Reliability and Some Qualitative Aspects of On-Screen Essay Marking, Research Matters, 8, 2-7.
27. Johnson, M. & Nádas, R. (2009b) Marginalised Behaviour: digital annotations, spatial encoding and the implications for reading comprehension, Learning, Media and Technology, 34(4), 323-336. http://dx.doi.org/10.1080/17439880903338606
28. Johnson, M., Nádas, R. & Bell, J.F. (2009) Marking Essays on Screen: an investigation into the reliability of marking extended subjective texts, British Journal of Educational Technology, 41, 814-826. http://dx.doi.org/10.1111/j.1467-8535.2009.00979.x
29. Johnson, M. & Shaw, S. (2008) Annotating to Comprehend: a marginalised activity? Research Matters, 6, 19-24.
30. Johnson-Laird, P.N. (1983) Mental Models: towards a cognitive science of language, inference and consciousness. Cambridge MA: Harvard University Press.
31. Just, M.A. & Carpenter, P.A. (1992) A Capacity Theory of Comprehension: individual differences in working memory, Psychological Review, 98, 122-149. http://dx.doi.org/10.1037/0033-295X.99.1.122
32. Kurniawan, S.H, & Zaphiris, P. (2001) Reading Online or On Paper: which is faster? Proceedings of HCI International 2001. Mahwah, NJ: Lawrence Erlbaum Associates.
33. Marshall, C.C. & Bly, S. (2005) Turning the Page on Navigation, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries, 7-11 June 2005, Denver, CO, pp. 225-234. http://dx.doi.org/10.1145/1065385.1065438
34. Mayes, D.K., Sims, V.K. & Koonce, J.M. (2001) Comprehension and Workload Differences for VDT and Paper-Based Reading, International Journal of Industrial Ergonomics, 28, 367-378. http://dx.doi.org/10.1016/S0169-8141(01)00043-9
35. Mills, C.B. & Weldon, L.J. (1987) Reading Text from Computer Screens, ACM Computing Surveys, 19(4), 329-358. http://dx.doi.org/10.1145/45075.46162
36. Muter, P., Latremouille, S.A., Treurniet, W.C. & Beam, P. (1982) Extended Reading of Continuous Texts on Television Screens, Human Factors, 24, 501-508.
37. Muter, P. & Maurutto, P. (1991) Reading and Skimming from Computer Screens and Books: the paperless office revisited? Behaviour and Information Technology, 10(4), 257-266. http://dx.doi.org/10.1080/01449299108924288
38. Noyes, J.M. & Garland, K.J. (2003) VDT versus Paper-Based Text: reply to Mayes, Sims and Koonce, International Journal of Industrial Ergonomics, 31(6), 411-423. http://dx.doi.org/10.1016/S0169-8141(03)00027-1
39. Noyes, J., Garland, K. & Robbins, L. (2004) Paper-Based Versus Computer-based Assessment: is workload another test mode effect? British Journal of Educational Technology, 35(1), 111-113. http://dx.doi.org/10.1111/j.1467-8535.2004.00373.x
40. O'Hara, K. & Sellen, A. (1997) A Comparison of Reading Paper and On-line documents, in S. Pemberton (Ed.) Proceedings of the ACM Conference on Human Factors in Computing Systems, pp. 335-342. Atlanta: ACM Press. http://dx.doi.org/10.1145/258549.258787
41. Piolat, A., Roussey, J-Y. & Thunin, O. (1997) Effects of Screen Presentation on Text Reading and Revising, International Journal of Human-Computer Studies, 47, 565-589. http://dx.doi.org/10.1006/ijhc.1997.0145
42. Precel, K., Eshet-Alkalai, Y. & Alberton, Y. (2009) Pedagogical and Design Aspects of a Blended Learning Course, International Review of Research in Open and Distance Learning, 19(2), 469-508.
43. Price, B. & Petre, M. (1997) Teaching Programming through Paperless Assignments: an empirical evaluation of instructor feedback, Proceedings of ITiCSE, ACM SIGCSE/SIGCUE Conference on Integrating Technology into Computer Science Education. June 1-5. New York: Association for Computing Machinery.
44. Rose, E. (2011) The Phenomenology of On-Screen Reading: university students' lived experiences of digitised text, British Journal of Education Technology, 42(3), 515-526. http://dx.doi.org/10.1111/j.1467-8535.2009.01043.x
45. Royal-Dawson, L. (2003) Electronic Marking with ETS Software. AQA Research Committee Paper RC/219, in D. Fowles & C. Adams (2005) How does Assessment Differ when e-Marking Replaces Paper-Based Marking? Paper presented at the 31st International Association for Educational Assessment Conference, Abuja, Nigeria, 4-9 September.
46. Sanderson, P. (2001) Language and Differentiation in Examining at A Level. PhD thesis, University of Leeds.
47. Schilit, B.N., Golovchinsky, G. & Price, M.N. (1998) Beyond Paper: supporting active reading with free form digital ink annotations, Proceedings of CHI 98, Los Angeles, CA. http://dx.doi.org/10.1145/274644.274680
48. Shaw, S. & Imam, H. (2008) On-Screen Essay Marking Reliability: towards an understanding of marker assessment behaviour. Paper presented at the International Association for Educational Assessment Annual Conference, September, Cambridge, UK.
49. Shaw, S. & Johnson, M. (2009) Annotating On-Screen: the influence of reading environment on annotative practice and assessor comprehension building. Paper presented at the International Association for Educational Assessment Annual Conference, September, Brisbane, Australia.
50. Spencer, C. (2006) Research on Learners' Preferences for Reading from a Printed Text or from a Computer Screen, Journal of Distance Education, 21(1), 33-50.
51. Sturman, L. & Kispal, A. (2003) To E or Not To E? A Comparison of Electronic Marking and Paper-Based Marking. Paper presented at the 29th International Association for Educational Assessment Conference, 5-10 October, Manchester.
52. Therriault, D.J. & Raney, G.E. (2002) The Representation and Comprehension of Place-on-the-Page and Text-Sequence Memory, Scientific Studies of Reading, 6(2), 117-134. http://dx.doi.org/10.1207/S1532799XSSR0602_01
53. Tolman, E.C. (1948) Cognitive Maps in Rats and Men, Psychological Review, 55, 189-208. http://dx.doi.org/10.1037/h0061626
54. Wästlund, E., Reinikka, H., Norlander, T. & Archer, T. (2005) Effects of VDT and Paper Presentation on Consumption and Production of Information: psychological and physiological factors, Computers in Human Behavior, 21, 377-394. http://dx.doi.org/10.1016/j.chb.2004.02.007
55. Weir, C. J. & Khalifa, H. (2008) A Cognition Processing Approach towards defining Reading Comprehension, Research Notes, 31, 2-10.
56. Weldon, L.J., Mills, C.B., Koved, L. & Shneiderman, B. (1985) The Structure of Information in Online and Paper Technical Manuals, in R.W. Sweezy (Ed.) Proceedings of the Human Factors Society 29th Annual Meeting, 2, 1110-1113. Santa Monica, CA: Human Factors Society.
57. Whetton, C. & Newton, P. (2002) An Evaluation of On-line Marking. Paper presented at the 28th International Association for Educational Assessment Conference, 1-6 September, Hong Kong.
58. Wilkinson, R.T. (1987) Proof-Reading: VDU and Paper Text Compared for Speed, Accuracy and Fatigue, Behaviour and Information Technology, 6(2), 125-133. http://dx.doi.org/10.1080/01449298708901822
59. Wood, R. (1991) Assessment and Testing: a survey of research. Cambridge: University of Cambridge Press.
60. Wright, P. & Lickorish, A. (1983) Proof-Reading Texts on Screen and Paper, Behaviour and Information Technology, 2(3), 227-235. http://dx.doi.org/10.1080/01449298308914479