On the design of online synchronous assessments in a synchronous cyber classroom

Journal of Computer Assisted Learning

Volumn 28, Issue 4, 2012, Pages 379-395

  Chao, K J ^a   Hung, I C ^b   Chen, N S ^b  

^a NATIONAL KAOHSIUNG UNIVERSITY OF APPLIED SCIENCES   (Taiwan)

^b NATIONAL SUN YAT SEN UNIVERSITY   (Taiwan)

Author keywords

Cyber face to face interaction; Knowledge taxonomy; Online course assessment; Online real time assessment; Synchronous cyber classroom

Indexed keywords

EID: 84862901640     PISSN: 02664909     EISSN: 13652729     Source Type: Journal    
DOI: 10.1111/j.1365-2729.2011.00463.x     Document Type: Article

References (54)

1. Anderson L.W., Krathwohl D.R., Airasian P.W., Cruikshank K.A., Mayer R.E., Pintrich P.R., Raths J. & Wittrock M.C. (2001) Summary of the changes from the original framework. In A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives (eds L.W. Anderson, D.R. Krathwohl, P.W. Airasian, K.A. Cruikshank, R.E. Mayer, P.R. Pintrich, J. Raths & M.C. Wittrock), pp. 263-270. Addison Wesley Longman, Inc., New York, NY.
2. Angelo T.A. (1999) Doing assessment as if learning matters most. AAHE Bulletin 51, 3-6.
3. Bauer J.F. (2002) Assessing student work from chatrooms and bulletin boards. New Directions for Teaching and Learning 91, 31-36. doi: 10.1002/tl.63.
4. Black P. & Wiliam D. (1998) Inside the black box: raising standards through classroom assessment. Phi Delta Kappan 80, 139-148.
5. Bloom B.S., Engelhart M.D., Furst E.J., Hill W.H. & Krathwohl D.R. (1956) Taxonomy of Educational Objectives: The Classification of Educational Goals. Handbook I: Cognitive Domain. David McKay, New York, NY.
6. Bostock S. (2004) Motivation and electronic assessment. In Effective Learning and Teaching in Computing (eds A. Irons & S. Alexander), pp. 86-99. Routledge Falmer, London.
7. Bull J. & McKenna C. (2004) Blueprint for Computer-Assisted Assessment. Routledge Falmer, London.
8. Chen N.S. & Ko L. (2010) An online synchronous test for professional interpreters. Educational Technology & Society 13, 153-165.
9. Chen N.S. & Wang Y. (2008) Testing principles of language learning in a cyber face-to-face environment. Educational Technology & Society 11, 97-113.
10. Chen N.S., Ko H.C., Kinshuk & Lin T. (2005) A model for synchronous learning using the Internet. Innovations in Education and Teaching International 42, 181-194. doi: 10.1080/14703290500062599.
11. Cohen A.D. (1998) Strategies in Learning and Using A Second Language. Addison-Wesley Longman, New York, NY.
12. Conole G. & Warburton B. (2005) A review of computer-assisted assessment. Association for Learning Technology Journal 13, 17-31. doi: 10.1080/0968776042000339772.
13. Corbett A.T. & Anderson J.R. (1994) Knowledge tracing: modeling the acquisition of procedural knowledge. User Modeling and User-adapted Interaction 4, 253-278. doi: 10.1007/bf01099821.
14. Cortez C., Nussbaum M., Woywood G. & Aravena R. (2009) Learning to collaborate by collaborating: a face-to-face collaborative activity for measuring and learning basics about teamwork. Journal of Computer Assisted Learning 25, 126-142.
15. Cronbach L. (1970) Essentials of Psychological Testing, 3rd edition. Harper & Row, New York, NY.
16. Cronbach L. (1971) Test validation. In Educational Measurement (ed. R.L. Thorndike), pp. 443-507. American Council on Education, Washington, DC.
17. Dermo J. (2009) e-assessment and the student learning experience: a survey of student perceptions of e-assessment. British Journal of Educational Technology 40, 203-214. doi: 10.1111/j.1467-8535.2008.00915.x.
18. Foltz P.W., Laham D. & Landauer T.K. (1999) The intelligent essay assessor: applications to educational technology. Interactive Multimedia Electronic Journal of Computer-Enhanced Learning. Available at: (last accessed 21 October 2011).
19. Garris R., Ahlers R. & Driskell J.E. (2002) Games, motivation, and learning: a research and practice model. Simulation & Gaming 33, 441-467. doi: 10.1177/1046878102238607.
20. Gaytan J. & McEwen B.C. (2007) Effective online instructional and assessment strategies. American Journal of Distance Education 21, 117-132. doi: 10.1080/08923640701341653.
21. Gikandi J.W., Morrow D. & Davisa N.E. (2011) Online formative assessment in higher education: a review of the literature. Computers & Education 57, 2333-2351. doi: 10.1016/j.compedu.2011.06.004.
22. Gronlund N.E. (1976) Measurement and Evaluation in Teaching, 3rd edition. Macmillan, New York, NY.
23. Gulikers J., Bastiaens T. & Kirschner P. (2004) A five-dimensional framework for authentic assessment. Educational Technology Research and Development 52, 67-86. doi: 10.1007/bf02504676.
24. Hammond M., Reynolds L. & Ingram J. (2011) How and why do student teachers use ICT? Journal of Computer Assisted Learning 27, 191-203. doi: 10.1111/j.1365-2729.2010.00389.x.
25. Hastie M., Chen N.S. & Kuo Y.H. (2007) Instructional design for best practice in the synchronous cyber classroom. Educational Technology & Society 10, 281-294.
26. Hastie M., Hung I.C., Chen N.S. & Kinshuk (2010) A blended synchronous learning model for educational international collaboration. Innovations in Education and Teaching International 47, 9-24. doi: 10.1080/14703290903525812.
27. Huba M.E. & Freed J.E. (2000) Learner-Centered Assessment on College Campuses: Shifting the Focus from Teaching to Learning. Allyn and Bacon, Boston, MA.
28. Jordan S. & Mitchell T. (2009) e-Assessment for learning? The potential of short-answer free-text questions with tailored feedback. British Journal of Educational Technology 40, 371-385. doi: 10.1111/j.1467-8535.2008.00928.x.
29. King T. & Duke-Williams E. (2001) Using computer aided assessment to test higher level learning outcomes. In Proceedings of the 5th International Computer Assisted Assessment Conference (eds M. Danson & C. Eabry), pp. 177-187. Loughborough University, Loughborough.
30. Lewis D. & Sewell R. (2007) Providing formative feedback from a summative computer-aided assessment. American Journal of Pharmaceutical Education 71, 33.
31. Loevinger J. (1957) Objective tests as instruments of psychological theory. Psychological Reports 3, 635-694.
32. Marjanovic O. (1999) Learning and teaching in a synchronous collaborative environment. Journal of Computer Assisted Learning 15, 129-138. doi: 10.1046/j.1365-2729.1999.152085.x.
33. Marriott P. (2009) Students' evaluation of the use of online summative assessment on an undergraduate financial accounting module. British Journal of Educational Technology 40, 237-254. doi: 10.1111/j.1467-8535.2008.00924.x.
34. Mayer R.E. (2002) A taxonomy for computer-based assessment of problem solving. Computers in Human Behavior 18, 623-632. doi: 10.1016/s0747-5632(02)00020-1.
35. Mayotte S. (2010) Online assessment of problem solving skills. Computers in Human Behavior 26, 1253-1258. doi: 10.1016/j.chb.2010.03.033.
36. McCormack C. & Jones D. (1997) Building A Web-Based Education System. John Wiley & Sons, Inc., New York, NY.
37. McTighe J. & O'Connor K. (2005) Seven practices for effective learning. Educational Leadership 63, 10-17.
38. Nakatani Y. (2005) The effects of awareness-raising training on oral communication strategy use. The Modern Language Journal 89, 76-91. doi: 10.1111/j.0026-7902.2005.00266.x.
39. Oliver R.G. (1988) Experience of Assessing Programming Assignments by Computer. SEED Publications, Plymouth.
40. Phakiti A. (2003) A closer look at the relationship of cognitive and metacognitive strategy use to EFL reading achievement test performance. Language Testing 20, 26-56. doi: 10.1191/0265532203lt243oa.
41. Rockman I.F. (2002) The importance of assessment. Reference Services Review 30, 181-182. doi: 10.1108/00907320210435455.
42. Rust C. (2002) The impact of assessment on student learning. Active Learning in Higher Education 3, 145-158. doi: 10.1177/1469787402003002004.
43. Salisbury M.W. (2003) Putting theory into practice to build knowledge management systems. Journal of Knowledge Management 7, 128-141. doi: 10.1108/13673270310477333.
44. Sang G., Valcke M., van Braak J., Tondeur J. & Zhu C. (2011) Predicting ICT integration into classroom teaching in Chinese primary schools: exploring the complex interplay of teacher-related variables. Journal of Computer Assisted Learning 27, 160-172. doi: 10.1111/j.1365-2729.2010.00383.x.
45. Schlegel R.E. & Gilliland K. (2007) Development and quality assurance of computer-based assessment batteries. Archives of Clinical Neuropsychology 22 (Suppl. 1), 49-61. doi: 10.1016/j.acn.2006.10.005.
46. Shepard L.A. (2000) The role of assessment in a learning culture. Educational Researcher 29, 4-14.
47. Sim G., Holifield P. & Brown M. (2004) Implementation of computer assisted assessment: lessons from the literature. Association for Learning Technology Journal 12, 215-229. doi: 10.1080/0968776042000259546.
48. Swan K., Shen J. & Hiltz S.R. (2006) Assessment and collaboration in online learning. Journal of Asynchronous Learning Networks 10, 45-62.
49. Thomas P., Price B., Paine C. & Richards M. (2002) Remote electronic examinations: student experiences. British Journal of Educational Technology 33, 537-549. doi: 10.1111/1467-8535.00290.
50. Thorpe M. & Edmunds R. (2011) Practices with technology: learning at the boundary between study and work. Journal of Computer Assisted Learning 27, 385-398.
51. Vonderwell S. (2004) Assessing online learning and teaching: adapting the minute paper. TechTrends 48, 29-31. doi: 10.1007/bf02763442.
52. Wang Y. & Chen N.S. (2009) Criteria for evaluating synchronous learning management systems: arguments from the distance language classroom. Computer Assisted Language Learning 22, 1-18. doi: 10.1080/09588220802613773.
53. Whitelock D. (2009) Editorial: e-assessment - developing new dialogues for the digital age. British Journal of Educational Technology 40, 199-202. doi: 10.1111/j.1467-8535.2008.00932.x.
54. Williams J.B. (2006) The place of the closed book, invigilated final examination in a knowledge economy. Educational Media International 43, 107-119. doi: 10.1080/09523980500237864.