Automatic grading of 3D computer animation laboratory assignments

IEEE Transactions on Learning Technologies

Volumn 7, Issue 3, 2014, Pages 280-290

  Lamberti, Fabrizio ^a   Sanna, Andrea ^a   Paravati, Gianluca ^a   Carlevaris, Gilles ^a  

^a POLITECNICO DI TORINO   (Italy)

Author keywords

3D animation; Computer graphics; Computer managed instruction; Evaluation methodologies

Indexed keywords

ANIMATION; BLENDING; COMPUTER GRAPHICS; EDUCATION; GRADING; STUDENTS; TEACHING; THREE DIMENSIONAL COMPUTER GRAPHICS;

3D ANIMATION; 3D COMPUTER ANIMATION; AUTOMATIC ASSESSMENT; COMPUTER BASED TOOLS; COMPUTER-BASED ASSESSMENTS; COMPUTER-MANAGED INSTRUCTIONS; EVALUATION METHODOLOGIES; LABORATORY ASSIGNMENTS;

QUALITY CONTROL;

EID: 84907536823     PISSN: 19391382     EISSN: None     Source Type: Journal    
DOI: 10.1109/TLT.2014.2340861     Document Type: Article

References (58)

1. J. Hollingsworth"Automatic graders for programming classes" Commun. ACM, vol. 3, no. 10, pp. 528-529, Oct. 1960.
2. P. Ihantola, T. Ahoniemi, V. Karavirta, and O. Seppala"Review of recent systems for automatic assessment of programming assignments" in Proc. 10th Int. Conf. Comput. Edu. Res., 2010, pp. 86-93.
3. T. Lahtonene and V. Isomottonen"PARSI: A tool for automatic assessment of office documents and basic it skills" Proc. 11th Int. Conf. Comput. Edu. Res., 2012, pp. 174-180.
4. G. T. Ferreres, K. Wouters, B. Ramos Alvarez, and A. R. Garnacho"EVAWEB: A web-based assessment system to learn X.509/PKIXbased digital signatures" IEEE Trans. Edu., vol. 50, no. 2, pp. 112-117, May 2007.
5. A. Robles-Gomez, L. Tobarra, S. Ros, R. Hernadez, A. C. Caminero, and R. Pastor"Automatic assessment for the e-learning of the network services in the context of the EHEA" in Proc. Frontiers Edu. Conf., 2011, pp. 1-6.
6. V. Petridis, S. Kazarlis, and V. G. Kaburlasos"ACES: An interactive software platform for self-instruction and self-evaluation in automatic control systems" IEEE Trans. Edu., vol. 46, no. 1, pp. 102-110, Feb. 2003.
7. G. Molnar, V. Omrcen, and M. Cupic"Automating the formal logic course" in Proc. 35th Int. Convention MIPRO, 2012, pp. 1124-1129.
8. Z. Stanisavljevic, B. Nikolic, and J. Djordjevic"A module for automatic assessment and verification of student' work in digital logic design" in Proc. 19th Int. Conf. Workshops Eng. Comput.-Based Syst., 2012, pp. 275-282.
9. J. Z. Kovacic and J. S. Green"Automatic grading of spreadsheet and database skills" J. Inf. Technol. Edu.: Innovations Practice, vol. 11, pp. 53-70, 2012.
10. A. Rasila, M. Harjula, and K. Zenger"Automatic assessment of mathematics exercises: Experiences and future prospects" in Proc. Symp. Eng. Educ., 2007, pp. 70-80.
11. R. E. Stanley"Using web based animation software with algorithmic parameters in order to simplify grading while still maintaining oversight of the student's work" Comput. Edu., vol. 19, no. 1, Jan.-Mar. 2009.
12. Y. Wang, S. Zhong, H. Zhang, Y. Zhong, and L. Bai"Research of automatic assessment system of virtual experiment in middle school biology based on virtual simulation technology" in Proc. Int. Conf. E-Learn. Games, 2010, pp. 345-352.
13. Y. E. Chen, C. L. Liu, T. H. Chang and C. H. Lee"An unsupervised automated essay-scoring system" IEEE Intell. Syst., vol. 25, no. 5, pp. 61-67, Sep./Oct. 2010.
14. A. E. Tshibalo"The Potential impact of computer-aided assessment technology in higher education" South African J. Higher Edu., vol. 22, no. 6, pp. 686-695, 2007.
15. S. Brandle"Automated grading of student programming assignments" J. Comput. Sci. Colleges, vol. 25, no. 2, pp. 284-286, May 2010.
16. R. Alur, L. D'Antoni, S. Gulwani, D. Kini, and M. Viswanathan"Automated grading of DFA constructions" in Proc. Int. Joint Conf. Artif. Intell., 2013, pp. 1976-1982.
17. L. Yang"An automatic grading model for learning assessment" in Proc. Int. Conf. e-Education, e-Bus., e-Manage. e-Learn., 2010, pp. 217-220.
18. A. Tartaglia and E. Tresso"An automatica evaluation system for technical education at the university level" IEEE Trans. Edu., vol. 45, no. 3, pp. 268-275, Aug. 2002.
19. R. Singh, S. Gulwani, and A. Solar-Lezama"Automated feedback generation for introductory programming assignments" in Proc. 34th ACM SIGPLAN Conf. Program. Lang. Des. Implementation, 2013, pp. 15-26.
20. M. L. Nguyen, S.C. Hui and A. C. M. Fing"Web-based mathematic testing with automatic assessment" in Proc. 12th Int. Conf. Artif. Intell., 2012, pp. 347-358.
21. L. de Alfaro and M. Shavlovsky"CrowdGrader: a tool for crowdsourcing the evaluation of homework assignments" in Proc. 45th ACM Tech. Symp. Comput. Sci. Educ., 2014, pp. 415-420.
22. S. Swithenby"E-assessment for open learning" in Proc. Annu. Conf. Eur. Assoc. Distance Teach. Universities, 2006.
23. M. Mahana, M. Johns and A. Apte"Automated essay grading using machine learning" Mach. Learn. Session, Stanford University, 2012.
24. H. Q. Jiang, L. Zhang and W. Q. Ye"The automatic evaluation strategies and methods of multimedia work assignment" in Proc. Int. Conf. Comput. Intell. Softw. Eng, 2009, pp. 1-5.
25. K. D. Forbus, J. Usher, A. Lovett, K. Lockwood and J. Wetzel"Cogsketch: Sketch understanding for cognitive science research and for education" Topics Cognitive Sci., vol. 3, pp. 648-666, 2011.
26. Z. Shukur, Y. Away and M. A. Dawari"Computer-aided marking system for engineering drawing" in Proc. Int. Conf. Soc. Inf. Technol. Teacher Educ., 2004, pp. 1852-1857.
27. K. A. Hekman and M. T. Gordon"Automated grading of first year student CAD work" in Proc. 120th ASEE Annu. Conf., 2013, pp. 1-10.
28. A. Sanna, F. Lamberti, G. Paravati and C. Demartini"Automatic assessment of 3D modeling exams" IEEE Trans. Learn. Technol., vol. 5, no. 1, pp. 2-10, Jan.-Mar. 2012.
29. J. English"Automated assessment of GUI programs using JEWL" in Proc. 9th Annu. SIGCSE Conf. Innovation Technol. Comput. Sci. Educ., 2004, pp. 137-141.
30. D. H. Baxter and M. J. Guerci"Automating an introductory computer aided design course to improve student evaluation" in Proc. Annu. Meeting Am. Soc. Eng. Educ., 2003, pp. 1179-1180.
31. M. Thornton, S. H. Edwards, R. P. Tan and M.A. Perez-Quinones"Supporting student-written tests of GUI programs" in Proc. 39th SIGCSE Tech. Symp. Comput. Sci. Edu., 2008, pp. 537-541.
32. J. Ramos, M. A. Trenas, E. Gutierrez, and S. Romero"E-assessment of Matlab assignments in moodle: Application to an introductory programming course for engineers" in Proc. Comput. Appl. Eng. Edu., 2011, pp. 1-6.
33. T. G. Hill"Word grader and PowerPoint grader" ACM Inroads, vol. 2, no. 2, pp. 34-36, Jun. 2011.
34. P. Thomas, N. Smith and K. Waugh"Automatically assessing graph-based diagrams" Learn., Media Technol., vol. 33, no. 3, pp. 249-267, 2008.
35. J. Masters"Automated scoring of an interactive geometry item: A proof of concept" J. Technol., Learn., Assessment, vol. 8, no. 7, pp. 1-39, 2010.
36. P. Thomas, N. Smith and K. Waugh"Automatic assessment of sequence diagrams" in Proc. 12th Int. CAA Conf., 2008, pp. 1-14.
37. F. Batmaz and C. J. Hinde"A Web-based automatic assessment tool for conceptual database design" in Proc. 6th Conf. Web-Based Educ., 2007, pp. 427-432.
38. T. J. Branoff"Integrating constraint-based CAD into an introductory engineering graphics course: Activities and grading strategies" in Proc. Annu. Meeting Amer. Soc. Eng. Educ., 2003.
39. J. L. Colwell, J. Whittington and J. Higley"Assessment measures and outcomes for computer graphics programs" Eng. Des. Graph. J., vol. 69, no. 3, pp. 24-33, 2005.
40. Z. Jin, J. Jia, Y. Liu, Y. Wang and L. Cai"An automated grading method for singing evaluation" Recent Adv. Comput. Sci. Inf. Eng., vol. 5, pp. 691-696, 2012.
41. J. C. P. Chan, H. Leung, J. K. T. Tang and T. Komura"A virtual reality dance training system using motion capture technology" IEEE Trans. Learn. Technol., vol. 4, no. 2, pp. 187-195, Apr. 2011.
42. C. Li, and T. Chen"Aesthetic Visual Quality Assessment of Paintings" IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 236-252, Apr. 2009.
43. G. M. Sanchez-Torrubia, C. Torres-Blanc and S. Escribano"GRAPHS: A learning environment for graph algorithm simulation primed for automatic fuzzy assessment" in Proc. 10th Int. Conf. Comput. Edu. Res., 2010, pp. 62-67.
44. M., Flickner, H. Sawhney, W. Niblack, J. Ashley, H. Qian, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele and P. Yanker"Query by image and video content: The QBIC system" IEEE Comput., vol. 29, no. 9, pp. 23-32, Sep. 1995.
45. E. Chalom, E. Asa and E. Biton"Measuring image similarity: An overview of some useful application" in Proc. IEEE Instrum. Measurement Mag., 2013, pp. 24-28.
46. W. Hu, N. Xie, L. Li, X. Zeng and S. Maybank"A survey on visual content-based video indexing and retrieval" IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 41, no. 6, pp. 797-819, Nov. 2011.
47. S. S. Cheung and A. Zakhor"Efficient video similarity measurement with video signature" IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 1, pp. 59-74, Jan. 2003.
48. C. W. Su, H. Y. M. Liao, H. R. Tyan, C. W. Lin, D. Y. Chen, K. C. Fan"Motion flow-based video retrieval" IEEE Trans. Multimedia, vol. 9, no. 6, pp. 1193-1201, Oct. 2007.
49. Computer 3D. Modelling and Animation, Level 5, N23010, Further Education and Training Awards Council, 2013.
50. J. Lasseter"Principles of traditional animation applied to 3D computer animation" Comput. Graph., pp. 35-44, vol. 21, no. 4, Jul. 1987.
51. K. Miura, H. Furukawa and M. Shoji "Similarity of human motion: Congruity between perception and data" in Proc. IEEE Int. Conf. Syst., Man Cybern., 2006, pp. 1184-1189.
52. P. T. Chua, R. Crivella, B. Daly, H. Ning, R. Schaaf, D. Ventura, T. Camill, J. Hodgins and R. Paush"Training for physical tasks in virtual environments: Tai-chi" Proc. IEEE Virtual Reality, 2003, pp. 87-94.
53. J. Chan, H. Leung, K .T. Tang and T. Komura"Immersive performance training tools using motion capture technology" Proc. 1st Int. Conf. Immersive Telecommun., art. no. 7, 2007.
54. M. Muller, Information Retrievel for Music and Motion. New York, NY, USA: Springer-Verlag, 2007.
55. S. Celebi, A. S. Aydin, T. T. Temiz and T. Arici" Robust gesture recognition using feature pre-processing and weighted dynamic time warping" Proc. Int. Conf. CVTA., 2013, pp. 620-625.
56. J. K. T. Tang, H. Leung, T. Komura and H. P. H. Shum" Emulating human perception of motion similarity" Comput. Animation Virtual Worlds, vol. 19, no. 3-4, pp. 211-221, 2008.
57. R. Blake and M. Shiffrar"Perception of human motion" Annu. Rev. Psychol., vol. 58, pp. 47-73, 2006.
58. L. Ren, A. Patrick, A. A. Efros, J. K. Hodging and J. M. Rehg"A data-driven approach to quantifying natural human motion" ACM Trans. Graph., vol. 24, pp. 1090-1097, 2005.