Penetrating the black box of time-on-task estimation

ACM International Conference Proceeding Series

Volumn 16-20-March-2015, Issue , 2015, Pages 184-193

  Kovanović, Vitomir ^a   Gašević, Dragan ^a   Dawson, Shane ^b   Joksimović, Srećko ^c   Baker, Ryan S ^d   Hatala, Marek ^c  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b UNIVERSITY OF SOUTH AUSTRALIA   (Australia)

^c SIMON FRASER UNIVERSITY   (Canada)

^d Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

Higher Education; Learning Analytics; Learning Management Systems (LMS); Measurement; Moodle; Time on task

Indexed keywords

EDUCATION; EDUCATION COMPUTING; INFORMATION MANAGEMENT; MEASUREMENTS;

HIGHER EDUCATION; LEARNING ANALYTICS; LEARNING MANAGEMENT SYSTEM; MOODLE; TIME ON TASKS;

STUDENTS;

EID: 84955594969     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2723576.2723623     Document Type: Conference Paper

References (59)

1. Special issue on the community of inquiry framework: Ten years later. The Internet and Higher Education, 13(1-2), 2010.
2. W. Admiraal, T. Wubbels, and A. Pilot. College teaching in legal education: Teaching method, students time-on-task, and achievement. Research in Higher Education, 40(6):687-704, 1999.
3. H. Ba-Omar, I. Petrounias, and F. Anwar. A framework for using web usage mining to personalise e-learning. In Proceedings of the Seventh IEEE International Conference on Advanced Learning Technologies, ICALT 2007, pages 937-938, 2007.
4. R. S. Baker. Modeling and understanding students off-task behavior in intelligent tutoring systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '07, pages 1059-1068, 2007.
5. R. S. Baker, A. T. Corbett, K. R. Koedinger, and A. Z. Wagner. Off-task behavior in the cognitive tutor classroom: When students "game the system". In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 04, pages 383-390, 2004.
6. B. S. Bloom. Time and learning. American Psychologist, 29 (9):682-688, 1974.
7. A. H. Brown and T. Green. Time students spend reading threaded discussions in online graduate courses requiring asynchronous participation. The International Review of Research in Open and Distance Learning, 10(6):51-64, 2009.
8. C. Calderwood, P. L. Ackerman, and E. M. Conklin. What else do college students "do" while studying? an investigation of multitasking. Computers & Education, 75:19-29, 2014.
9. J. Carroll. A model of school learning. Teachers College Record, 64(8):723-733, 1963. ISSN 0161-4681. WOS:A1963CAJ4400010.
10. L. D. Catledge and J. E. Pitkow. Characterizing browsing strategies in the world-wide web. In Proceedings of the Third International World-Wide Web Conference on Technology, Tools and Applications, pages 1065-1073, 1995.
11. S. Cetintas, L. Si, Y. P. Xin, C. Hord, and D. Zhang. Learning to identify students' off-task behavior in intelligent tutoring systems. In Proceedings of the 14th AIED Conference on Artificial Intelligence in Education, pages 701-703, 2009.
12. S. Cetintas, L. Si, Y. P. Xin, and C. Hord. Automatic detection of off-task behaviors in intelligent tutoring systems with machine learning techniques. IEEE Transactions on Learning Technologies, 3(3):228-236, 2010.
13. A. W. Chickering and Z. F. Gamson. Seven principles for good practice in undergraduate education. Biochemical Education, 17(3):140-141, 1989.
14. V. Chitraa and A. S. Davamani. A survey on preprocessing methods for web usage data. International Journal ofCom-puter Science and Information Security, 7(3):78-83, 2010.
15. L. Cohen, L. Manion, and K. Morrison. Research Methods in Education. Routledge, 2007.
16. R. Cooley, B. Mobasher, and J. Srivastava. Web mining: information and pattern discovery on the world wide web. In, Ninth IEEE International Conference on Tools with Artificial Intelligence, 1997. Proceedings, pages 558-567, 1997.
17. R. Cooley, B. Mobasher, and J. Srivastava. Data preparation for mining world wide web browsing patterns. Knowledge and Information Systems, 1(1):5-32, 1999.
18. J. Garcia-Martm and J.-N. Garcfa-Sanchez. Patterns of web 2.0 tool use among young spanish people. Computers & Education, 67:105-120, 2013.
19. D. R. Garrison, T. Anderson, and W. Archer. Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2 (2-3):87-105, 1999.
20. D. R. Garrison, T. Anderson, and W. Archer. Critical thinking, cognitive presence, and computer conferencing in distance education. American Journal ofDistance Education, 15(1):7-23, 2001.
21. D. Gasevic, A. Olusola, S. Joksimovic, and V. Kovanovic. Externally-facilitated regulation scaffolding and role assignment to develop cognitive presence in asynchronous online discussions. The Internet and Higher Education, in press, 2014.
22. M. Grabe and E. Sigler. Studying online: evaluation of an online study environment. Computers & Education, 38(4): 375-383, 2002.
23. Y. Guo, J. Wang, J. Moore, M. Liu, and H.-L. Chen. A case study of usability testing on an asynchronous e-learning platform. In 2009 Joint Conferences on Pervasive Computing (JCPC), pages 693-698, 2009.
24. T. J. Hastie, R. J. Tibshirani, and J. H. Friedman. The elements ofstatistical learning: data mining, inference, and prediction. Springer, 2013.
25. A. Helmke, W. Schneider, and F. E. Weinert. Quality of instruction and classroom learning outcomes: The german contribution to the IEA classroom environment study. Teaching and Teacher Education, 2(1):1-18, 1986.
26. J. Hewitt, C. Brett, and V. Peters. Scan rate: A new metric for the analysis of reading behaviors in asynchronous computer conferencing environments. American Journal of Distance Education, 21(4):215-231, Nov. 2007. ISSN 08923647, 1538-9286.
27. Y.-C. Hsu and Y.-H. Ching. Mobile app design for teaching and learning: Educators' experiences in an online graduate course. The International Review of Research in Open and Distance Learning, 14(4), 2013.
28. T. Hussain, S. Asghar, and N. Masood. Web usage mining: A survey on preprocessing of web log file. In 2010 International Conference on Information and Emerging Technologies (ICIET), pages 1-6, 2010.
29. T. Judd. Making sense of multitasking: The role of facebook. Computers & Education, 70:194-202, 2014.
30. N. Karweit. Time-on-task reconsidered: Synthesis of research on time and learning. Educational Leadership, 41(8):32-35, 1984.
31. N. Karweit and R. E. Slavin. Time-on-task: Issues of timing, sampling, and definition. Journal of Educational Psychology, 74(6):844-851, 1982.
32. B. Kolloffel, T. H. S. Eysink, and T. D. Jong. Comparing the effects of representational tools in collaborative and individual inquiry learning. International Journal of Computer-Supported Collaborative Learning, 6(2):223-251, 2011.
33. L. A. Kraus, W. M. Reed, and G. E. Fitzgerald. The effects of learning style and hypermedia prior experience on behavioral disorders knowledge and time on task: a case-based hypermedia environment. Computers in Human Behavior, 17(1): 125-140, 2001.
34. G. Lust, M. Vandewaetere, E. Ceulemans, J. Elen, and G. Clarebout. Tool-use in a blended undergraduate course: In search of user profiles. Computers & Education, 57(3): 2135-2144, 2011.
35. G. Lust, J. Elen, and G. Clarebout. Regulation of tool-use within a blended course: Student differences and performance effects. Computers & Education, 60(1):385-395, 2013.
36. G. Lust, J. Elen, and G. Clarebout. Students' tool-use within a web enhanced course: Explanatory mechanisms of students' tool-use pattern. Computers in Human Behavior, 29(5):2013- 2021, 2013.
37. L. P. Macfadyen and S. Dawson. Mining LMS data to develop an "early warning system" for educators: A proof of concept. Computers & Education, 54(2):588-599, 2010.
38. C. G. Marquardt, K. Becker, and D. D. Ruiz. A pre-processing tool for web usage mining in the distance education domain. In Proceedings of the International Database Engineering and Applications Symposium, IDEAS '04, pages 78-87, 2004.
39. B. Mobasher, R. Cooley, and J. Srivastava. Creating adaptive web sites through usage-based clustering of URLs. In Knowledge and Data Engineering Exchange, 1999.(KDEX'99) Proceedings. 1999 Workshop on, pages 19-25, 1999.
40. MoodleHQ. Homepage, 2014. https://moodle.org/.
41. E. S. A. T. Mooij. Time on task, interaction, and information handling in multimedia learning environments. Journal ofEducational Computing Research, 21(4):487-502, 2000.
42. M. Munk and M. Drlfk. Impact of different pre-processing tasks on effective identification of users' behavioral patterns in web-based educational system. Procedia Computer Science, 4:1640-1649, 2011.
43. M. Munk, J. Kapusta, and P. Svec. Data preprocessing evaluation for web log mining: reconstruction of activities of a web visitor. Procedia Computer Science, 1(1):2273-2280, 2010.
44. M. Oztok, D. Zingaro, C. Brett, and J. Hewitt. Exploring asynchronous and synchronous tool use in online courses. Computers & Education, 60(1):87-94, 2013.
45. Z. A. Pardos, R. S. J. D. Baker, M. O. C. Z. San Pedro, S. M. Gowda, and S. M. Gowda. Affective states and state tests: Investigating how affect throughout the school year predicts end of year learning outcomes. In Proceedings of the Third International Conference on Learning Analytics and Knowledge, LAK '13, pages 117-124, 2013.
46. D. Perera, J. Kay, I. Koprinska, K. Yacef, and O. Zaiane. Clustering and sequential pattern mining for online collaborative learning. IEEE Transactions on Knowledge and Data Engineering, 21(6):759-772, 2009.
47. G. T. Raju and P. S. Satyanarayana. Knowledge discovery from web usage data: Complete preprocessing methodology. International Journal of Computer Science and Network Security, 8(1):179-186, 2008.
48. D. Roberge, A. Rojas, and R. Baker. Does the length of time off-task matter? In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, LAK '12, pages 234-237, 2012.
49. C. Romero and S. Ventura. Educational data mining: A review of the state of the art. Trans. Sys. Man Cyber Part C, 40 (6):601-618, 2010.
50. C. Romero, S. Ventura, and E. Garcia. Data mining in course management systems: Moodle case study and tutorial. Computers & Education, 51(1):368-384, 2008.
51. C. Romero, P. G. Espejo, A. Zafra, J. R. Romero, and S. Ventura. Web usage mining for predicting final marks of students that use moodle courses. Computer Applications in Engineering Education, 21(1):135-146, 2013.
52. M. Romero and E. Barbera. Quality of learners' time and learning performance beyond quantitative time-on-task. International Review ofResearch in Open and Distance Learning, 12(5):125-137, 2011.
53. L. D. Rosen, L. Mark Carrier, and N. A. Cheever. Facebook and texting made me do it: Media-induced task-switching while studying. Computers in Human Behavior, 29(3):948-958, 2013.
54. J. Stallings. Allocated academic learning time revisited, or beyond time on task. Educational Researcher, 9(11):11-16, 1980.
55. R. D. Valle and T. M. Duffy. Online learning: Learner characteristics and their approaches to managing learning. Instructional Science, 37(2):129-149, 2009.
56. P. H. Winne and D. Jamieson-Noel. Exploring students' calibration of self reports about study tactics and achievement. Contemporary Educational Psychology, 27(4):551-572, 2002.
57. A. F. Wise, J. Speer, F. Marbouti, and Y.-T. Hsiao. Broadening the notion of participation in online discussions: examining patterns in learners' online listening behaviors. Instructional Science, 41(2):323-343, 2013.
58. A. F. Wise, Y. Zhao, and S. N. Hausknecht. Learning analytics for online discussions: A pedagogical model for intervention with embedded and extracted analytics. In Proceedings of the Third International Conference on Learning Analytics and Knowledge, LAK '13, pages 48-56, 2013.
59. B. R. Worthen, L. M. Van Dusen, and P. J. Sailor. A comparative study of the impact of integrated learning systems on students' time-on-task. International Journal ofEducational Research, 21(1):25-37, 1994.