Learning analytics at “small” scale: Exploring a complexity-grounded model for assessment automation

Journal of Universal Computer Science

Volumn 21, Issue 1, 2015, Pages 66-92

  Goggins, Sean ^a   Xing, Wanli ^a   Chen, Xin ^b   Chen, Bodong ^c   Wadholm, Bob ^a  

^a UNIVERSITY OF MISSOURI   (United States)

^b Purdue University   (United States)

^c UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Assessment; Complex systems; Learning analytics; Small group learning

Indexed keywords

EID: 84930346306     PISSN: 0948695X     EISSN: 09486968     Source Type: Journal    
DOI: None     Document Type: Article

References (48)

1. [Arnold et al. 09] Arnold, N., Ducate, L., Lomicka, D. and Lord, G.: "Assessing Online Collaboration among Language Teachers: A Cross-Institutional Case Study." Journal of Interactive Online Learning, 8, 2 (2009), 121-139.
2. [Arrow et al. 00] Arrow, H., McGrath, J. E. and Berdahl. J. L.: "Small groups as complex systems: Formation, coordination, development, and adaptation;" Sage, (2000).
3. [Barab 01] Barab, S. A., Hay K. and Yamagata-Lynch, L.: "Constructing Networks of Action-Relevant Episodes: An in Situ Research Methodology." The Journal of the Learning Sciences, 10, 1-2 (2001), 63-112.
4. [Bar-Yam 97] Bar-Yam, Y.: "Dynamics of complex systems;" Reading, MA: Addison-Wesley, 3(1997).
5. [Capra 96] Capra, F.: "The web of life: A new scientific understanding of living systems;" Random House LLC (1996).
6. [Chen and Monica 14] Chen, B. D., and Resendes, M.: "Uncovering what matters: analyzing transitional relations among contribution types in knowledge-building discourse." In Proceedins of the Fourth International Conference on Learning Analytics And Knowledge, ACM (2014), 226-230.
7. [Coffrin 14] Coffrin, C., Corrin, L., Barba, P. and Kennedy, G.: "Visualizing Patterns of Student Engagement and Performance in MOOCs." ACMPress (2014), 83-92.
8. [Cress 08] Cress, U.: "The Need for Considering Multilevel Analysis in CSCL research-An Appeal for the Use of More Advanced Statistical Methods." International Journal of Computer-Supported Collaborative Learning 3, 1(2008), 69-84.
9. [Dennen 08] Dennen, V.: "Looking for Evidence of Learning: Assessment and Analysis Methods for Online Discourse." Computers in Human Behavior, 24, 2 (2008), 205-219.
10. [Ebner and Schön 13] Ebner, M. and Schön, M.: "Why Learning Analytics for Primary Education Matters!" Bulletin of the IEEE Technical Committee on Learning Technology, 15, 2 (2013), 14.
11. [Fancsali 11] Fancsali, S. E.: "Variable construction for predictive and causal modeling of online education data." In Proceedings of the 1st International Conference on Learning Analytics and Knowledge, ACM (2011), 54-63.
12. [Ferguson and Shum 11] Ferguson, R., and Shum, S. M.: "Learning Analytics to Identify Exploratory Dialogue within Synchronous Text Chat." In Proceedings of the 1st International Conference on Learning Analytics and Knowledge, ACM (2011), 99-103.
13. [Friedman et al. 97] Friedman, N., Geiger, D. and Goldszmidt. M.: "Bayesian network classifiers." Machine learning, 29, 2-3 (1997), 131-163.
14. [Goggins et al. 11] Goggins, S. P., Laffey, J. and Gallagher, M.: "Completely Online Group Formation and Development: Small Groups as Socio-Technical Systems." Information Technology & People, 24, 2, (2011), 104-33.
15. [Goggins et al. 13] Goggins, S. P., Mascaro, C., & Valetto, G. (2013). Group informatics: A methodological approach and ontology for sociotechnical group research. Journal of the American Society for Information Science and Technology, 64(3), 516-539.
16. [Goldstone and Wilensky 08] Goldstone, R., and Wilensky, U.: "Promoting transfer by grounding complex systems principles." The Journal of the Learning Sciences, 17, 4 (2008), 465-516.
17. [Gress et al. 10] Gress, C. L. Z., Fior, M., Hadwin, A. F. and Winne, P. H. "Measurement and Assessment in Computer-Supported Collaborative Learning." Computers in Human Behavior, 26, 5 (2010), 806-14.
18. [Hall 99] Hall, M. A.: "Correlation-based feature selection for machine learning." PhD diss., The University of Waikato, (1999).
19. [Hämäläinen and Vinni 06] Hämäläinen, W. and Vinni, M.: "Comparison of Machine Learning Methods for Intelligent Tutoring Systems." In Intelligent Tutoring Systems, Springer (2006), 525-34.
20. [Hmelo-Silver et al. 00] Hmelo-Silver, C. E., Holton, D. L., and Kolodner, J. L.: "Designing to learn about complex systems." The Journal of the Learning Sciences, 9, 3 (2000), 247-298.
21. [Hmelo-Silver et al. 11] Hmelo-Silver, C. E., Jordan, R., Liu, L. and Chernobilsky, E.: "Representational tools for understanding complex computer-supported collaborative learning environments." In Analyzing Interactions in CSCL, Springer (2011), 83-106.
22. [Holland 98] Holland, J. H.: "Emergence-from order to chaos;" Perseus Books Cambridge, MA (1998).
23. [Hoyle 08] Hoyle, D. C.: "Automatic PCA Dimension Selection for High Dimensional Data and Small Sample Sizes." Journal of Machine Learning Research, 9, 12 (2008).
24. [Jacobson and Wilensky 06] Jacobson, M. J. and Wilensky, U.: "Complex Systems in Education: Scientific and Educational Importance and Implications for the Learning Sciences." The Journal of the Learning Sciences, 15, 1 (2006), 11-34.
25. [Kantardzic 11] Kantardzic, M.: "Data mining: concepts, models, methods, and algorithms;" John Wiley & Sons (2011).
26. [Kauffman 95] Kauffman, S.: "At home in the universe: The search for the laws of self-organization and complexity;" Oxford University Press (1995).
27. [Kapur and Kinzer 09] Kapur, M. and Kinzer, C. K.: "Productive Failure in CSCL Groups." International Journal of Computer-Supported Collaborative Learning, 4, 1 (2009).
28. [Kapur et al. 08] Kapur, M., Voiklis, J. and Kinzer, C. K.: "Sensitivities to early exchange in synchronous computer-supported collaborative learning (CSCL) groups." Computers & Education, 51, 1 (2008), 54-66.
29. [Kapur et al. 11] Kapur, M., Voiklis, J. and Kinzer, C. K.: "A complexity-grounded model for the emergence of convergence in CSCL groups." In Analyzing Interactions in CSCL, Springer US (2011), 3-23.
30. [Kumar et al. 10] Kumar, V. S., Gress, C. L. Z., Hadwin, A. F. and Winne, P. H.: "Assessing Process in CSCL: An Ontological Approach." Computers in Human Behavior, 26, 5 (2010), 825-34.
31. [Mennin 07] Mennin, S.: "Small-Group Problem-Based Learning as a Complex Adaptive System." Teaching and Teacher Education, 23, 3 (2007), 303-13.
32. [Mirriahi et al. 13] Mirriahi, N. and Dawson, S.: "The Pairing of Lecture Recording Data with Assessment Scores: A Method of Discovering Pedagogical Impact." In Proceedings of the Third International Conference on Learning Analytics and Knowledge, ACM (2013), 180-84.
33. [Nowark 04] Nowak, A.: "Dynamical minimalism: Why less is more in psychology." Personality and Social Psychology Review, 8, 2 (2004), 183-192.
34. [Reimann 09] Reimann, P.: "Time Is Precious: Variable-and Event-Centred Approaches to Process Analysis in CSCL Research." International Journal of Computer-Supported Collaborative Learning, 4, 3 (2009): 239-57.
35. [Safin et al. 10] Safin, S., Verschuere, A., Burkhardt, J., Détienne, F., and Hébert, A. M.: "Quality of Collaboration in a Distant Collaborative Architectural Educational Setting." International Reports on Socio-Informatics 7, 1 (2010), 40-48.
36. [Schuldt et al. 04] Schuldt, C., Laptev, I. and Caputo, B.: "Recognizing human actions: a local SVM approach." In Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on, 3, IEEE (2004), 32-36.
37. [Siemens and Baker 12] Siemens, G., and d Baker, R. S. J.: "Learning analytics and educational data mining: towards communication and collaboration." In Proceedings of the 2nd international conference on learning analytics and knowledge, ACM (2012), 252-254.
38. [Smith 58] Smith, D. E.: "History of Mathematics;" Special Topics of Elementary Mathematics, 2 (1958).
39. [Stahl 12] Stahl, G.: "Theories of cognition in collaborative learning." International handbook of collaborative learning (2012), 74-90.
40. [Strijbos 11] Strijbos, J. W.: "Assessment of (Computer-Supported) Collaborative Learning." IEEE Transactions on Learning Technologies, 4, 1 (2011), 59-73.
41. [Suthers et al. 03] Suthers, D. D., and Hundhausen, C. D.: "An experimental study of the effects of representational guidance on collaborative learning processes." The Journal of the Learning Sciences, 12, 2 (2003), 183-218.
42. [Tair and El-Halees 12] Tair, M. M. T., and El-Halees, A. M.: "Mining educational data to Improve student's performance: A case study." International Journal of Information and Communication Technology Research, 2, 2 (2012), 1-19.
43. [Taraghi et al. 14] Taraghi, B., Ebner, M., Saranti, A., and Schön, M.: "On Using Markov Chain to Evidence the Learning Structures and Difficulty Levels of One Digit Multiplication." ACM Press (2014), 68-72.
44. [Vanneschi and Poli 12] Vanneschi, L., and Poli, R.: "Genetic Programming-Introduction, Applications, Theory and Open Issues." In Handbook of Natural Computing. Springer Berlin Heidelberg (2012), 709-739.
45. [Webb 01] Webb, G. I.: "Candidate elimination criteria for lazy Bayesian rules." AI 2001: Advances in Artificial Intelligence. Springer Berlin Heidelberg (2001), 545-556.
46. [Xing et al. 14] Xing, W. L., Wadholm, B. and Goggins. S.: "Learning Analytics in CSCL with a Focus on Assessment: An Exploratory Study of Activity Theory-Informed Cluster Analysis." ACM Press (2014), 59-67.
47. [Xing et al. 14] Xing, W. L., Wadholm, B. and Goggins. S.: "Assessment Analytics in CSCL: Activity Theory based Method." In International Conference of Learning Sciences, ICLS, 2014, (pp. 1535-1536).
48. [Zhu 12] Zhu, C.: "Student Satisfaction, Performance, and Knowledge Construction in Online Collaborative Learning." Journal of Educational Technology & Society 15, 1 (2012), 127-136.