Using Learning Analytics to Understand the Learning Pathways of Novice Programmers

Journal of the Learning Sciences

Volumn 22, Issue 4, 2013, Pages 564-599

  Berland, Matthew ^a   Martin, Taylor ^b   Benton, Tom ^c   Petrick Smith, Carmen ^d   Davis, Don ^e  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b UTAH STATE UNIVERSITY   (United States)

^c UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^d UNIVERSITY OF VERMONT   (United States)

^e UNIVERSITY OF TEXAS AT SAN ANTONIO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84888001735     PISSN: 10508406     EISSN: None     Source Type: Journal    
DOI: 10.1080/10508406.2013.836655     Document Type: Article

References (78)

1. Adams, J. C. 2007. Alice, middle schoolers, and the imaginary worlds camps. SIGCSE Bulletin, 39: 307 - 311.
2. Baker, R. S. and Yacef, K. 2009. The state of educational data mining in 2009: A review and future visions. Journal of Educational Data Mining, 1: 3 - 17.
3. Baldwin, L. P. and Kuljis, J. 2001. " Learning programming using program visualization techniques ". In In Proceedings of the 34th Annual Hawaii International Conference on System Sciences (Vol. 1, p. 1051). Washington, DC: IEEE Computer Society doi: 10.1109/HICSS.2001.926232
4. Basawapatna, A., Koh, K. H., Repenning, A., Webb, D. C. and Marshall, K. S. 2011. " Recognizing computational thinking patterns ". In Proceedings of the 42nd ACM Technical Symposium on Computer Science Education, 245 - 250. New York, NY: ACM.
5. Beckwith, L., Kissinger, C., Burnett, M., Wiedenbeck, S., Lawrance, J., Blackwell, A. and Cook, C. 2006. " Tinkering and gender in end-user programmers' debugging ". In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 231 - 240. New York, NY: ACM. doi: 10.1145/1124772.1124808
6. Berland, M. 2008. VBOT: Motivating computational and complex systems fluencies with constructionist virtual/physical robotics (Doctoral dissertation), Evanston, IL: Northwestern University.
7. Berland, M., Martin, T. and Benton, T. 2010. " Programming standing up: Embodied computing with constructionist robotics ". In Proceedings of Constructionism 2010 10 - 12. Paris
8. Berland, M., Martin, T., Benton, T. and Petrick, C. 2011. " Programming on the move: Design lessons from IPRO ". In Proceedings of the 2011 ACM Conference on Computer-Human Interaction, 1 - 6. New York, NY: ACM.
9. Blikstein, P. 2011. " Using learning analytics to assess students' behavior in open-ended programming tasks ". In Proceedings of the 1st International Conference on Learning Analytics and Knowledge, 110 - 116. New York, NY: ACM. doi: 10.1145/2090116.2090132
10. Bonar, J. and Soloway, E. 1983. " Uncovering principles of novice programming ". In In Proceedings of the 10th ACM SIGACT-SIGPLAN Symposium on Principles of Programming Languages, 10 - 13. New York, NY: ACM. doi: 10.1145/567067.567069
11. Brandt, J., Guo, P., Lewenstein, J., Dontcheva, M. and Klemmer, S. 2009. " Two studies of opportunistic programming: Interleaving Web foraging, learning, and writing code ". In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1589 - 1598. New York, NY: ACM. doi: 10.1145/1518701.1518944
12. Bransford, J. D., Brown, A. L. and Cocking, R. R. 2000. How people learn: Brain, mind, experience, and school, Washington, DC: National Academies Press.
13. Buechley, L., Eisenberg, M., Catchen, J. and Crockett, A. 2008. " The LilyPad Arduino: Using computational textiles to investigate engagement, aesthetics, and diversity in computer science education ". In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 423 - 432. New York, NY: ACM. doi: 10.1145/1357054.1357123
14. Burke, Q. and Kafai, Y. B. 2010. " Programming & storytelling: Opportunities for learning about coding & composition ". In In Proceedings of the 9th International Conference on Interaction Design and Children, 348 - 351. New York, NY: ACM. doi: 10.1145/1810543.1810611
15. Cheryan, S., Plaut, V. C., Davies, P. G. and Steele, C. M. 2009. Ambient belonging: How stereotypical cues impact gender participation in computer science. Journal of Personality and Social Psychology, 97: 1045 - 1060.
16. Clegg, T. and Kolodner, J. 2007. Bricoleurs and planners engaging in scientific reasoning: A tale of two groups in one learning community. Research and Practice in Technology Enhanced Learning, 2 (3): 239 - 265.
17. Coelho, M., Poupyrev, I., Sadi, S., Vertegaal, R., Berzowska, J., Buechley, L. and Oxman, N. 2009. " Programming reality: From transitive materials to organic user interfaces ". In CHI'09 Extended Abstracts on Human Factors in Computing Systems, 4759 - 4762. New York, NY: ACM. doi: 10.1145/1520340.1520734
18. Coelho, M. and Zigelbaum, J. 2011. Shape-changing interfaces. Personal Ubiquitous Computing, 15 (2): 161 - 173.
19. Cunniff, N., Taylor, R. P. and Black, J. 1989. " Does programming language affect the type of conceptual bugs in beginners' programs? A comparison of FPL and PASCAL ". In Studying the novice programmer, Edited by: Soloway, E. and Spohrer, J. C. 419 - 429. Hillsdale, NJ: Erlbaum.
20. diSessa, A. 2000. Changing minds: Computers, learning, and literacy, Cambridge, MA: MIT Press.
21. Dorn, B. and Guzdial, M. 2010. " Learning on the job: Charactering the programming knowledge and learning strategies of Web designers ". In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 703 - 712. New York, NY: ACM. doi: 10.1145/1753326.1753430
22. Dreyfus, S. and Dreyfus, H. 1980. A five-stage model of the mental activities involved in directed skill activities (Unpublished report), Berkeley.: University of California.
23. Eisenberg, M., Elumeze, N., MacFerrin, M. and Buechley, L. 2009. " Children's programming, reconsidered: Settings, stuff, and surfaces ". In In Proceedings of the 8th International Conference on Interaction Design and Children, 1 - 8. New York, NY: ACM. doi: 10.1145/1551788.1551790
24. Forte, A. and Guzdial, M. 2004. " Computers for communication, not calculation: Media as a motivation and context for learning ". In In Proceedings of the 37th Annual Hawaii International Conference on System Sciences, Track 4, Volume 4, 40096.1 Washington, DC: IEEE Computer Society.
25. Haigh, R. W. 1985. Planning for computer literacy. Journal of Higher Education, 56 (2): 161 - 171.
26. Han, J., Kamber, M. and Pei, J. 2005. Data mining: Concepts and techniques, New York, NY: Morgan Kaufman.
27. Hancock, C. M. 2001, April. Children's understanding of process in the construction of robot behaviors, Seattle, WA.: Paper presented at the annual conference of the American Educational Research Association.
28. Hancock, C. M. 2003. Real-time programming and the big ideas of computational literacy (Unpublished doctoral dissertation), Boston.: Massachusetts Institute of Technology.
29. Helminen, J., Ihantola, P., Karavirta, V. and Malmi, L. 2012. " How do students solve Parsons programming problems? An analysis of interaction traces ". In In Proceedings of the Ninth Annual International Conference on International Computing Education Research, 119 - 126. New York, NY: ACM. doi: 10.1145/2361276.2361300
30. Howe, D. C. 2009. " RiTa: Creativity support for computational literature ". In Proceedings of the 7th ACM Conference on Creativity and Cognition, 205 - 210. New York, NY: ACM. doi: 10.1145/1640233.1640265
31. Hundhausen, C. D., Farley, S. F. and Brown, J. L. 2009. Can direct manipulation lower the barriers to computer programming and promote transfer of training? An experimental study. ACM Transactions on Computer-Human Interaction, 16 (3): 1 - 40.
32. Ingalls, D., Kaehler, T., Maloney, J., Wallace, S. and Kay, A. 1997. " Back to the future: The story of Squeak, a practical Smalltalk written in itself ". In SIGPLAN Notices, 32(10) 318 - 326. doi: 10.1145/263700.263754
33. Kafai, Y., Fields, D. A. and Searle, K. 2012. " Making the connections visible: Crafting, circuitry, and coding in high school e-textile ". In Textile messages: Dispatches from the world of e-textiles and education, Edited by: Buechley, L., Peppler, K., Eisenberg, M. and Kafia, Y. Logan: Utah State University Press.
34. Kelleher, C., Pausch, R. and Kiesler, S. 2007. Storytelling Alice motivates middle school girls to learn computer programming. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1455-1464). New York, NY: ACM. doi:10.1145/1240624.1240844,
35. Klahr, D. and Carver, S. M. 1988. Cognitive objectives in a LOGO debugging curriculum: Instruction, learning, and transfer. Cognitive Psychology, 20: 362 - 404.
36. Klein, D., Cavanagh, R., Kay, K.Meisinger, S.2006Are they ready to work? Employers' perspectives on the basic knowledge and applied skills of new entrants into the 21st century US workforce. http://www.21stcenturyskills.org/documents/FINAL_REPORT_PDF09-29-06.pdf (http://www.21stcenturyskills.org/documents/FINAL_REPORT_PDF09-29-06.pdf)
37. Koedinger, K. R., Cunningham, K., Skogsholm, A. and Leber, B. 2008. " An open repository and analysis tools for fine-grained, longitudinal learner data ". In Educational Data Mining 2008: 1st International Conference on Educational Data Mining Edited by: Baker, R. S. J. d., Barnes, T. and Beck, J. E. 157 - 166. Montreal, Canada
38. Law, L-C. 1998. A situated cognition view about the effects of planning and authorship on computer program debugging. Behaviour & Information Technology, 17 (6): 325 - 337.
39. Maloney, J., Peppler, K., Kafai, Y. B., Resnick, M. and Rusk, N. Programming by choice: Urban youth programming learning with Scratch. Proceedings of the 39th SIGCSE Technical Symposium on Computer Science Education, (2008) (pp. 367-371). New York, NY: ACM. doi:10.1145/1352135.1352260
40. Maloney, J., Resnick, M., Rusk, N., Silverman, B. and Eastmond, E. 2010. The Scratch programming language and environment. ACM Transactions on Computing Education, 10 (4): 1 - 15.
41. Marder, M. and Bansal, D. 2009. Flow and diffusion of high-stakes test scores. Proceedings of the National Academy of Sciences of the United States of America, 106: 17267 - 17270.
42. Margolis, J., Estrella, R., Goode, J., Holme, J. H. and Nao, K. 2008. Stuck in the shallow end: Education, race, and computing, Cambridge, MA: MIT Press.
43. Martin, T. 2008. " Physically distributed learning with virtual manipulatives for elementary mathematics ". In Recent innovations in educational technology that facilitate student learning (pp. 253-275), Edited by: Robinson, D. and Schraw, G. Charlotte, NC: Information Age.
44. Martin, T. 2009. Rethinking the concrete to abstract shift: A theory of physically distributed learning. Child Development Perspectives, 3 (3) 140-144. doi:10.1111/j.1750-8606.2009.00094.x
45. Martin, T., Berland, M., Benton, T. and Smith, C. P. 2013. Learning programming with IPRO: The effects of a mobile, social programming environment. Journal of Interactive Learning Research, 24 (3): 301 - 328.
46. Mattila, J. and Väätänen, A. 2006. " UbiPlay: An interactive playground and visual programming tools for children ". In Proceedings of the 2006 Conference on Interaction Design and Children (pp. 129-136). New York, NY: ACM. doi:10.1145/1139073.1139106
47. Papert, S. 1980. Mindstorms: Children, computers, and powerful ideas, Cambridge, MA: Basic Books.
48. Pears, A., Daniels, M. and Berglund, A. 2002. Describing computer science education research: An academic process view. Simulation Series, 34 (1): 99 - 104.
49. Pelleg, D. and Moore, A. 2000. " X-means: Extending K-means with efficient estimation of the number of clusters ". In In Proceedings of the 17th International Conference on Machine Learning, 727 - 734. San Francisco, CA: Morgan Kaufmann.
50. Perkins, D. N., Hancock, C., Hobbs, R., Martin, F. and Simmons, R. 1986. Conditions of learning in novice programmers. Journal of Educational Computing Research, 2 (1): 37 - 55.
51. Petre, M. and Blackwell, A. 2007. " Children as unwitting end-user programmers ". In Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing, 239 - 242. Washington, DC: IEEE Computer Society. doi: 10.1109/VLHCC.2007.13
52. Petrick, C., Berland, M. and Martin, T. 2011. " Allocentrism and computational thinking ". In Connecting Computer-Supported Collaborative Learning to Policy and Practice: CSCL2011 Conference Proceedings, Edited by: Stahl, G., Spada, H. and Miyake, N. Vol. 2, 666 - 670. Hong Kong: International Society of the Learning Sciences.
53. Putnam, R. T., Sleeman, D., Baxter, J. and Kuspa, L. K. 1989. " A summary of misconceptions of high-school BASIC programmers ". In Studying the novice programmer, Edited by: Soloway, E. and Spohrer, J. C. 301 - 314. Hillsdale, NJ: Erlbaum.
54. Raffle, H. S., Parkes, A. J. and Ishii, H. 2004. " Topobo: A constructive assembly system with kinetic memory ". In In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 647-654). New York, NY: ACM. doi:10.1145/985692.985774
55. Raymond, E. 1999. The cathedral and the bazaar, Sebastopol, CA: O'Reilly.
56. Repenning, A., Ioannidou, A. and Zola, J. 2000. AgentSheets: End-user programmable simulations. Journal of Artificial Societies and Social Simulation, 3 (3) Retrieved from http://jass.soc.surrey.ac.uk/3/3/forum/1.html
57. Resnick, M., Maloney, J., Monroy-Hernandez, A., Rusk, N., Eastmond, E., Brennan, K. and Kafai, Y. 2009. Scratch: Programming for all. Communications of the ACM, 52 (11): 60 - 67.
58. Resnick, M. and Wilensky, U. 1998. Diving into complexity: Developing probabilistic decentralized thinking through role-playing activities. Journal of the Learning Sciences, 7 (2): 153 - 172.
59. Reynolds, R. and Caperton, I. H. 2011. Contrasts in student engagement, meaning-making, dislikes, and challenges in a discovery-based program of game design learning. Educational Technology Research and Development, 59 (2): 267 - 289.
60. Robins, A., Rountree, J. and Rountree, N. 2003. Learning and teaching programming: A review and discussion. Computer Science Education, 13 (2): 137 - 172.
61. Rogalski, J. and Samurçay, R. 1990. " Acquisition of programming knowledge and skills ". In Psychology of programming, Edited by: Hoc, J. M., Green, T. R. G., Samurçay, R. and Gilmore, D. J. 157 - 170. London, England: Academic Press.
62. Rubenking, N. 2001. Hidden messages. PC Magazine, 20 (10): 86 - 88.
63. Shea, N. A. and Duncan, R. G. 2013. From theory to data: The process of refining learning progressions. Journal of the Learning Sciences, 22: 7 - 32.
64. Sherin, B. 2002. Representing geometric constructions as programs: A brief exploration. International Journal of Computers for Mathematical Learning, 7 (1): 101 - 115.
65. Siegler, R. S. 2007. Cognitive variability. Developmental Science, 10: 104 - 109.
66. Soloway, E. and Ehrlich, K. 1984. Empirical studies of programming knowledge. IEEE Transactions on Software Engineering, SE-10(5): 595 - 609. doi: 10.1109/TSE.1984.5010283
67. Soloway, E. and Iyengar, S., eds. 1986. Empirical studies of programmers, Norwood, NJ: Ablex.
68. Soloway, E. and Spohrer, J. C. 1989. Studying the novice programmer, Hillsdale, NJ: Erlbaum.
69. Stefik, A., Siebert, S., Stefik, M. and Slattery, K. 2011. " An empirical comparison of the accuracy rates of novices using the Quorum, Perl, and Randomo programming languages ". In In Proceedings of the 3rd ACM SIGPLAN Workshop on Evaluation and Usability of Programming Languages and Tools, 3 - 8. Portland, OR: ACM.
70. Stonedahl, F., Wilkerson-Jerde, M. and Wilensky, U. 2009. " Reconceiving introductory computer science curricula through agent based modeling ". In In Proceedings of the AAMAS 2009 Workshop on Educational Uses of Multi-Agent Systems, 63 - 70. Budapest: Hungary.
71. Suchman, L. A. 1987. Plans and situated actions: The problem of human-machine communication, Cambridge, England: Cambridge University Press.
72. Turkle, S. and Papert, S. 1990. Epistemological pluralism: Styles and voices within the computer culture. Signs, 16 (1): 128 - 157.
73. Weiser, M. and Shertz, J. 1983. Programming problem representation in novice and expert programmers. International Journal of Man-Machine Studies, 19 (4): 391 - 398.
74. Wilensky, U.1999NetLogo [Computer software]. Evanston, IL: Center for Connected Learning and Computer-Based Modeling. http://ccl.northwestern.edu/netlogo (http://ccl.northwestern.edu/netlogo)
75. Wing, J. M. 2006. Computational thinking. Communications of the ACM, 49 (3): 33 - 35.
76. Wing, J. M. 2008. Computational thinking and thinking about computing. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 366: 3717 - 3725.
77. Winslow, L. E. 1996. Programming pedagogy-A psychological overview. ACM SIGCSE Bulletin, 28 (3): 17 - 22.
78. Yeshno, T. and Ben-Ari, M. 2001. " Salvation for bricoleurs ". In In G. Kadoda (Ed.), Proceedings of the 13th Workshop of the Psychology of Programming Interest Group 225 - 235. Bournemouth, UK