What makes a great MOOC? An interdisciplinary analysis of student retention in online courses

International Conference on Information Systems (ICIS 2013): Reshaping Society Through Information Systems Design

Volumn 5, Issue , 2013, Pages 4720-4740

  Adamopoulos, Panagiotis ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

Choice models; Econometric analysis; Grounded theory method; Massive Open Online Courses; MOOCs; Online learning; Opinion mining; Predictive modeling; Student retention; Text mining; User satisfaction; User generated content; Utility

Indexed keywords

CHOICE MODEL; ECONOMETRIC ANALYSIS; GROUNDED THEORY METHODS; MASSIVE OPEN ONLINE COURSE; MOOCS; ONLINE LEARNING; OPINION MINING; PREDICTIVE MODELING; STUDENT RETENTION; TEXT MINING; USER SATISFACTION; USER-GENERATED CONTENT; UTILITY;

CURRICULA; DATA MINING; EDUCATION COMPUTING; INFORMATION SYSTEMS; LEARNING SYSTEMS; STUDENTS; VIRTUAL REALITY;

E-LEARNING;

EID: 84897795912     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (103)

1. Aciar, S., Zhang, D., Simoff, S., and Debenham, J. 2006. "Recommender System Based on Consumer Product Reviews, " in: Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence. Washington, DC, USA: IEEE Computer Society, pp. 719-723.
2. Adamopoulos, P. 2013. "Beyond Rating Prediction Accuracy: On New Perspectives in Recommender Systems, " Proceedings of the seventh ACM conference on Recommender Systems (RecSys'13), Hong Kong, China: ACM.
3. Adamopoulos, P., and Tuzhilin, A. 2011. "On Unexpectedness in Recommender Systems: Or How to Expect the Unexpected, " Workshop on Novelty and Diversity in Recommender Systems (DiveRS 2011), at the 5th ACM International Conference on Recommender Systems (RecSys'11), P. Castells, J. Wang, R. Lara and D. Zhang (eds.), Chicago, Illinois, USA: ACM, pp. 11-18.
4. Adamopoulos, P., and Tuzhilin, A. 2013a. "On Unexpectedness in Recommender Systems: Or How to Better Expect the Unexpected, " NYU Working Paper No. 2451/31832, June 19, 2013, pp. 1-50.
5. Adamopoulos, P., and Tuzhilin, A. 2013b. "Recommendation Opportunities: Improving Item Prediction Using Weighted Percentile Methods in Collaborative Filtering Systems, " Proceedings of the seventh ACM conference on Recommender Systems (RecSys'13), Hong Kong, China: ACM.
6. Adomavicius, G., and Tuzhilin, A. 2005. "Toward the Next Generation of Recommender Systems: A Survey of the State-of-the-Art and Possible Extensions, " Ieee Transactions on Knowledge and Data Engineering (17:6), Jun, pp. 734-749.
7. Agresti, A. 2002. Categorical Data Analysis. Wiley-interscience.
8. AlchemyApi. 2012. "Orchestr8, Llc. " from http://www.alchemyapi.com/
9. Archak, N., Ghose, A., and Ipeirotis, P.G. 2007. "Show Me the Money!: Deriving the Pricing Power of Product Features by Mining Consumer Reviews, " in: Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining. San Jose, California, USA: ACM, pp. 56-65.
10. Archak, N., Ghose, A., and Ipeirotis, P.G. 2011. "Deriving the Pricing Power of Product Features by Mining Consumer Reviews, " Management Science (57:8), Aug, pp. 1485-1509.
11. Armstrong, J.S. 2012. "Natural Learning in Higher Education, " in Encyclopedia of the Sciences of Learning. Springer, pp. 2426-2433.
12. Avakian, A.N., Mackinney, A.C., and Allen, G.R. 1982. "Race and Sex-Differences in Student Retention at an Urban University, " College and University (57:2), pp. 160-165.
13. Bean, J.P. 1985. "Interaction Effects Based on Class Level in an Explanatory Model of College-Student Dropout Syndrome, " American Educational Research Journal (22:1), pp. 35-64.
14. Bedford, M.H., and Durkee, P.E. 1989. "Retention: Some More Ideas, " NASPA Journal (27:2), pp. 168-171.
15. Bickart, B., and Schindler, R.M. 2001. "Internet Forums as Influential Sources of Consumer Information, " Journal of interactive marketing (15:3), pp. 31-40.
16. Birks, D.F., Fernandez, W., Levina, N., and Nasirin, S. 2013. "Grounded Theory Method in Information Systems Research: Its Nature, Diversity and Opportunities, " European Journal of Information Systems (22:1), Jan, pp. 1-8.
17. Boudreau, C.A., and Kromrey, J.D. 1994. "A Longitudinal-Study of the Retention and Academic-Performance of Participants in Freshmen Orientation Course, " Journal of College Student Development (35:6), Nov, pp. 444-449.
18. Breiman, L. 2001. "Random Forests, " Machine Learning (45:1), Oct, pp. 5-32.
19. Breiman, L., Friedman, J., Stone, C.J., and Olshen, R.A. 1984. Classification and Regression Trees. Chapman & Hall/CRC.
20. Bruce, R.F., and Wiebe, J.M. 1999. "Recognizing Subjectivity: A Case Study in Manual Tagging, " Natural Language Engineering (5:2), pp. 187-205.
21. Cabrera, A.F., Castañeda, M.B., Nora, A., and Hengstler, D. 1992. "The Convergence between Two Theories of College Persistence, " The Journal of Higher Education (63:2), pp. 143-164.
22. Chang, C.C., and Lin, C.J. 2011. "Libsvm: A Library for Support Vector Machines, " Acm Transactions on Intelligent Systems and Technology (2:3), p. 27.
23. Clow, D. 2013. "Moocs and the Funnel of Participation, " in: Proceedings of the Third International Conference on Learning Analytics and Knowledge. Leuven, Belgium: ACM, pp. 185-189.
24. Corbin, J., and Strauss, A. 2007. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. Sage Publications, Incorporated.
25. Cormier, D., and Siemens, G. 2010. "The Open Course: Through the Open Door--Open Courses as Research, Learning, and Engagement, " Educause Review (45:4), pp. 30-32.
26. CourseTalk. org. 2012. "Coursetalk. Org. " from http://coursetalk.org/
27. Das, S.R., and Chen, M.Y. 2007. "Yahoo! For Amazon: Sentiment Extraction from Small Talk on the Web, " Management Science (53:9), Sep, pp. 1375-1388.
28. Dave, K., Lawrence, S., and Pennock, D.M. 2003. "Mining the Peanut Gallery: Opinion Extraction and Semantic Classification of Product Reviews, " in: Proceedings of the 12th international conference on World Wide Web. Budapest, Hungary: ACM, pp. 519-528.
29. Dey, E.L. 1997. "Working with Low Survey Response Rates: The Efficacy of Weighting Adjustments, " Research in Higher Education (38:2), 1997/04/01, pp. 215-227.
30. Dey, E.L., and Astin, A.W. 1993. "Statistical Alternatives for Studying College-Student Retention-a Comparative-Analysis of Logit, Probit, and Linear-Regression, " Research in Higher Education (34:5), Oct, pp. 569-581.
31. Dhar, V., and Chang, E.A. 2009. "Does Chatter Matter? The Impact of User-Generated Content on Music Sales, " Journal of Interactive Marketing (23:4), 11//, pp. 300-307.
32. Downes, S. 2010. "Learning Networks and Connective Knowledge, " Collective intelligence and e-learning (2), pp. 1-26.
33. Eisenhardt, K.M. 1989. "Building Theories from Case-Study Research, " Academy of Management Review (14:4), Oct, pp. 532-550.
34. Fellbaum, C. 1998. Wordnet: An Electronic Lexical Database. Cambridge, MA: MIT Press.
35. Fox, A., and Patterson, D. 2012. "Crossing the Software Education Chasm, " Communications of the Acm (55:5), May, pp. 44-49.
36. Fuller, R.B. 1962. Education Automation: Freeing the Scholar to Return to His Studies: A Discourse before the Southern Illinois University, Edwardsville Campus Planning Committee, April 22, 1961. Southern Illinois University Press.
37. Ghani, R., Probst, K., Liu, Y., Krema, M., and Fano, A. 2006. "Text Mining for Product Attribute Extraction, " ACM SIGKDD Explorations Newsletter (8:1), pp. 41-48.
38. Ghose, A., and Ipeirotis, P.G. 2011. "Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics, " Ieee Transactions on Knowledge and Data Engineering (23:10), Oct, pp. 1498-1512.
39. Ghose, A., Ipeirotis, P.G., and Li, B. 2012. "Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowdsourced Content, " Marketing Science (31:3), May-Jun, pp. 493-520.
40. Glaser, B.G. 1998. Doing Grounded Theory: Issues and Discussions. Sociology Press.
41. Glaser, B.G., and Strauss, A.L. 1967. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine de Gruyter.
42. Glass Jr, J.C., and Garrett, M.S. 1995. "Student Participation in a College Orientation Course, Retention, and Grade Point Average, " Community College Journal of Research and Practice (19:2), pp. 117-132.
43. Goldsmith, R.E., and Horowitz, D. 2006. "Measuring Motivations for Online Opinion Seeking, " Journal of Interactive Advertising (6:2), pp. 1-16.
44. Green, P.E., and Srinivasan, V. 1990. "Conjoint-Analysis in Marketing-New Developments with Implications for Research and Practice, " Journal of Marketing (54:4), Oct, pp. 3-19.
45. Greene, W. 2003. Econometric Analysis. Pearson Education.
46. Harasim, L., Hiltz, S.R., Teles, L., and Turoff, M. 1995. Learning Networks: A Field Guide to Teaching and Learning on-Line. MIT press.
47. Heiberger, R.M. 1993. "Predicting Next Year's Enrollment: Survival Analysis of University Student Enrollment Histories, " Proceedings of the American Statistical Association, Social Statistical Section, pp. 143-148.
48. Hennig-Thurau, T., Gwinner, K.P., Walsh, G., and Gremler, D.D. 2004. "Electronic Word-of-Mouth Via Consumer-Opinion Platforms: What Motivates Consumers to Articulate Themselves on the Internet?, " Journal of interactive marketing (18:1), pp. 38-52.
49. Hu, M., and Liu, B. 2004a. "Mining and Summarizing Customer Reviews, " in: Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining. pp. 168-177.
50. Hu, M., and Liu, B. 2004b. "Mining Opinion Features in Customer Reviews, " in: Proceedings of the National Conference on Artificial Intelligence. pp. 755-760.
51. Hyman, R.E. 1995. "Creating Campus Partnerships for Student Success, " College and University (71:2), pp. 2-8.
52. Iiyoshi, T., and Kumar, S.V. 2008. Opening up Education: The Collective Advancement of Education through Open Technology, Open Content, and Open Knowledge. Mit Press.
53. Jaggars, S.S. 2012. "Beyond Flexibility: Why Students Choose Online Courses in Community College. " American Educational Research Association Annual Meeting, Vancouver, Canada.
54. Joglekar, M., Garcia-Molina, H., and Parameswaran, A. 2013. "Evaluating the Crowd with Confidence, " in: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining. Chicago, Illinois, USA: ACM, pp. 686-694.
55. Johnson, R. 1996. "The Adult Student: Motivation and Retention, " American Music Teacher (46:2), pp. 16-19.
56. Knight, D.W., Carlson, L.E., and Sullivan, J. 2007. "Improving Engineering Student Retention through Hands-on, Team Based, First-Year Design Projects, " Proceedings of the International Conference on Research in Engineering Education.
57. Knowledge@Wharton. 2013. "Moocs on the Move: How Coursera Is Disrupting the Traditional Classroom. " Innovation and Entrepreneurship Articles Retrieved September 5, 2013, from http://knowledge.wharton.upenn.edu/article.cfm?articleid=3109
58. Lee, T., and Bradlow, E.T. 2007. "Automatic Construction of Conjoint Attributes and Levels from Online Customer Reviews, " University Of Pennsylvania, The Wharton School Working Paper.
59. Lewin, T. 2013. "Universities Abroad Join Partnerships on the Web, " in: The New York Times February 21, 2013: p. A18.
60. Liu, Y. 2001. "Word-of-Mouth for Movies: Its Dynamics and Impact on Box Office Revenue, " Journal of marketing (70:3), pp. 74-89.
61. Mackness, J., Mak, S., and Williams, R. 2010. "The Ideals and Reality of Participating in a Mooc, " Networked Learing Conference: University of Lancaster, pp. 266-275.
62. MacNeely, J.H. 1938. College Student Mortality. US Government Printing Office.
63. Mak, S., Williams, R., and Mackness, J. 2010. "Blogs and Forums as Communication and Learning Tools in a Mooc, " in: Networked Learing Conference. pp. 275-285.
64. Manning, C.D., and Schütze, H. 1999. Foundations of Statistical Natural Language Processing. MIT press.
65. Margahny, M., and Mitwaly, A. 2005. "Fast Algorithm for Mining Association Rules, " in: the conference proceedings of AIML, CICC, pp (36-40) Cairo, Egypt. pp. 19-21.
66. Masters, K. 2011. "A Brief Guide to Understanding Moocs, " The Internet Journal of Medical Education (1:2).
67. McFadden, D. 1974. "Conditional Logit Analysis of Qualitative Choice Behavior, " in: Frontiers in Econometrics. Academic Press, pp. 105-142.
68. McFadden, D. 1978. Quantitative Methods for Analyzing Travel Behavior of Individuals: Some Recent Developments. London: Croom Helm.
69. Moore, R., and Miller, I. 1996. "How the Use of Multimedia Affects Student Retention and Learning, " Journal of College Science Teaching (25:4), pp. 289-293.
70. Morris, E.K., Surber, C.F., and Bijou, S.W. 1978. "Self-Pacing Versus Instructor-Pacing-Achievement, Evaluations, and Retention, " Journal of Educational Psychology (70:2), pp. 224-230.
71. Muchnik, L., Aral, S., and Taylor, S.J. 2013. "Social Influence Bias: A Randomized Experiment, " Science (341:6146), August 9, 2013, pp. 647-651.
72. Murtaugh, P.A., Burns, L.D., and Schuster, J. 1999. "Predicting the Retention of University Students, " Research in Higher Education (40:3), Jun, pp. 355-371.
73. Nandeshwar, A., Menzies, T., and Nelson, A. 2011. "Learning Patterns of University Student Retention, " Expert Systems with Applications (38:12), 11//, pp. 14984-14996.
74. Naretto, J.A. 1995. "Adult Student Retention: The Influence of Internal and External Communities, " NASPA journal (32:2), pp. 90-97.
75. Netzer, O., Toubia, O., Bradlow, E.T., Dahan, E., Evgeniou, T., Feinberg, F.M., Feit, E.M., Hui, S.K., Johnson, J., Liechty, J.C., Orlin, J.B., and Rao, V.R. 2008. "Beyond Conjoint Analysis: Advances in Preference Measurement, " Marketing Letters (19:3-4), Dec, pp. 337-354.
76. Olsen, A. 2008. "Staying the Course: Retention and Attrition in Australian Universities. " Paper for the Australian Universities International Directors' Forum Retrieved September 5, 2013, from http://trove.nla.gov.au/work/153059543?q&versionId=166810055
77. Pang, B., and Lee, L. 2008. Opinion Mining and Sentiment Analysis. Now Pub.
78. Pang, B., Lee, L., and Vaithyanathan, S. 2002. "Thumbs Up?: Sentiment Classification Using Machine Learning Techniques, " in: Proceedings of the ACL-02 conference on Empirical methods in natural language processing-Volume 10. Association for Computational Linguistics, pp. 79-86.
79. Pantages, T.J., and Creedon, C.F. 1978. "Studies of College Attrition-1950-1975, " Review of Educational Research (48:1), pp. 49-101.
80. Pappano, L. 2012. "The Year of the Mooc, " in: The New York Times. November 4, 2012: p. ED26
81. Pascarella, E.T. 1980. "Student-Faculty Informal Contact and College Outcomes, " Review of Educational Research (50:4), pp. 545-595.
82. Person, D.R., and Christensen, M.C. 1996. "Understanding Black Student Culture and Black Student Retention, " Journal of Student Affairs Research and Practice (34:1), pp. 70-79.
83. Piech, C., Huang, J., Chen, Z., Do, C., Ng, A., and Koller, D. 2013. "Tuned Models of Peer Assessment in Moocs, " 6th International Conference on Educational Data Mining, Memphis, Tennessee, USA.
84. Postmes, T., Spears, R., Sakhel, K., and De Groot, D. 2001. "Social Influence in Computer-Mediated Communication: The Effects of Anonymity on Group Behavior, " Personality and Social Psychology Bulletin (27:10), pp. 1243-1254.
85. Provost, F., and Fawcett, T. 2013. Data Science for Business: What You Need to Know About Data Mining and Data-Analytic Thinking. O'Reilly Media.
86. Rankings, Q.W.U. 2012. "Qs Quacquarelli Symonds, Ltd. " Retrieved September 5, 2013, from http://www.topuniversities.com
87. Russell, D.M., Klemmer, S., Fox, A., Latulipe, C., Duneier, M., and Losh, E. 2013. "Will Massive Online Open Courses (Moocs) Change Education?, " in: CHI '13 Extended Abstracts on Human Factors in Computing Systems. Paris, France: ACM, pp. 2395-2398.
88. Sadigh, D., Seshia, S.A., and Gupta, M. 2012. "Automating Exercise Generation: A Step Towards Meeting the Mooc Challenge for Embedded Systems, " Proceedings of the Workshop on Embedded Systems Education (WESE), ESWeek.
89. Singh, R., Gulwani, S., and Solar-Lezama, A. 2013. "Automated Feedback Generation for Introductory Programming Assignments, " SIGPLAN Not. (48:6), pp. 15-26.
90. Spady, W.G. 1970. "Dropouts from Higher Education: An Interdisciplinary Review and Synthesis, " Interchange (1:1), pp. 64-85.
91. Suddaby, R. 2006. "From the Editors: What Grounded Theory Is Not, " Academy of management journal (49:4), pp. 633-642.
92. Terzi, M., Ferrario, M.A., and Whittle, J. 2011. "Free Text in User Reviews: Their Role in Recommender Systems, " Workshop on Recommender Systems and the Social Web at the 5th ACM International Conference on Recommender Systems (RecSys'11), Chicago, Illinois, USA: ACM, pp. 45-48.
93. Tinto, V. 1975. "Dropout from Higher Education: A Theoretical Synthesis of Recent Research, " Review of educational research (45:1), pp. 89-125.
94. Tinto, V. 1987. Leaving College: Rethinking the Causes and Cures of Student Attrition. ERIC.
95. Train, K.E. 2003. Discrete Choice Methods with Simulation. Cambridge University Press.
96. Tresman, S. 2002. "Towards a Strategy for Improved Student Retention in Programmes of Open, Distance Education: A Case Study from the Open University Uk, " The International Review of Research in Open and Distance Learning (3:1).
97. Urquhart, C., and Fernandez, W. 2013. "Using Grounded Theory Method in Information Systems: The Researcher as Blank Slate and Other Myths, " Journal of Information Technology (28), 01/29/online, pp. 224-236.
98. Vaast, E., and Walsham, G. 2011. "Grounded Theorizing for Electronically Mediated Social Contexts, " European Journal of Information Systems (22:1), pp. 9-25.
99. Vihavainen, A., Luukkainen, M., and Kurhila, J. 2012. "Multi-Faceted Support for Mooc in Programming, " in: Proceedings of the 13th annual conference on Information technology education. Calgary, Alberta, Canada: ACM, pp. 171-176.
100. Willging, P.A., and Johnson, S.D. 2004. "Factors That Influence Students' Decision to Dropout of Online Courses, " Journal of Asynchronous Learning Networks (8:4), pp. 105-118.
101. Xenos, M., Pierrakeas, C., and Pintelas, P. 2002. "A Survey on Student Dropout Rates and Dropout Causes Concerning the Students in the Course of Informatics of the Hellenic Open University, " Computers & Education (39:4), Dec, pp. 361-377.
102. Xu, D., and Jaggars, S. 2013. "Adaptability to Online Learning: Differences across Types of Students and Academic Subject Areas. " CCRC Working Paper No. 54. Retrieved September 5, 2013, from http://ccrc.tc.columbia.edu/media/k2/attachments/adaptability-to-online-learning.pdf
103. Yu, H.F., Huang, F.L., and Lin, C.J. 2011. "Dual Coordinate Descent Methods for Logistic Regression and Maximum Entropy Models, " Machine Learning (85:1-2), Oct, pp. 41-75.