Addressing common analytic challenges to randomized experiments in MOOCs: Attrition and zero-inflation

L@S 2015 - 2nd ACM Conference on Learning at Scale

Volumn , Issue , 2015, Pages 21-30

  Lamb, Anne ^a   Smilack, Jascha ^a   Ho, Andrew ^a   Reich, Justin ^a  

^a HARVARD UNIVERSITY   (United States)

Author keywords

A B testing; Attrition; Engagement; MOOCs; Randomized controlled trials; Treatment on treated; Zero inflation

Indexed keywords

A/B TESTING; ATTRITION; ENGAGEMENT; MOOCS; RANDOMIZED CONTROLLED TRIAL; TREATMENT-ON-TREATED; ZERO-INFLATION;

STUDENTS;

EID: 84928042081     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2724660.2724669     Document Type: Conference Paper

References (15)

1. Abadie, A., Angrist, J. and Imbens, G. Instrumental variables estimates of the effect of subsidized training on the quantiles of trainee earnings. Econometrica, 70, 1 ( 2002), 91-117. DOI=10.1111/1468-0262.00270.
2. Anderson, A., Huttenlocher, D., Kleinberg, J. and Leskovec, J. Engaging with Massive Online Courses. in Proceedings of the 2014 International World Wide Web Conference, (2014), 687-698.
3. Angrist, J. D. Mostly harmless econometrics: An empiricist's companion. Princeton: Princeton University Press, Princeton, 2009.
4. Bakshy, E., Eckles, D. and Bernstein, M. S. Designing and deploying online field experiments. in Proceedings of the 23rd international Conference on World wide web. (2014), 283-292.
5. Breslow, L., Pritchard, D. E., DeBoer, J., Stump, G. S., Ho, A. D. and Seaton, D. Studying learning in the worldwide classroom: Research into edX's first MOOC. Research & Practice in Assessment, 8( 2013), 13-25.
6. Guo, P. J. and Reinecke, K. Demographic differences in how students navigate through MOOCs. in Proceedings of the First ACM Conference on Learning@Scale Conference. (Atlanta, USA, 2014). ACM, 21-30.
7. Ho, A. D., Reich, J., Nesterko, S. O., Seaton, D. T., Mullaney, T., Waldo, J. and Chuang, I. HarvardX and MITx: The First Year of Open Online Courses, Fall 2012-Summer 2013. HarvardX & MITx Working Paper No. 1. , 2014.
8. Huang, J., Dasgupta, A., Ghosh, A., Manning, J. and Sanders, M. Superposter behavior in MOOC forums. in Proceedings of the First ACM Conference on Learning@Scale Conference. (Atlanta, USA, 2014). ACM, 117-126.
9. Kizilcec, R. F., Schneider, E., Cohen, G. and McFarland, D. Encouraging forum participation in online courses with collectivist, individualist, and neutral motivational framings. eLearning Papers, 37( 2014), 13-22.
10. Manning, J. and Sanders, M. How widely used are MOOC forums? A first look. Signals: Thoughts on Online Learning, ( 2013).
11. Nichols, A. IVPOIS: Stata module to estimate an instrumental variables Poisson regression via GMM. Statistical Software Components, ( 2008).
12. O'Hara, R. B. and Kotze, D. J. Do not log-transform count data. Methods in Ecology and Evolution, 1, 2 ( 2010), 118-122. DOI=10.1111/j.2041-210X.2010.00021.x.
13. Rabe-Hesketh, S., Skrondal, A. and Stata Corporation. Multilevel and longitudinal modeling using Stata. Stata Press Publication, College Station, Tex., 2008.
14. Reich, J. MOOC Completion and retention in the context of student intent. EDUCAUSE Review Online, ( 2014).
15. Reich, J., Nesterko, S. O., Seaton, D. T., Mullaney, T., Waldo, J., Chuang, I. and Ho, A. D. JusticeX: Spring 2013 Course Report. HarvardX Working Paper No. 4, 2014.