Systematic Review of Discussion Forums in Massive Open Online Courses (MOOCs)

IEEE Transactions on Learning Technologies

Volumn 12, Issue 3, 2019, Pages 413-428

  Almatrafi, Omaima ^a   Johri, Aditya ^a  

^a Krasnow Institute for Advanced Study   (United States)

Author keywords

Discussion forums; learning analytics; MOOC; systematic review

Indexed keywords

BIBLIOGRAPHIES; DATABASE SYSTEMS; EDUCATION; ENGINEERING; MONITORING;

DISCUSSION FORUM; LEARNING ANALYTICS; MOOC; STAKEHOLDERS; SYSTEMATIC REVIEW; SYSTEMATICS;

E-LEARNING;

EID: 85050596114     PISSN: None     EISSN: 19391382     Source Type: Journal    
DOI: 10.1109/TLT.2018.2859304     Document Type: Review

References (100)

1. D. Shah, "By the numbers: MOOCS in 2016," Class Central, 2016. Accessed: Apr. 20, 2017 [Online]. Available: https://www.class-central. com/report/moocs-2015-stats/
2. R. Saadatdoost, A. T. H. Sim, H. Jafarkarimi, and J. M. Hee, "Exploring MOOC from education and information systems perspectives: A short literature review," Educ. Rev., vol. 67, no. 4, pp. 505-518, 2015.
3. M. Mazzolini and S. Maddison, "Sage, guide or ghost? The effect of instructor intervention on student participation in online discussion forums," Comput. Educ., vol. 40, no. 3, pp. 237-253, 2003.
4. K. Stephens-Martinez, M. A. Hearst, and A. Fox, "Monitoring MOOCs: Which information sources do instructors value?" in Proc. 1st ACM Conf. Learn. Scale Conf., 2014, pp. 79-88.
5. M. Jenders, R. Krestel, and F. Naumann, "Which answer is Best? Predicting accepted answers in MOOC forums," in Proc. Int. World Wide Web Conf. Committee, 2016, pp. 679-684.
6. G. Veletsianos and P. Shepherdson, "A systematic analysis and synthesis of the empirical MOOC literature published in 2013-2015," Int. Rev. Res. Open Distrib. Learn., vol. 17, no. 2, pp. 1-16, 2016.
7. T. R. Liyanagunawardena, A. A. Adams, and S. A. Williams, "MOOCs: A systematic study of the published literature 2008-2012," Int. Rev. Res. Open Distance Learn., vol. 14, no. 3, pp. 202-227, 2013.
8. M. Ebben and J. S. Murphy, "Unpacking MOOC scholarly discourse: A review of nascent MOOC scholarship," Learn. Media Technol., vol. 39, no. 3, pp. 328-345, 2014.
9. K. R. Clark, B. L. Veale, and L. K. Watts, "A review of the use of massive open online courses (MOOCs) in medical Imaging Education," Internet J. Allied Health Sci. Practice, vol. 15, no. 2, pp. 1-6, 2017.
10. B. Moissa, I. Gasparini, and A. Kemczinski, "A systematic mapping on the learning analytics field and its analysis in the massive open online courses context," Int. J. Distance Educ. Technol., vol. 13, no. 3, pp. 1-24, 2015.
11. M. Petticrew and H. Roberts, "Why do we need systematic reviews?" in Systematic Reviews in the Social Sciences, Oxford, U.K.: Blackwell, 2008, pp. 1-26.
12. M. Borrego, M. J. Foster, and J. E. Froyd, "Systematic literature reviews in engineering education and other developing interdisciplinary fields," J. Eng. Educ., vol. 103, no. 1, pp. 45-76, 2014.
13. R. Cerchione and E. Esposito, "A systematic review of supply chain knowledge management research: State of the art and research opportunities," Int. J. Prod. Econ., vol. 182, pp. 276-292, 2016.
14. M. A. Chatti, A. L. Dyckhoff, U. Schroeder, and H. Thus, "A reference model for learning analytics," Int. J. Technol. Enhanced Learn., vol. 4, no. 5/6, pp. 318-331, 2012.
15. D. Yang, M. Wen, and C. Rose, "Towards identifying the resolvability of threads in MOOCs," in Proc. Empirical Methods Natural Lang. Process., 2014, pp. 21-31.
16. T. Atapattu and K. Falkner, "A framework for topic generation and labeling from MOOC discussions," in Proc. 3rd ACM Conf. Learn. Scale, 2016, pp. 201-204.
17. A. Ezen-Can, K. E. Boyer, S. Kellogg, and S. Booth, "Unsupervised modeling for understanding MOOC discussion forums," in Proc. 5th Int. Conf. Learn. Anal. Knowl., 2015, pp. 146-150.
18. K. C. Chu, C. S. Wang, and J. H. Kuo, "Mining of learning interaction patterns in MOOCs forums," Proc. IEEE 17th Int. Conf. Inf. Reuse Integration, 2016, pp. 631-637.
19. S. Shatnawi, M. M. Gaber, and M. Cocea, "Automatic content related feedback for MOOCs based on course domain ontology," in Proc. Int. Conf. Intell. Data Eng. Autom. Learn., 2014, pp. 27-35.
20. C. G. Brinton, S. Buccapatnam, F. M. F. Wong, M. Chiang, and H. V. Poor, "Social learning networks: Efficiency optimization for MOOC forums," in Proc. 35th Annu. IEEE Int. Conf. Comput. Commun., 2016, pp. 1-9.
21. X. Wei, H. Lin, L. Yang, and Y. Yu, "A convolution-LSTM-based deep neural network for cross-domain MOOC forum post classification," Information, vol. 8, no. 3, pp. 1-16, 2017.
22. D. A. Cook and C. P. West, "Conducting systematic reviews in medical education: A stepwise approach," Med. Educ., vol. 46, no. 10, pp. 943-952, 2012.
23. S. B. Kellogg, S. Booth, and K. M. Oliver, "A social network perspective on peer support learning in MOOCs for educators," Int. Rev. Res. Open Distance Learn., vol. 15, no. 5, pp. 263-289, 2014.
24. J. Reich, D. Tingley, J. Leder-luis, M. E. Roberts, and B. M. Stewart, "Computer-assisted reading and discovery for student-generated text in massive open online courses," J. Learn. Anal., vol. 2, no. 1, pp. 156-184, 2015.
25. N. Gillani and R. Eynon, "Communication patterns in massively open online courses," Internet Higher Educ., vol. 23, pp. 18-26, 2014.
26. J. H. Tomkin and D. Charlevoix, "Do professors matter? Using an A/B test to evaluate the impact of instructor involvement on MOOC student outcomes," in Proc. 1st ACM Conf. Learn. Scale, 2014, pp. 71-77.
27. A. Sharif and B. Magrill, "Discussion forums in MOOCs," Int. J. Learn. Teaching Educational Res., vol. 12, no. 1, pp. 119-132, 2015.
28. J. Huang, A. Dasgupta, A. Ghosh, J. Manning, and M. Sanders, "Superposter behavior in MOOC forums," in Proc. 1st ACM Conf. Learn. Scale, 2014, pp. 117-126.
29. C. P. Rose, P. Goldman, J. Z. Sherer, and L. Resnick, "Supportive technologies for group discussion in MOOCs," Current Issues Emerg. eLearning, vol. 2, no. 1, 2015, Art. no. 18.
30. P. Oleksandra and D. Shane, "Untangling MOOC learner networks," in Proc. 6th Int. Conf. Learn. Anal. Knowl., 2016, pp. 208-212.
31. T. Staubitz, T. Pfeiffer, J. Renz, C. Willems, and C. Meinel, "Collaborative learning in a Mooc environment," in Proc. iCeri, 2015, pp. 8237-8246.
32. E. Mustafaraj and J. Bu, "The visible and invisible in a MOOC discussion forum," in Proc. 2nd ACM Conf. Learn. Scale, 2015, pp. 351-354.
33. C. G. Brinton, M. Chiang, S. Jain, H. Lam, Z. Liu, and F. M. F. Wong, "Learning about social learning in MOOCs: From statistical analysis to generative model," IEEE Trans. Learn. Technol., vol. 7, no. 4, pp. 346-359, Oct.-Dec. 2014.
34. A. A. Tawfik et al., "The nature and level of learner-learner interaction in a chemistry massive open online course," J. Comput. Higher Educ., vol. 29, pp. 411-431, 2017.
35. L. A. Rossi and O. Gnawali, "Language independent analysis and classification of discussion threads in Coursera MOOC forums," in Proc. IEEE 15th Int. Conf. Inf. Reuse Integration, 2014, pp. 654-661.
36. N. Gillani, T. Yasseri, R. Eynon, and I. Hjorth, "Structural limitations of learning in a crowd: Communication vulnerability and information diffusion in MOOCs," Sci. Report, vol. 4, 2014, Art. no. 6447.
37. T. Hecking, I.-A. Chounta, and H. U. Hoppe, "Role modelling in MOOC discussion forums," J. Learn. Anal., vol. 4, no. 1, pp. 85-116, 2017.
38. B. Xu and D. Yang, "Study partners recommendation for xMOOCs learners," Comput. Intell. Neurosci., vol. 2015, 2015, Art. no. 832093.
39. M. Zhu, Y. Bergner, Y. Zhang, R. Baker, Y. Wang, and L. Paquette, "Longitudinal engagement, performance, and social connectivity: A MOOC case study using exponential random graph models," in Proc. 6th Int. Conf. Learn. Anal. Knowl., 2016, pp. 223-230.
40. M. Dubosson and S. Emad, "The forum community, the connectivist element of an xMOOC," Universal J. Educ. Res., vol. 3, no. 10, pp. 680-690, 2015.
41. M. S. Boroujeni, T. Hecking, H. U. Hoppe, and P. Dillenbourg, "Dynamics of MOOC discussion forums," in Proc. 7th Int. Learn. Anal. Knowl. Conf., 2017, pp. 128-137.
42. J. S. Wong, B. Pursel, A. Divinsky, and B. J. Jansen, "Analyzing MOOC discussion forum messages to identify cognitive learning information exchanges," in Proc. Assoc. Inf. Sci. Technol., 2015, vol. 52, pp. 1-10.
43. N. M. M. Dowell, C. Brooks, V. Kovanovic, S. Joksimovic, and D. Gasevic, "The changing patterns of MOOC discourse," in Proc. 4th ACM Conf. Learn. Scale, 2017, pp. 283-286.
44. A. Lamb, J. Smilack, A. Ho, and J. Reich, "Addressing common analytic challenges to randomized experiments in MOOCs," in Proc. 2nd ACM Conf. Learn. Scale, 2015, pp. 21-30.
45. J. S. Wong, B. Pursel, A. Divinsky, and B. J. Jansen, "An analysis of MOOC discussion forum interactions from the most active users," in Proc. Int. Conf. Soc. Comput. Behavioral-Cultural Model. Prediction, 2015, pp. 452-457.
46. Z. Jiang, Y. Zhang, C. Liu, and X. Li, "Influence analysis by heterogeneous network in MOOC forums: What can we discover?" in Proc. 8th Int. Conf. Educ. Data Mining, 2015, pp. 242-249.
47. J. L. Santos, J. Klerkx, E. Duval, D. Gago, and L. Rodriguez, "Success, activity and drop-outs in MOOCs an exploratory study on the UNED COMA courses," in Proc. 4th Int. Conf. Learn. Anal. Knowl., 2014, pp. 98-102.
48. D. Yang, T. Sinha, and D. Adamson, "'Turn on, tune in, drop out': Anticipating student dropouts in massive open online courses," in Proc. NIPS Workshop Data Driven Educ., 2016, pp. 1-8.
49. D. Coetzee, A. Fox, M. A. Hearst, and B. Hartmann, "Should your MOOC forum use a reputation system?" in Proc. 17th ACM Conf. Comput. Supported Cooperative Work Social Comput., 2014, pp. 1176-1187.
50. D. Yang, R. Kraut, and C. Rose, "Exploring the effect of student confusion in massive open online courses," J. Educ. Data Mining, vol. 8, no. 1, pp. 52-83, 2016.
51. A. Sunar, S. White, N. Abdullah, and H. Davis, "How learners' interactions sustain engagement: A MOOC case study," IEEE Trans. Learn. Technol., vol. 10, no. 4, pp. 475-487, Oct.-Dec. 2016.
52. M. Klusener and A. Fortenbacher, "Predicting students' success based on forum activities in MOOCs," in Proc. IEEE 8th Int. Conf. Intell. Data Acquisition Adv. Comput. Syst.: Technol. Appl., 2015, pp. 925-928.
53. A. Ramesh, D. Goldwasser, B. Huang, H. Daume, and L. Getoor, "Understanding MOOC discussion forums using seeded LDA," in Proc. 9th Workshop Innovative Use NLP Building Educ. Appl., 2014, pp. 28-33.
54. D. Yang, M. Wen, A. Kumar, E. P. Xing, and C. P. Rose, "Towards an integration of text and graph clustering methods as a lens for studying social interaction in MOOCs," Int. Rev. Res. Open Distance Learn., vol. 15, no. 5, pp. 215-234, 2014.
55. M. Wen, D. Yang, and C. P. Rose, "Linguistic reflections of student engagement in massive open online courses," in Proc. 8th Int. Conf. Weblogs Social Media, 2014, pp. 525-534.
56. Q. Zhang et al., "Exploring the communication preferences of MOOC learners and the value of preference-based groups: Is grouping enough?" vol. 64, no. 4, pp. 809-837, Mar. 2016.
57. R. F. Kizilcec, E. Schneider, G. L. Cohen, and D. A. McFarland, "Encouraging forum participation in online courses with collectivist, individualist and neutral motivational framings," eLearning Papers, vol. 37, pp. 13-22, 2014.
58. S. Joksimovic, A. Manataki, D. Gasevic, S. Dawson, V. Kovanovic, and I. F. de Kereki, "Translating network position into performance," in Proc. 6th Int. Conf. Learn. Anal. Knowl., 2016, pp. 314-323.
59. A. Anderson, D. Huttenlocher, J. Kleinberg, and J. Leskovec, "Engaging with massive online courses," in Proc. 23rd Int. Conf. World Wide Web, 2014, pp. 687-698.
60. W. Liu, . Kidzinski, and P. Dillenbourg, "Semiautomatic annotation of MOOC forum posts," in Proc. State-The-Art Future Directions Smart Learn., 2016, pp. 399-408.
61. D. J. Zhang, G. Allon, and J. A. van Mieghem, "Does social interaction improve learning outcomes? Evidence from field experiments on massive open online courses," Manuf. Serv. Oper. Manage., vol. 19, no. 3, pp. 347-367, 2017.
62. J. Arguello and K. Shaffer, "Predicting speech acts in MOOC forum posts," in Proc. 9th Int. Conf. Web Social Media, 2015, pp. 2-11.
63. X. Wang, M. Wen, and C. P. Rose, "Towards triggering higher-order thinking behaviors in MOOCs," in Proc. 6th Int. Conf. Learn. Anal. Knowl., 2016, pp. 398-407.
64. R. Anbalagan, A. Kumar, and K. Bijlani, "Footprint model for discussion forums in MOOC," Procedia Comput. Sci., vol. 58, pp. 530-537, 2015.
65. S. Zheng, M. B. Rosson, P. C. Shih, and J. M. Carroll, "Designing MOOCs as interactive places for collaborative learning," in Proc. 2nd ACM Conf. Learn. Scale, 2015, pp. 343-346.
66. I. Howley, G. S. Tomar, O. Ferschke, and C. P. Rose, "Reputation systems impact on help seeking in MOOC discussion forums," IEEE Trans. Learn. Technol., to be published, doi: 10.1109/ TLT.2017.2776273.
67. Q. Zhao, S. Varma, and J. A. Konstan, "In-video reuse of discussion threads in MOOCs," in Proc. 4th ACM Conf. Learn. Scale, 2017, pp. 153-156.
68. D. Yang, M. Piergallini, I. Howley, and C. Rose, "Forum thread recommendation for massive open online courses," in Proc. Educ. Data Mining, 2014, pp. 257-260.
69. D. Yang, D. Adamson, and C. P. Rose, "Question recommendation with constraints for massive open online courses," in Proc. 8th ACM Conf. Recommender Syst., 2014, pp. 49-56.
70. T. Hecking, I. A. Chounta, and H. U. Hoppe, "Analysis of user roles and the emergence of themes in discussion forums," Proc. 2nd Eur. Netw. Intell. Conf., 2015, pp. 114-121.
71. G. S. Stump, J. Deboer, J. Whittinghill, and L. Breslow, "Development of a framework to classify MOOC discussion forum posts: Methodology and challenges," in Proc. NIPS Workshop Data Driven Educ., 2013, pp. 1-20.
72. A.Nylen,N. Thota, A. Eckerdal, P.Kinnunen, M. Butler, and M.Morgan, "Multidimensional analysis of creative coding MOOC forums," in Proc. 15th Koli Calling Conf. Comput. Educ. Res.-Koli Calling, 2015, pp. 137-141.
73. I. A. Chounta, T. Hecking, and H. U. Hoppe, "Every answer has a question: Exploring communication and knowledge exchange in MOOCs through learning analytics," in Proc. CYTED-RITOS Int. Workshop Groupware, 2015, pp. 140-147.
74. A. F. Wise, Y. Cui, W. Q. Jin, and J. Vytasek, "Mining for gold: Identifying content-related MOOC discussion threads across domains through linguistic modeling," Internet Higher Educ., vol. 32, pp. 11-28, 2017.
75. M. Wen, D. Yang, and C. P. Rose, "Sentiment analysis in MOOC discussion forums: What does it tell us?" in Proc. 7th Int. Conf. Educ. Data Mining, 2014, pp. 130-137.
76. A. F. Wise, Y. Cui, and W. Q. Jin, "Honing in on social learning networks in MOOC forums," in Proc. 7th Int. Learn. Anal. Knowl. Conf., 2017, pp. 383-392.
77. R. Fisher, R. Simmons, and C. Malin-Mayor, "Weakly supervised learning of dialogue structure in MOOC forum threads," in Proc. IEEE 14th Int. Conf. Mach. Learn. Appl., 2015, pp. 624-627.
78. S. Chaturvedi, D. Goldwasser, and H. Daume, "Predicting instructor's intervention in MOOC forums," in Proc. Conf. 52nd Annu. Meeting Assoc. Comput. Linguistics, 2014, pp. 1501-1511.
79. N. M. M. Dowell et al., "Modeling learners ' social centrality and performance through language and discourse," in Proc. Educational Data Mining, 2015, pp. 250-257.
80. A. Ramesh, D. Goldwasser, B. Huang, H. Daum, and L. Getoor, "Modeling learner engagement in MOOCs using probabilistic soft logic," in Proc. NIPS Workshop Data Driven Educ., 2013, pp. 1-7.
81. O. Ferschke, I. Howley, G. Tomar, D. Yang, and C. Rose, "Fostering discussion across communication media in massive open online courses," in Proc. 11th Int. Conf. Comput. Supported Collaborative Learn., 2015, pp. 459-466.
82. A. Bakharia, "Towards cross-domain MOOC forum post classification," in Proc. 3rd ACM Conf. Learn. Scale, 2016, pp. 253-256.
83. A. Agrawal, J. Venkatraman, S. Leonard, and A. Paepcke, "YouEDU: Addressing confusion in MOOC discussion forums by recommending instructional video clips," in Proc. 8th Int. Conf. Educ. Data Mining, 2015, pp. 297-304.
84. J. Zhu, J. Warner, M. Gordon, J. White, R. Zanelatto, and P. J. Guo, "Toward a domain-specific visual discussion forum for learning computer programming: An empirical study of a popular MOOC forum," in Proc. IEEE Symp. Visual Lang. Human-Centric Comput., 2015, pp. 101-109.
85. M. K. Chandrasekaran, M.-Y. Kan, B. C. Y. Tan, and K. Ragupathi, "Learning instructor intervention from MOOC forums: Early results and issues," in Proc. 8th Int. Conf. Educ. Data Mining, 2015, pp. 218-225.
86. O. Almatrafi, A. Johri, and H. Rangwala, "Needle in a haystack: Identifying learner posts that require urgent response in MOOC discussion forums," Comput. Educ., vol. 118, pp. 1-9, Mar. 2018.
87. H. Hsu, N. Huang, S. Chen, C. Lee, and J. Tzeng, "Misconceptions mining and visualizations for Chinese-based MOOCs forum based on NLP," in Proc. IEEE 2nd Int. Conf. Big Data Anal., 2017, pp. 634-639.
88. S. Fu, J. Zhao, W. Cui, and H. Qu, "Visual analysis of MOOC forums with iForum," IEEE Trans. Vis. Comput. Graph., vol. 23, no. 1, pp. 201-210, Jan. 2017.
89. J. Zhang, M. Skryabin, and X. Song, "Understanding the dynamics of MOOC discussion forums with simulation investigation for empirical network analysis (SIENA)," Distance Educ., vol. 37, pp. 1-17, 2016.
90. S. Marchena, E. M. Morales-Morgado, and V. Izquierdo, "Potential of the MOOC of MiriadaX for the formation of learning communities," in Proc. 4th Int. Conf. Technol. Ecosyst. Enhancing Multiculturality, 2016, pp. 865-871.
91. S. Jiang, S. M. Fitzhugh, and M. Warschauer, "Social positioning and performance in MOOCs," in Proc. CEUR Workshop, 2014, pp. 55-58.
92. O. Poquet, S. Dawson, and N. Dowell, "How effective is your facilitation? Group-level analytics of MOOC forums," in Proc. 7th Int. Conf. Learn. Anal. Knowl., 2017, pp. 208-217.
93. H. Khalil and M. Ebner, "'How satisfied are you with your MOOC?'- A research study about interaction in huge online courses," J. Mass Commun., vol. 5, no. 12, pp. 629-639, 2015.
94. T. Hecking, I.-A. Chounta, and H. U. Hoppe, "Investigating social and semantic user roles in MOOC discussion forums," in Proc. 6th Int. Conf. Learn. Anal. Knowl., 2016, pp. 198-207.
95. J. Reich, B. Stewart, K. Mavon, and D. Tingley, "The civic mission of MOOCs," in Proc. 3rd ACM Conf. Learn. Scale, 2016, pp. 1-10.
96. E. Longstaff, "Ritual in online communities: A study of post-voting in MOOC discussion forums," Int. J. Human Comput. Interact., vol. 33, no. 8, pp. 655-663, 2017.
97. U. O. Reilly and N. Hoffman, "Sharing in LearnSphere: Study report," CSAIL, MIT, 2017, pp. 1-31.
98. F. Yu and D. Zheng, "Education data mining: How to mine interactive text in MOOCs using natural language process," in Proc. 12th Int. Conf. Comput. Sci. Educ., 2017, pp. 694-699.
99. J. Buder, C. Schwind, A. Rudat, and D. Bodemer, "Selective reading of large online forum discussions: The impact of rating visualizations on navigation and learning," Comput. Human Behav., vol. 44, pp. 191-201, Mar. 2015.
100. C. P. Rose and O. Ferschke, "Technology support for discussion based learning: From computer supported collaborative learning to the future of massive open online courses," Int. J. Artif. Intell. Educ., vol. 26, no. 2, pp. 660-678, 2016.