Methodological issues in developing a multi-dimensional coding procedure for small-group chat communication

Learning and Instruction

Volumn 17, Issue 4, 2007, Pages 394-404

  Strijbos, Jan Willem ^a   Stahl, Gerry ^b  

^a LEIDEN UNIVERSITY   (Netherlands)

^b Drexel University   (United States)

Author keywords

Coding; Content analysis; Methodology; Reliability; Threading

Indexed keywords

EID: 34249790952     PISSN: 09594752     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.learninstruc.2007.03.005     Document Type: Article

References (41)

1. In: Andriessen J., Baker M., and Suthers D. (Eds). Arguing to learn: Confronting cognitions in computer-supported collaborative learning (2003), Kluwer Academic/Springer Verlag, Dordrecht
2. 3 = alpha (or beta) (NLE Technical Note 05-1). University of Essex: Natural Language Engineering and Web Applications Group.
3. Barron B. When smart groups fail. The Journal of the Learning Sciences 12 (2003) 307-359
4. Beers P.J., Boshuizen H.P.A., Kirschner P.A., and Gijselaers W. Computer support for knowledge construction in collaborative learning environments. Computers in Human Behavior 21 (2005) 623-643
5. Cakir, M., Xhafa, F., Zhou, N., & Stahl, G. (2005, July). Thread-based analysis of patterns of collaborative interaction in chat. Paper presented at the 12th international conference on artificial intelligence in education, Amsterdam, The Netherlands.
6. Chi M.T.H. Quantifying qualitative analysis of verbal data: a practical guide. The Journal of the Learning Sciences 6 (1997) 271-315
7. Chiu M.M., and Khoo L. Rudeness and status effects during group problem solving: do they bias evaluations and reduce the likelihood of correct solutions?. Journal of Educational Psychology 95 (2003) 506-523
8. De Wever B., Schellens T., Valcke M., and Van Keer H. Content analysis schemes to analyze transcripts of online asynchronous discussion groups: a review. Computers & Education 46 (2006) 6-28
9. Fischer F., Bruhn J., Gräsel C., and Mandl H. Fostering collaborative knowledge construction with visualization tools. Learning and Instruction 12 (2002) 213-232
10. Fischer F., and Mandl H. Knowledge convergence in computer-supported collaborative learning: the role of external representation tools. The Journal of the Learning Sciences 14 (2005) 405-441
11. Fuks H., Pimentel M., and De Lucena C.J.P. R-U-Typing-2-Me? Evolving a chat tool to increase understanding in learning activities. International Journal of Computer-Supported Collaborative Learning 1 (2006) 117-142
12. Gunawardena C.N., Lowe C.A., and Anderson T. Analysis of a global online debate and the development of an interaction analysis model for examining social construction of knowledge in computer conferencing. Journal of Educational Computing Research 17 (1997) 397-431
13. Henri F. Computer conferencing and content analysis. In: Kaye A. (Ed). Collaborative learning through computer conferencing: The Najaden papers (1992), Springer Verlag, London 117-136
14. Hmelo-Silver C.E. Analyzing collaborative knowledge construction: multiple methods for integrated understanding. Computers & Education 41 (2003) 397-420
15. Hurme T.R., and Järvelä S. Students' activity in computer-supported collaborative problem solving in mathematics. International Journal of Computers for Mathematical Learning 10 (2005) 49-73
16. Jonassen D.H., and Kwon H.I. Communication patterns in computer mediated and face-to-face group problem solving. Educational Technology Research & Development 49 (2001) 35-51
17. Krippendorff K. Reliability in content analysis: some common misconceptions and recommendations. Human Communication Research 30 (2004) 411-433
18. Landis J., and Koch G. The measurement of observer agreement for categorical data. Biometrics 33 (1977) 159-174
19. Mercer N., and Wegerif R. Is "exploratory talk" productive talk?. In: Littleton K., and Light P. (Eds). Learning with computers: Analyzing productive interaction (1999), Routledge, New York, NY 79-101
20. Neuendorf K.A. The content analysis guidebook (2002), Sage publications, Thousand Oaks, CA
21. O'Neill, J., & Martin, D. (2003). Text chat in action. Paper presented at the ACM Conference on Groupware (GROUP 2003), Sanibel Island, FL, USA.
22. Polya G. How to solve it (1985), Princeton University Press, Princeton
23. Renninger K.A., and Farra L. Mentor-participant exchange in the Ask Dr. Math service: Design and implementation considerations. In: Mardis M. (Ed). Digital libraries as complement to K-12 teaching and learning (2003), ERIC Monograph Series 159-173
24. Riffe D., Lacy S., and Fico F.G. Analyzing media messages: Using quantitative content analysis in research (1998), Lawrence Erlbaum Associates, Mahwah, NJ
25. Rourke L., Anderson T., Garrison D.R., and Archer W. Methodological issues in the content analysis of computer conference transcripts. International Journal of Artificial Intelligence in Education 12 (2001) 8-22
26. Schellens T., and Valcke M. Collaborative learning in asynchronous discussion groups: what about the impact on cognitive processing?. Computers in Human Behavior 21 (2005) 957-975
27. Sfard A., and McClain K. Analyzing tools: perspectives on the role of designed artifacts in mathematics learning (special issue). The Journal of the Learning Sciences 11 2 & 3 (2003)
28. Stahl G. Rediscovering CSCL. In: Koschmann T., Hall R., and Miyake N. (Eds). CSCL 2: Carrying forward the conversation (2002), Lawrence Erlbaum Associates, Hillsdale, NJ 169-181
29. Stahl G. Group cognition: Computer support for building collaborative knowledge (2006), MIT Press, Cambridge, MA
30. Stahl, G. (2006b). Virtual Math Teams project: An overview of VMT. Retrieved January 23, 2007, from: http://www.mathforum.org/vmt/researchers/orientation.html.
31. Stahl G. Sustaining group cognition in a math chat environment. Research and Practice in Technology Enhanced Learning (RPTEL) 1 (2006) 85-113
32. Stahl G. Analyzing and designing the group cognitive experience. International Journal of Cooperative Information Systems (IJCIS) 15 (2006) 157-178
33. Stahl G. Supporting group cognitions in an online math community: a cognitive tool for small-group text referencing in chat. Journal of Educational Computing Research 35 (2006) 103-122
34. Stahl G., Koschmann T., and Suthers D. Computer-supported collaborative learning: An historical perspective. In: Sawyer R.K. (Ed). Cambridge handbook of the learning sciences (2006), Cambridge University Press, Cambridge, UK 409-426
35. Strijbos, J. W. (2004). The effect of roles on computer-supported collaborative learning. Unpublished doctoral dissertation, Open University of The Netherlands, Heerlen, The Netherlands.
36. In: Strijbos J.W., Kirschner P.A., and Martens R.L. (Eds). What we know about CSCL: And implementing it in higher education (2004), Kluwer Academic/Springer Verlag, Boston, MA
37. Strijbos J.W., Martens R.L., Jochems W.M.G., and Broers N.J. The effect of functional roles on perceived group efficiency: using multilevel modeling and content analysis to investigate computer-supported collaboration in small groups. Small Group Research 35 (2004) 195-229
38. Strijbos J.W., Martens R.L., Prins F.J., and Jochems W.M.G. Content analysis: what are they talking about?. Computers & Education 46 (2006) 29-48
39. Webb N.M., and Mastergeorge A.M. The development of students' helping behaviour and learning in peer-directed small groups. Cognition & Instruction 21 (2003) 361-428
40. Weinberger A., and Fischer F. A framework to analyze argumentative knowledge construction in computer-supported collaborative learning. Computers & Education 46 (2006) 71-95
41. Zemel, A., Xhafa, F., & Stahl, G. (2005, September). Analyzing the organization of collaborative math problem-solving in online chats using statistics and conversation analysis. Paper presented at CRIWIG 2005 conference, Recipe, Brazil.