메뉴 건너뛰기




Volumn 27, Issue 4, 2015, Pages 645-656

When Is It Better to Learn Together? Insights from Research on Collaborative Learning

Author keywords

Collaboration; Instruction; Learning; Mechanisms

Indexed keywords


EID: 84948567975     PISSN: 1040726X     EISSN: 1573336X     Source Type: Journal    
DOI: 10.1007/s10648-015-9312-8     Document Type: Article
Times cited : (206)

References (73)
  • 1
    • 84984116634 scopus 로고
    • Recall suffers from collaboration: joint recall effects of friendship and task complexity
    • Andersson, J., & Rönnberg, J. (1995). Recall suffers from collaboration: joint recall effects of friendship and task complexity. Applied Cognitive Psychology, 9(3), 199–211.
    • (1995) Applied Cognitive Psychology , vol.9 , Issue.3 , pp. 199-211
    • Andersson, J.1    Rönnberg, J.2
  • 3
    • 0031483495 scopus 로고    scopus 로고
    • Dyadic versus individual training protocols: loss and reacquisition of a complex skill
    • Arthur, W., Jr., Day, E. A., Bennett, W., Jr., McNelly, T. L., & Jordan, J. A. (1997). Dyadic versus individual training protocols: loss and reacquisition of a complex skill. Journal of Applied Psychology, 82(5), 783–791.
    • (1997) Journal of Applied Psychology , vol.82 , Issue.5 , pp. 783-791
    • Arthur, W.1    Day, E.A.2    Bennett, W.3    McNelly, T.L.4    Jordan, J.A.5
  • 4
    • 0002717571 scopus 로고
    • Peer interaction and problem solving: when are two heads better than one?
    • Azmitia, M. (1988). Peer interaction and problem solving: when are two heads better than one? Child Development, 59(1), 87–96.
    • (1988) Child Development , vol.59 , Issue.1 , pp. 87-96
    • Azmitia, M.1
  • 6
    • 84856193737 scopus 로고    scopus 로고
    • Learning and remembering with others: the key role of retrieval in shaping group recall and collective memory
    • Barber, S. J., Rajaram, S., & Fox, E. B. (2012). Learning and remembering with others: the key role of retrieval in shaping group recall and collective memory. Social Cognition, 30(1), 121–122.
    • (2012) Social Cognition , vol.30 , Issue.1 , pp. 121-122
    • Barber, S.J.1    Rajaram, S.2    Fox, E.B.3
  • 11
    • 22944445274 scopus 로고    scopus 로고
    • Quintilian: a classic educator speaks to the writing process
    • Bloodgood, J. W. (2002). Quintilian: a classic educator speaks to the writing process. Reading, Research and Instruction, 42(1), 30–43.
    • (2002) Reading, Research and Instruction , vol.42 , Issue.1 , pp. 30-43
    • Bloodgood, J.W.1
  • 12
    • 84970670988 scopus 로고    scopus 로고
    • Cooperative activities in the classroom
    • Bossert, S. T. (1988/1989). Cooperative activities in the classroom. Review of Research in Education, 15, 225–250.
    • Review of Research in Education , vol.15 , pp. 225-250
    • Bossert, S.T.1
  • 13
    • 70350717339 scopus 로고    scopus 로고
    • Active-constructive-interactive: a conceptual framework for differentiating learning activities
    • Chi, M. T. H. (2009). Active-constructive-interactive: a conceptual framework for differentiating learning activities. Topics in Cognitive Science, 1(1), 73–105.
    • (2009) Topics in Cognitive Science , vol.1 , Issue.1 , pp. 73-105
    • Chi, M.T.H.1
  • 14
    • 84918546411 scopus 로고    scopus 로고
    • The ICAP framework: linking cognitive engagement to active learning outcomes
    • Chi, M. T. H., & Wiley, R. (2014). The ICAP framework: linking cognitive engagement to active learning outcomes. Educational Psychologist, 49(4), 219–243.
    • (2014) Educational Psychologist , vol.49 , Issue.4 , pp. 219-243
    • Chi, M.T.H.1    Wiley, R.2
  • 15
    • 0014503043 scopus 로고
    • Effect of perceived expertness upon creativity of members of brainstorming groups
    • Collaros, P. A., & Anderson, L. R. (1969). Effect of perceived expertness upon creativity of members of brainstorming groups. Journal of Applied Psychology, 53(2), 159–163.
    • (1969) Journal of Applied Psychology , vol.53 , Issue.2 , pp. 159-163
    • Collaros, P.A.1    Anderson, L.R.2
  • 16
    • 82855166029 scopus 로고    scopus 로고
    • The influence of learning methods on collaboration: prior repeated retrieval enhances retrieval organization, abolishes collaborative inhibition, and promotes post-collaborative memory
    • Congleton, A. R., & Rajaram, S. (2011). The influence of learning methods on collaboration: prior repeated retrieval enhances retrieval organization, abolishes collaborative inhibition, and promotes post-collaborative memory. Journal of Experimental Psychology: General, 140(4), 535–551.
    • (2011) Journal of Experimental Psychology: General , vol.140 , Issue.4 , pp. 535-551
    • Congleton, A.R.1    Rajaram, S.2
  • 17
    • 70449467409 scopus 로고    scopus 로고
    • Improving classroom learning by collaboratively observing human tutoring videos while problem solving
    • Craig, S. D., Chi, M. T. H., & VanLehn, K. (2009). Improving classroom learning by collaboratively observing human tutoring videos while problem solving. Journal of Educational Psychology, 101(4), 779–789.
    • (2009) Journal of Educational Psychology , vol.101 , Issue.4 , pp. 779-789
    • Craig, S.D.1    Chi, M.T.H.2    VanLehn, K.3
  • 18
    • 0032380092 scopus 로고    scopus 로고
    • Effects of cooperative and individual learning during learner-controlled computer-based instruction
    • Crooks, S. M., Klein, J. D., Savenye, W., & Leader, L. (1998). Effects of cooperative and individual learning during learner-controlled computer-based instruction. The Journal of Experimental Education, 66(3), 223–244.
    • (1998) The Journal of Experimental Education , vol.66 , Issue.3 , pp. 223-244
    • Crooks, S.M.1    Klein, J.D.2    Savenye, W.3    Leader, L.4
  • 19
    • 0346904659 scopus 로고
    • Productivity loss in brainstorming groups: toward the solution of a riddle
    • Diehl, M., & Stroebe, W. (1987). Productivity loss in brainstorming groups: toward the solution of a riddle. Journal of Personality and Social Psychology, 53, 497–509.
    • (1987) Journal of Personality and Social Psychology , vol.53 , pp. 497-509
    • Diehl, M.1    Stroebe, W.2
  • 22
    • 84920743798 scopus 로고    scopus 로고
    • The productive disciplinary engagement framework: Origins, key concepts, and developments
    • Dai DY, (ed), Routledge, New York
    • Engle, R. A. (2012). The productive disciplinary engagement framework: Origins, key concepts, and developments. In D. Y. Dai (Ed.), Design research on learning and thinking in educational settings (pp. 161–200). New York: Routledge.
    • (2012) Design research on learning and thinking in educational settings , pp. 161-200
    • Engle, R.A.1
  • 24
    • 84861224939 scopus 로고    scopus 로고
    • Collaborative facilitation through error-detection: a classroom experiment
    • Gadgil, S., & Nokes-Malach, T. J. (2012). Collaborative facilitation through error-detection: a classroom experiment. Applied Cognitive Psychology, 26(3), 410–420.
    • (2012) Applied Cognitive Psychology , vol.26 , Issue.3 , pp. 410-420
    • Gadgil, S.1    Nokes-Malach, T.J.2
  • 25
    • 37849186012 scopus 로고    scopus 로고
    • Promoting constructive activities that support vicarious learning during computer-based instruction
    • Gholson, B., & Craig, S. D. (2006). Promoting constructive activities that support vicarious learning during computer-based instruction. Educational Psychology Review, 18, 119–139.
    • (2006) Educational Psychology Review , vol.18 , pp. 119-139
    • Gholson, B.1    Craig, S.D.2
  • 28
    • 34248435160 scopus 로고
    • Group versus individual performance: are n + 1 heads better than one
    • Hill, G. W. (1982). Group versus individual performance: are n + 1 heads better than one. Psychological Bulletin, 91(3), 517–539.
    • (1982) Psychological Bulletin , vol.91 , Issue.3 , pp. 517-539
    • Hill, G.W.1
  • 30
    • 0001430347 scopus 로고
    • The internal dynamics of cooperative learning groups
    • Slavin R, Sharan S, Kagan S, Hertz-Lazarowitz R, Webb C, Schmuck R, (eds), Plenum Press, New York
    • Johnson, D., & Johnson, R. (1985). The internal dynamics of cooperative learning groups. In R. Slavin, S. Sharan, S. Kagan, R. Hertz-Lazarowitz, C. Webb, & R. Schmuck (Eds.), Learning to cooperate, cooperating to learn (pp. 103–124). New York: Plenum Press.
    • (1985) Learning to cooperate, cooperating to learn , pp. 103-124
    • Johnson, D.1    Johnson, R.2
  • 32
    • 77951444850 scopus 로고    scopus 로고
    • An educational psychology success story: social interdependence theory and cooperative learning
    • Johnson, D. W., & Johnson, R. T. (2009). An educational psychology success story: social interdependence theory and cooperative learning. Educational Researcher, 38(5), 365–379.
    • (2009) Educational Researcher , vol.38 , Issue.5 , pp. 365-379
    • Johnson, D.W.1    Johnson, R.T.2
  • 33
    • 84948585624 scopus 로고    scopus 로고
    • Cooperative learning methods: a meta-analysis. Retrieved April 14
    • Johnson, D. W., Johnson, R. T., & Stanne, M. B. (2000). Cooperative learning methods: a meta-analysis. Retrieved April 14, 2015 from www.tablelearning.com/uploads/File/EXHIBIT-B.pdf.
    • (2000) 2015 from
    • Johnson, D.W.1    Johnson, R.T.2    Stanne, M.B.3
  • 34
    • 33847274175 scopus 로고    scopus 로고
    • The state of cooperative learning in postsecondary and professional settings
    • Johnson, D. W., Johnson, R. T., & Smith, K. (2007). The state of cooperative learning in postsecondary and professional settings. Educational Psychology Review, 19(1), 15–29.
    • (2007) Educational Psychology Review , vol.19 , Issue.1 , pp. 15-29
    • Johnson, D.W.1    Johnson, R.T.2    Smith, K.3
  • 35
    • 21344492537 scopus 로고
    • Social loafing: a meta-analytic review and theoretical integration
    • Karau, S. J., & Williams, K. D. (1993). Social loafing: a meta-analytic review and theoretical integration. Journal of Personality and Social Psychology, 65(4), 681–706.
    • (1993) Journal of Personality and Social Psychology , vol.65 , Issue.4 , pp. 681-706
    • Karau, S.J.1    Williams, K.D.2
  • 36
    • 79951514365 scopus 로고    scopus 로고
    • Retrieval practice produces more learning than elaborative studying with concept mapping
    • Karpicke, J. D., & Blunt, J. R. (2011). Retrieval practice produces more learning than elaborative studying with concept mapping. Science, 331, 772–775.
    • (2011) Science , vol.331 , pp. 772-775
    • Karpicke, J.D.1    Blunt, J.R.2
  • 37
    • 77952488639 scopus 로고    scopus 로고
    • Obtaining representative nominal groups
    • Kelley, M. R., & Wright, D. B. (2010). Obtaining representative nominal groups. Behavior Research Methods, 42(1), 36–41.
    • (2010) Behavior Research Methods , vol.42 , Issue.1 , pp. 36-41
    • Kelley, M.R.1    Wright, D.B.2
  • 38
    • 1842537934 scopus 로고    scopus 로고
    • Group performance and decision making
    • Kerr, N. L., & Tindale, R. S. (2004). Group performance and decision making. Annual Review of Psychology, 55(1), 623–655.
    • (2004) Annual Review of Psychology , vol.55 , Issue.1 , pp. 623-655
    • Kerr, N.L.1    Tindale, R.S.2
  • 39
    • 61449213872 scopus 로고    scopus 로고
    • A cognitive load approach to collaborative learning: united brains for complex tasks
    • Kirschner, F., Paas, F., & Kirschner, P. A. (2009a). A cognitive load approach to collaborative learning: united brains for complex tasks. Educational Psychology Review, 21(1), 31–42.
    • (2009) Educational Psychology Review , vol.21 , Issue.1 , pp. 31-42
    • Kirschner, F.1    Paas, F.2    Kirschner, P.A.3
  • 40
    • 59049093316 scopus 로고    scopus 로고
    • Individual and group based learning from complex cognitive tasks: effects on retention and transfer efficiency
    • Kirschner, F., Paas, F., & Kirschner, P. A. (2009b). Individual and group based learning from complex cognitive tasks: effects on retention and transfer efficiency. Computers in Human Behavior, 25(2), 306–314.
    • (2009) Computers in Human Behavior , vol.25 , Issue.2 , pp. 306-314
    • Kirschner, F.1    Paas, F.2    Kirschner, P.A.3
  • 41
    • 78651347240 scopus 로고    scopus 로고
    • Task complexity as a driver for collaborative learning efficiency: the collective working-memory effect
    • Kirschner, F., Paas, F., & Kirschner, P. A. (2011). Task complexity as a driver for collaborative learning efficiency: the collective working-memory effect. Applied Cognitive Psychology, 25(4), 615–624.
    • (2011) Applied Cognitive Psychology , vol.25 , Issue.4 , pp. 615-624
    • Kirschner, F.1    Paas, F.2    Kirschner, P.A.3
  • 42
    • 21844465695 scopus 로고    scopus 로고
    • Teachers’ attitudes to and beliefs about web-based collaborative learning environments in the context of an international implementation
    • Kollias, V., Mamalougos, N., Vamvakoussi, X., Lakkala, M., & Vosniadou, S. (2005). Teachers’ attitudes to and beliefs about web-based collaborative learning environments in the context of an international implementation. Computers in Education, 45(3), 295–315.
    • (2005) Computers in Education , vol.45 , Issue.3 , pp. 295-315
    • Kollias, V.1    Mamalougos, N.2    Vamvakoussi, X.3    Lakkala, M.4    Vosniadou, S.5
  • 43
    • 79954472454 scopus 로고    scopus 로고
    • Dialogic argumentation as a vehicle for developing young adolescents? Thinking
    • Kuhn, D., & Crowell, A. (2011). Dialogic argumentation as a vehicle for developing young adolescents? Thinking. Psychological Science, 22, 545–552.
    • (2011) Psychological Science , vol.22 , pp. 545-552
    • Kuhn, D.1    Crowell, A.2
  • 45
    • 33744744019 scopus 로고    scopus 로고
    • Groups perform better than the best individuals on letters-to-numbers problems: effects of group size
    • Laughlin, P. R., Hatch, E. C., Silver, J. S., & Boh, L. (2006). Groups perform better than the best individuals on letters-to-numbers problems: effects of group size. Journal of Personality and Social Psychology, 90(4), 644–651.
    • (2006) Journal of Personality and Social Psychology , vol.90 , Issue.4 , pp. 644-651
    • Laughlin, P.R.1    Hatch, E.C.2    Silver, J.S.3    Boh, L.4
  • 46
    • 0031164993 scopus 로고    scopus 로고
    • Improving student learning of conceptual information: GSS supported collaborative learning vs. individual constructive learning
    • Leidner, D. E., & Fuller, M. (1997). Improving student learning of conceptual information: GSS supported collaborative learning vs. individual constructive learning. Decision Support Systems, 20(2), 149–163.
    • (1997) Decision Support Systems , vol.20 , Issue.2 , pp. 149-163
    • Leidner, D.E.1    Fuller, M.2
  • 47
    • 0001348038 scopus 로고
    • A survey of studies contrasting the quality of group performance and individual performance
    • Lorge, I., Fox, D., Davitz, J., & Brenner, M. (1958). A survey of studies contrasting the quality of group performance and individual performance. Psychological Bulletin, 55, 337–372.
    • (1958) Psychological Bulletin , vol.55 , pp. 337-372
    • Lorge, I.1    Fox, D.2    Davitz, J.3    Brenner, M.4
  • 48
    • 0035457987 scopus 로고    scopus 로고
    • Small group and individual learning with technology: a meta-analysis
    • Lou, Y., Abrami, P. C., & d'Apollonia, S. (2001). Small group and individual learning with technology: a meta-analysis. Review of Educational Research, 71(3), 449–521.
    • (2001) Review of Educational Research , vol.71 , Issue.3 , pp. 449-521
    • Lou, Y.1    Abrami, P.C.2    d'Apollonia, S.3
  • 49
    • 58149396139 scopus 로고    scopus 로고
    • Expertise promotes facilitation on a collaborative memory task
    • Meade, M. L., Nokes, T. J., & Morrow, D. G. (2009). Expertise promotes facilitation on a collaborative memory task. Memory, 17(1), 39–48.
    • (2009) Memory , vol.17 , Issue.1 , pp. 39-48
    • Meade, M.L.1    Nokes, T.J.2    Morrow, D.G.3
  • 50
    • 84946256615 scopus 로고
    • Collaboration in recall: do pairs of people cross-cue each other to produce new memories?
    • Meudell, P. R., Hitch, G. J., & Boyle, M. M. (1995). Collaboration in recall: do pairs of people cross-cue each other to produce new memories? The Quarterly Journal of Experimental Psychology, 48, 141–152.
    • (1995) The Quarterly Journal of Experimental Psychology , vol.48 , pp. 141-152
    • Meudell, P.R.1    Hitch, G.J.2    Boyle, M.M.3
  • 51
    • 0001567184 scopus 로고
    • Operationalizing the effect of the group on the individual: a self-attention perspective
    • Mullen, B. (1983). Operationalizing the effect of the group on the individual: a self-attention perspective. Journal of Experimental Social Psychology, 19(4), 295–322.
    • (1983) Journal of Experimental Social Psychology , vol.19 , Issue.4 , pp. 295-322
    • Mullen, B.1
  • 52
    • 0002160146 scopus 로고
    • Self-attention theory
    • Mullen B, Goethals GR, (eds), Springer-Verlag, New York
    • Mullen, B. (1987). Self-attention theory. In B. Mullen & G. R. Goethals (Eds.), Theories of group behaviour (pp. 125–146). New York: Springer-Verlag.
    • (1987) Theories of group behaviour , pp. 125-146
    • Mullen, B.1
  • 53
    • 84858590361 scopus 로고    scopus 로고
    • The effect of expertise on collaborative problem solving
    • Nokes-Malach, T. J., Meade, M. L., & Morrow, D. G. (2012). The effect of expertise on collaborative problem solving. Thinking and Reasoning, 18(1), 32–58.
    • (2012) Thinking and Reasoning , vol.18 , Issue.1 , pp. 32-58
    • Nokes-Malach, T.J.1    Meade, M.L.2    Morrow, D.G.3
  • 54
    • 0031115881 scopus 로고    scopus 로고
    • Collaborative discovery in a scientific domain
    • Okada, T., & Simon, H. A. (1997). Collaborative discovery in a scientific domain. Cognitive Science, 21(2), 109–146.
    • (1997) Cognitive Science , vol.21 , Issue.2 , pp. 109-146
    • Okada, T.1    Simon, H.A.2
  • 57
    • 84993728927 scopus 로고    scopus 로고
    • The power of testing memory: basic research and implications for educational practice
    • Roediger, H. L., & Karpicke, J. D. (2006). The power of testing memory: basic research and implications for educational practice. Perspectives on Psychological Science, 1, 181–210.
    • (2006) Perspectives on Psychological Science , vol.1 , pp. 181-210
    • Roediger, H.L.1    Karpicke, J.D.2
  • 58
    • 0002294343 scopus 로고
    • The construction of shared knowledge in collaborative problem solving
    • O’Mally C, (ed), Springer-Verlag, Berlin Heidelberg
    • Roschelle, J., & Teasley, S. D. (1995). The construction of shared knowledge in collaborative problem solving. In C. O’Mally (Ed.), Computer supported collaborative learning (pp. 69–97). Berlin Heidelberg: Springer-Verlag.
    • (1995) Computer supported collaborative learning , pp. 69-97
    • Roschelle, J.1    Teasley, S.D.2
  • 59
    • 7744240432 scopus 로고    scopus 로고
    • Going shopping and identifying landmarks: does collaboration improve older people’s memory?
    • Ross, M., Spencer, S. J., Linardatos, L., Lam, K. C. H., & Perunovic, M. (2004). Going shopping and identifying landmarks: does collaboration improve older people’s memory? Applied Cognitive Psychology, 18(6), 683–696.
    • (2004) Applied Cognitive Psychology , vol.18 , Issue.6 , pp. 683-696
    • Ross, M.1    Spencer, S.J.2    Linardatos, L.3    Lam, K.C.H.4    Perunovic, M.5
  • 60
    • 0001451301 scopus 로고    scopus 로고
    • The productive agency that drives collaborative learning
    • Dillenbourg P, (ed), Elsevier, Oxford
    • Schwartz, D. L. (1999). The productive agency that drives collaborative learning. In P. Dillenbourg (Ed.), Collaborative learning: Cognitive and computational approaches (pp. 197–218). Oxford: Elsevier.
    • (1999) Collaborative learning: Cognitive and computational approaches , pp. 197-218
    • Schwartz, D.L.1
  • 63
    • 84910650297 scopus 로고    scopus 로고
    • Making cooperative learning powerful
    • Slavin, R. E. (2014). Making cooperative learning powerful. Educational Leadership, 72(2), 22–26.
    • (2014) Educational Leadership , vol.72 , Issue.2 , pp. 22-26
    • Slavin, R.E.1
  • 64
    • 0033238835 scopus 로고    scopus 로고
    • Effects of small-group learning on undergraduates in science, mathematics, engineering, and technology: a meta-analysis
    • Springer, L., Stanne, M. E., & Donovan, S. S. (1999). Effects of small-group learning on undergraduates in science, mathematics, engineering, and technology: a meta-analysis. Review of Educational Research, 69(1), 21–51.
    • (1999) Review of Educational Research , vol.69 , Issue.1 , pp. 21-51
    • Springer, L.1    Stanne, M.E.2    Donovan, S.S.3
  • 65
    • 0013932691 scopus 로고
    • Models for inferring the relationships between group size and potential group productivity
    • Steiner, I. D. (1966). Models for inferring the relationships between group size and potential group productivity. Behavioral Science, 11, 273–283.
    • (1966) Behavioral Science , vol.11 , pp. 273-283
    • Steiner, I.D.1
  • 67
    • 21844525967 scopus 로고
    • The role of talk in children’s peer collaborations
    • Teasley, S. D. (1995). The role of talk in children’s peer collaborations. Developmental Psychology, 31(2), 207–220.
    • (1995) Developmental Psychology , vol.31 , Issue.2 , pp. 207-220
    • Teasley, S.D.1
  • 68
    • 58149373845 scopus 로고    scopus 로고
    • False and veridical collaborative recognition
    • Thorley, C., & Dewhurst, S. A. (2009). False and veridical collaborative recognition. Memory, 17, 17–25.
    • (2009) Memory , vol.17 , pp. 17-25
    • Thorley, C.1    Dewhurst, S.A.2
  • 69
    • 84985817977 scopus 로고
    • When collaboration leads to regression: some negative consequences of socio-cognitive conflict
    • Tudge, J. (1989). When collaboration leads to regression: some negative consequences of socio-cognitive conflict. European Journal of Social Psychology, 19(2), 123–138.
    • (1989) European Journal of Social Psychology , vol.19 , Issue.2 , pp. 123-138
    • Tudge, J.1
  • 70
    • 84860576536 scopus 로고    scopus 로고
    • Conventional wisdom: negotiating conventions of reference enhances category learning
    • Voiklis, J., & Corter, J. E. (2012). Conventional wisdom: negotiating conventions of reference enhances category learning. Cognitive Science, 36(4), 607–634.
    • (2012) Cognitive Science , vol.36 , Issue.4 , pp. 607-634
    • Voiklis, J.1    Corter, J.E.2
  • 71
    • 0348007407 scopus 로고
    • Constructive activity and learning in collaborative small groups
    • Webb, N. M., Troper, J. D., & Fall, R. (1995). Constructive activity and learning in collaborative small groups. Journal of Educational Psychology, 87, 406–423.
    • (1995) Journal of Educational Psychology , vol.87 , pp. 406-423
    • Webb, N.M.1    Troper, J.D.2    Fall, R.3
  • 73
    • 34948876863 scopus 로고    scopus 로고
    • Calculating nominal group statistics in collaboration studies
    • Wright, D. B. (2007). Calculating nominal group statistics in collaboration studies. Behavior Research Methods, 39, 460–470.
    • (2007) Behavior Research Methods , vol.39 , pp. 460-470
    • Wright, D.B.1


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.