메뉴 건너뛰기




Volumn 19, Issue 2, 2011, Pages 117-127

Using technology to encourage student engagement with feedback: A literature review

Author keywords

Engagement; Feedback; Technology

Indexed keywords


EID: 81255185788     PISSN: 09687769     EISSN: 17411629     Source Type: Journal    
DOI: 10.1080/21567069.2011.586677     Document Type: Review
Times cited : (128)

References (67)
  • 1
    • 0001586316 scopus 로고    scopus 로고
    • Assessment and classroom learning
    • Black, P., and D. Wiliam. 1998. Assessment and classroom learning. Assessment in Education 5, no. 1: 7-74.
    • (1998) Assessment in Education , vol.5 , Issue.1 , pp. 7-74
    • Black, P.1    Wiliam, D.2
  • 6
    • 70350373492 scopus 로고    scopus 로고
    • Strategies for using feedback students bring to higher education
    • Burke, D. 2009. Strategies for using feedback students bring to higher education. Assessment & Evaluation in Higher Education 34, no. 1: 41-50.
    • (2009) Assessment & Evaluation in Higher Education , vol.34 , Issue.1 , pp. 41-50
    • Burke, D.1
  • 7
    • 0040144890 scopus 로고
    • Enhancing and undermining intrinsic motivation: The effects of task-involving and ego-involving evaluation of interest and performance
    • Butler, R. 1988. Enhancing and undermining intrinsic motivation: The effects of task-involving and ego-involving evaluation of interest and performance. British Journal of Educational Psychology 58, no. 4: 1-14.
    • (1988) British Journal of Educational Psychology , vol.58 , Issue.4 , pp. 1-14
    • Butler, R.1
  • 8
    • 33645228936 scopus 로고    scopus 로고
    • Differing perceptions in the feedback process
    • DOI 10.1080/03075070600572132, PII K3781855176150
    • Carless, D. 2006. Differing perceptions in the feedback process. Studies in Higher Education 21, no. 2: 219-33. (Pubitemid 43453823)
    • (2006) Studies in Higher Education , vol.31 , Issue.2 , pp. 219-233
    • Carless, D.1
  • 9
    • 33947681176 scopus 로고    scopus 로고
    • Committing to quality learning through adaptive online assessment
    • Challis, D. 2005. Committing to quality learning through adaptive online assessment. Assessment & Evaluation in Higher Education 30, no. 5: 519-27.
    • (2005) Assessment & Evaluation in Higher Education , vol.30 , Issue.5 , pp. 519-27
    • Challis, D.1
  • 10
    • 0002650523 scopus 로고    scopus 로고
    • Comments on essays: Do students understand what tutors write?
    • Chanock, K. 2000. Comments on essays: Do students understand what tutors write? Teaching in Higher Education 5, no. 1: 95-105.
    • (2000) Teaching in Higher Education , vol.5 , Issue.1 , pp. 95-105
    • Chanock, K.1
  • 11
    • 85068723462 scopus 로고    scopus 로고
    • Issues and impacts of using computer-based assessments (CBAs) for formative assessment
    • ed. S. Brown, J. Bull, and P. Race,. London: Kogan Page
    • Charman, D. 1999. Issues and impacts of using computer-based assessments (CBAs) for formative assessment. In Computer assisted assessment in higher education, ed. S. Brown, J. Bull, and P. Race, 85-93. London: Kogan Page.
    • (1999) Computer assisted assessment in Higher Education , pp. 85-93
    • Charman, D.1
  • 13
    • 30444437612 scopus 로고    scopus 로고
    • Assessment relationships in higher education: The tension of process and practice
    • DOI 10.1080/01411920500402037, PII J648458341452
    • Crook, C., H. Gross, and R. Dymott. 2006. Assessment relationships in higher education: The tension of process and practice. British Educational Research Journal 32, no. 1: 95-114. (Pubitemid 43071095)
    • (2006) British Educational Research Journal , vol.32 , Issue.1 , pp. 95-114
    • Crook, C.1    Gross, H.2    Dymott, R.3
  • 14
    • 79955557498 scopus 로고    scopus 로고
    • Using email for formative assessment with professional doctorate students
    • Crossouard, B., and J. Pryor. 2009. Using email for formative assessment with professional doctorate students. Assessment & Evaluation in Higher Education 34, no. 4: 377-88.
    • (2009) Assessment & Evaluation in Higher Education , vol.34 , Issue.4 , pp. 377-88
    • Crossouard, B.1    Pryor, J.2
  • 15
    • 81255163929 scopus 로고    scopus 로고
    • Generating and e-mailing feedback to students using MS Office
    • July 2-3, ed. M. Danson,. Loughborough: Learning and Teaching Development, Loughborough University
    • Denton, P. 2001a. Generating and e-mailing feedback to students using MS Office. In Proceedings of the 5th International Computer Assisted Assessment Conference, July 2-3, ed. M. Danson, 157-73. Loughborough: Learning and Teaching Development, Loughborough University.
    • (2001) Proceedings of the 5th International Computer Assisted Assessment Conference , pp. 157-73
    • Denton, P.1
  • 16
    • 42449117682 scopus 로고    scopus 로고
    • Generating Coursework Feedback for Large Groups of students using MS Excel and MS Word
    • Denton, P. 2001b. Generating coursework feedback for large groups of students using MS Excel and MS Word. University Chemistry Education 5, no. 1: 1-8.
    • (2001) University Chemistry Education , vol.5 , Issue.1 , pp. 1-8
    • Denton, P.1
  • 17
    • 75649101993 scopus 로고    scopus 로고
    • Returning feedback to students via email using Electronic Feedback 9
    • Denton, P. 2003. Returning feedback to students via email using Electronic Feedback 9. Learning and Teaching in Action 2, no. 1. http://www.celt.mmu.ac.uk/ltia/issue4/denton. shtml.
    • (2003) Learning and Teaching in Action , vol.2 , Issue.1
    • Denton, P.1
  • 18
    • 42449103457 scopus 로고    scopus 로고
    • Students' response to traditional and computer-assisted formative feedback: A comparative case study
    • DOI 10.1111/j.1467-8535.2007.00745.x
    • Denton, P., J. Madden, M. Roberts, and P. Rowe. 2008. Students' response to traditional and computer-assisted formative feedback: A comparative case study. British Journal of Educational Technology 39, no. 3: 486-500. (Pubitemid 351572073)
    • (2008) British Journal of Educational Technology , vol.39 , Issue.3 , pp. 486-500
    • Denton, P.1    Madden, J.2    Roberts, M.3    Rowe, P.4
  • 19
    • 0038604158 scopus 로고    scopus 로고
    • Department for Education and Skills. Cm 5735. London: The Stationery Office
    • Department for Education and Skills. 2003. The future of higher education. Cm 5735. London: The Stationery Office.
    • (2003) The future of Higher Education
  • 20
    • 60349129920 scopus 로고    scopus 로고
    • What are learners actually regulating when giving feedback?
    • Draper, S. 2009. What are learners actually regulating when giving feedback? British Journal of Educational Technology 40, no. 2: 306-15.
    • (2009) British Journal of Educational Technology , vol.40 , Issue.2 , pp. 306-15
    • Draper, S.1
  • 21
    • 54149105511 scopus 로고    scopus 로고
    • Feed-forward': Improving students' use of tutors' comments
    • Duncan, N. 2007. 'Feed-forward': Improving students' use of tutors' comments. Assessment & Evaluation in Higher Education 32, no. 3: 271-83.
    • (2007) Assessment & Evaluation in Higher Education , vol.32 , Issue.3 , pp. 271-83
    • Duncan, N.1
  • 22
    • 0141445204 scopus 로고    scopus 로고
    • Litigation and learning: Tensions in improving university lecturers' assessment practice
    • Ecclestone, K., and J. Swann. 1999. Litigation and learning: Tensions in improving university lecturers' assessment practice. Assessment in Education: Principles, Policy and Practice 6, no. 3: 377-89.
    • (1999) Assessment in Education: Principles, Policy and Practice , vol.6 , Issue.3 , pp. 377-89
    • Ecclestone, K.1    Swann, J.2
  • 23
    • 0036877606 scopus 로고    scopus 로고
    • SPARK, a confidential web-based template for selfand peer-assessment of student teamwork: Benefits of evaluating across different subjects
    • Freeman, M., and J. McKenzie. 2002. SPARK, a confidential web-based template for selfand peer-assessment of student teamwork: Benefits of evaluating across different subjects. British Journal of Educational Technology 33, no. 5: 551-69.
    • (2002) British Journal of Educational Technology , vol.33 , Issue.5 , pp. 551-69
    • Freeman, M.1    McKenzie, J.2
  • 24
    • 32544431839 scopus 로고    scopus 로고
    • The ethical limitations of online grading systems
    • DOI 10.1111/j.1467-8535.2005.00481.x
    • Fulda, J.S. 2005. The ethical limitations of online grading systems. British Journal of Educational Technology 36, no. 3: 559-61. (Pubitemid 43906805)
    • (2005) British Journal of Educational Technology , vol.36 , Issue.3 , pp. 559-561
    • Fulda, J.S.1
  • 25
    • 33645214429 scopus 로고    scopus 로고
    • Conditions under which assessment supports students' learning
    • Gibbs, G., and C. Simpson. 2004. Conditions under which assessment supports students' learning. Learning and Teaching in Higher Education 1: 3-31.
    • (2004) Learning and Teaching in Higher Education , vol.1 , pp. 3-31
    • Gibbs, G.1    Simpson, C.2
  • 26
    • 17044433954 scopus 로고    scopus 로고
    • What is the role for ICT-based assessment in universities?
    • Gipps, C.V. 2005. What is the role for ICT-based assessment in universities? Studies in Higher Education 30, no. 2: 171-80.
    • (2005) Studies in Higher Education , vol.30 , Issue.2 , pp. 171-80
    • Gipps, C.V.1
  • 27
    • 36248946705 scopus 로고    scopus 로고
    • ESL students' experiences of online peer feedback
    • Guardado, N., and L. Shi. 2007. ESL students' experiences of online peer feedback. Computers and Composition 24, no. 4: 443-61.
    • (2007) Computers and Composition , vol.24 , Issue.4 , pp. 443-61
    • Guardado, N.1    Shi, L.2
  • 28
    • 59849084149 scopus 로고    scopus 로고
    • Beyond model answers: Learners' perceptions of self-assessment materials in e-learning applications
    • Handley, K., and B. Cox. 2007. Beyond model answers: Learners' perceptions of self-assessment materials in e-learning applications. ALT-J Research in Learning Technology 15, no. 1: 21-36.
    • (2007) ALT-J Research in Learning Technology , vol.15 , Issue.1 , pp. 21-36
    • Handley, K.1    Cox, B.2
  • 29
    • 79951931514 scopus 로고    scopus 로고
    • Recommendations for the use of e-tools for improvements around assignment marking quality
    • Heinrich, E., J. Milne, A. Ramsay, and D. Morrison. 2009. Recommendations for the use of e-tools for improvements around assignment marking quality. Assessment & Evaluation in Higher Education 34, no. 4: 469-79.
    • (2009) Assessment & Evaluation in Higher Education , vol.34 , Issue.4 , pp. 469-79
    • Heinrich, E.1    Milne, J.2    Ramsay, A.3    Morrison, D.4
  • 30
    • 79951933339 scopus 로고    scopus 로고
    • Meeting rising student expectations of online assignment submission and online feedback
    • July 10-11, ed. Farzana Khandia,. Loughborough: Learning and Teaching Development, Loughborough University
    • Hepplestone, S., and R. Mather. 2007. Meeting rising student expectations of online assignment submission and online feedback. In Proceedings of the 11th International Computer- Assisted Assessment Conference, July 10-11, ed. Farzana Khandia, 269-75. Loughborough: Learning and Teaching Development, Loughborough University.
    • (2007) Proceedings of the 11th International Computer- Assisted Assessment Conference , pp. 269-75
    • Hepplestone, S.1    Mather, R.2
  • 31
    • 0036486748 scopus 로고    scopus 로고
    • The conscientious consumer: Reconsidering the role of assessment feedback in student learning
    • Higgins, R., P. Hartley, and A. Skelton. 2002. The conscientious consumer: Reconsidering the role of assessment feedback in student learning. Studies in Higher Education 27, no. 1: 53-64.
    • (2002) Studies in Higher Education , vol.27 , Issue.1 , pp. 53-64
    • Higgins, R.1    Hartley, P.2    Skelton, A.3
  • 32
    • 81255163926 scopus 로고    scopus 로고
    • Higher Education Funding Council for England. Bristol: HEFCE
    • Higher Education Funding Council for England. 2007. 2007 teaching quality information data. Bristol: HEFCE. http://www.hefce.ac.uk/learning/nss/data/ 2007/.
    • (2007) 2007 Teaching Quality Information Data
  • 33
    • 81255173777 scopus 로고    scopus 로고
    • Dogs, stars, Rolls Royces and old double-decker buses: Efficiency and effectiveness in assessment. In
    • Gloucester: Quality Assurance Agency for Higher Education
    • Hornby, W. 2005. Dogs, stars, Rolls Royces and old double-decker buses: Efficiency and effectiveness in assessment. In: Enhancing practice: Reflections on assessment: Volume 1, 15-28. Gloucester: Quality Assurance Agency for Higher Education.
    • (2005) Enhancing practice: Reflections on assessment , vol.1 , pp. 15-28
    • Hornby, W.1
  • 34
    • 77951686318 scopus 로고    scopus 로고
    • The trouble with feedback: New challenges, emerging strategies
    • Hounsell, D. 2008. The trouble with feedback: New challenges, emerging strategies. TLA Interchange 2. http://www.tla.ed.ac.uk/interchange/spring2008/ hounsell2.htm.
    • (2008) TLA Interchange 2.
    • Hounsell, D.1
  • 35
    • 81255181575 scopus 로고    scopus 로고
    • Learning and teaching at university: The influence of subjects and settings
    • no. 31. London: ESRC Teaching and Learning Research Programme
    • Hounsell, D., and N. Entwistle. 2007. Learning and teaching at university: The influence of subjects and settings. Teaching and Learning Research Briefings no. 31. London: ESRC Teaching and Learning Research Programme.
    • (2007) Teaching and Learning Research Briefings
    • Hounsell, D.1    Entwistle, N.2
  • 37
    • 77951102001 scopus 로고    scopus 로고
    • Assessor or assessee: How student learning improves by giving and receiving peer feedback
    • Li, L., X. Liu, and A.L. Steckelberg. 2010. Assessor or assessee: How student learning improves by giving and receiving peer feedback. British Journal of Educational Technology 41, no. 3: 525-36.
    • (2010) British Journal of Educational Technology , vol.41 , Issue.3 , pp. 525-36
    • Li, L.1    Liu, X.2    Steckelberg, A.L.3
  • 39
    • 0347806215 scopus 로고    scopus 로고
    • Assessment for Learning: The differing perceptions of tutors and students
    • DOI 10.1080/02602930120063466
    • Maclellan, E. 2001. Assessment for learning: The differing perceptions of tutors and students. Assessment & Evaluation in Higher Education 26, no. 4: 307-18. (Pubitemid 33296518)
    • (2001) Assessment and Evaluation in Higher Education , vol.26 , Issue.4 , pp. 307-318
    • Maclellan, E.1
  • 41
    • 77951678326 scopus 로고    scopus 로고
    • Students' attitudes to and usage of academic feedback provided via audio files
    • Merry, S., and P. Orsmond. 2008. Students' attitudes to and usage of academic feedback provided via audio files. Bioscience Education 11. http://www.bioscience.heacademy.ac.uk/journal/vol11/beej-11-3.aspx.
    • (2008) Bioscience Education , vol.11
    • Merry, S.1    Orsmond, P.2
  • 42
    • 77249104214 scopus 로고    scopus 로고
    • Beyond podcasting: Creative approaches to designing educational audio
    • Middleton, A. 2009. Beyond podcasting: Creative approaches to designing educational audio. ALT-J Research in Learning Technology 17, no. 2: 143-55.
    • (2009) ALT-J Research in Learning Technology , vol.17 , Issue.2 , pp. 143-55
    • Middleton, A.1
  • 43
    • 77951256003 scopus 로고    scopus 로고
    • Formative computer-based assessment in higher education: The effectiveness of feedback in supporting student, learning
    • Miller, T. 2009. Formative computer-based assessment in higher education: The effectiveness of feedback in supporting student, learning. Assessment & Evaluation in Higher Education 34, no. 2: 181-92.
    • (2009) Assessment & Evaluation in Higher Education , vol.34 , Issue.2 , pp. 181-92
    • Miller, T.1
  • 44
    • 32944462788 scopus 로고    scopus 로고
    • Exploring the practice of feedback to students
    • Mutch, A. 2003. Exploring the practice of feedback to students. Active Learning in Higher Education 4, no. 24: 24-38.
    • (2003) Active Learning in Higher Education , vol.4 , Issue.24 , pp. 24-38
    • Mutch, A.1
  • 45
    • 43949109324 scopus 로고    scopus 로고
    • Student justice perceptions following assignment feedback
    • Nesbit, P.L., and S. Burton. 2006. Student justice perceptions following assignment feedback. Assessment & Evaluation in Higher Education 31, no. 6: 655-70.
    • (2006) Assessment & Evaluation in Higher Education , vol.31 , Issue.6 , pp. 655-70
    • Nesbit, P.L.1    Burton, S.2
  • 47
    • 77955163455 scopus 로고    scopus 로고
    • Assessment for learner self-regulation: Enhancing achievement in the first year using learning technologies
    • Nicol, D. 2009. Assessment for learner self-regulation: Enhancing achievement in the first year using learning technologies. Assessment & Evaluation in Higher Education 34, no. 3: 335-52.
    • (2009) Assessment & Evaluation in Higher Education , vol.34 , Issue.3 , pp. 335-52
    • Nicol, D.1
  • 48
    • 33645227268 scopus 로고    scopus 로고
    • Formative assessment and self-regulated learning: A model and seven principles of good feedback practice
    • Nicol, D.J., and D. Macfarlane-Dick. 2006. Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education 31, no. 2: 199-218.
    • (2006) Studies in Higher Education , vol.31 , Issue.2 , pp. 199-218
    • Nicol, D.J.1    Macfarlane-Dick, D.2
  • 50
    • 0036879171 scopus 로고    scopus 로고
    • Supporting student learning: The use of computer-based formative assessment modules
    • Peat, M., and S. Franklin. 2002. Supporting student learning: The use of computer-based formative assessment modules. British Journal of Educational Technology 33, no. 5: 515-23.
    • (2002) British Journal of Educational Technology , vol.33 , Issue.5 , pp. 515-23
    • Peat, M.1    Franklin, S.2
  • 51
    • 34547269858 scopus 로고    scopus 로고
    • A pen-based paperless environment for annotating and marking student assignments
    • January 16-19, ed. Wayne Piekarski,. Darlinghurst, Australia: Australian Computer Society Inc
    • Plimmer, B., and P. Mason. 2006. A pen-based paperless environment for annotating and marking student assignments. In Proceedings of Seventh Australian User Interface Conference (AUIC2006), January 16-19, ed. Wayne Piekarski, 37-44. Darlinghurst, Australia: Australian Computer Society Inc.
    • (2006) Proceedings of Seventh Australian User Interface Conference (AUIC2006) , pp. 37-44
    • Plimmer, B.1    Mason, P.2
  • 52
    • 33748102579 scopus 로고
    • Case study: You can't teach those things to rats. A case for neither grading nor failing students
    • Potts, D. 1992. Case study: You can't teach those things to rats. A case for neither grading nor failing students. Educational and Training Technology International 29, no. 4: 296-309.
    • (1992) Educational and Training Technology International , vol.29 , Issue.4 , pp. 296-309
    • Potts, D.1
  • 54
    • 81255173778 scopus 로고    scopus 로고
    • Feedback - All that effort, but what is the effect?
    • Paper presented at August, in Potsdam, Germany
    • Price, M., and B. O'Donovan. 2008. Feedback - All that effort, but what is the effect? Paper presented at the EARLI/Northumbria Assessment Conference, August 27-29, in Potsdam, Germany.
    • (2008) The EARLI/Northumbria Assessment Conference , pp. 27-29
    • Price, M.1    O'Donovan, B.2
  • 57
    • 81255181573 scopus 로고    scopus 로고
    • Audio and screen visual feedback to support student learning
    • ed. Hugh Davies and Linda Creanor,. Oxford: Association for Learning Technology
    • Rodway-Dyer, S., E. Dunne, and M. Newcombe, M. 2009. Audio and screen visual feedback to support student learning. In Proceedings of the 16th ALT-C International Conference, September 8-10, ed. Hugh Davies and Linda Creanor, 61-9. Oxford: Association for Learning Technology.
    • (2009) Proceedings of the 16th ALT-C International Conference, September 8-10 , pp. 61-9
    • Rodway-Dyer, S.1    Dunne, E.2    Newcombe, M.M.3
  • 58
    • 77956359193 scopus 로고    scopus 로고
    • Sounds good: Quicker, better assessment using audio feedback
    • Rotheram, B. 2009. Sounds good: Quicker, better assessment using audio feedback. JISCfunded project. http://sites.google.com/site/soundsgooduk/ downloads.
    • (2009) JISCfunded project.
    • Rotheram, B.1
  • 60
    • 33751081344 scopus 로고    scopus 로고
    • A social constructivist assessment process model: how the research literature shows us this could be best practice
    • DOI 10.1080/02602930500063819
    • Rust, C., B. O'Donovan, and M. Price. 2005. A social constructivist assessment process model: How the research literature shows us this could be best practice. Assessment & Evaluation in Higher Education 30, no. 3: 231-40. (Pubitemid 40350573)
    • (2005) Assessment and Evaluation in Higher Education , vol.30 , Issue.3 , pp. 231-240
    • Rust, C.1    O Donovan, B.2    Price, M.3
  • 61
    • 79955569491 scopus 로고    scopus 로고
    • Beyond feedback: Developing student capability in complex appraisal
    • Sadler, D.R. 2010. Beyond feedback: Developing student capability in complex appraisal. Assessment & Evaluation in Higher Education 35, no. 5: 535-50.
    • (2010) Assessment & Evaluation in Higher Education , vol.35 , Issue.5 , pp. 535-50
    • Sadler, D.R.1
  • 62
    • 2442680463 scopus 로고    scopus 로고
    • The impact of e-feedback on the revisions of L2 writers in an academic writing course
    • DOI 10.1016/j.compcom.2004.02.003, PII S8755461504000088
    • Tuzi, F. 2004. The impact of e-feedback on the revisions of L2 writers in an academic writing course. Computers and Composition 21, no. 2: 217-35. (Pubitemid 38670735)
    • (2004) Computers and Composition , vol.21 , Issue.2 , pp. 217-235
    • Tuzi, F.1
  • 63
    • 1842787527 scopus 로고    scopus 로고
    • Reflection prompts and tutor feedback in a web-based learning environment: Effects on students' self-regulated learning competence
    • Van den Boom, G., F. Paas, J.J.G. Van Merriënboer, and T. Van Gog. 2004. Reflection prompts and tutor feedback in a web-based learning environment: Effects on students' self-regulated learning competence. Computers in Human Behavior 20, no. 4: 551-67.
    • (2004) Computers in Human Behavior , vol.20 , Issue.4 , pp. 551-67
    • Van Den Boom, G.1    Paas, F.2    Van Merriënboer, J.J.G.3    Van Gog, T.4
  • 64
    • 33846699999 scopus 로고    scopus 로고
    • Do students value feedback? Student perceptions of tutors written responses
    • DOI 10.1080/02602930500353061
    • Weaver, M.R. 2006. Do students value feedback? Student perceptions of tutors' written responses. Assessment & Evaluation in Higher Education 31, no. 3: 379-94. (Pubitemid 43315438)
    • (2006) ASSESSMENT AND EVALUATION IN HIGHER EDUCATION , vol.31 , Issue.3 , pp. 379-394
    • Weaver, M.R.1
  • 65
    • 60849107762 scopus 로고    scopus 로고
    • Editorial: e-assessment: Developing new dialogues for the digital age
    • Whitelock, D. 2009. Editorial: e-assessment: Developing new dialogues for the digital age. British Journal of Educational Technology 40, no. 2: 199-202.
    • (2009) British Journal of Educational Technology , vol.40 , Issue.2 , pp. 199-202
    • Whitelock, D.1
  • 67
    • 79961200176 scopus 로고    scopus 로고
    • Formative Assessment and its Relevance to Retention
    • Yorke, M. 2001. Formative assessment and its relevance to retention. Higher Education Research and Development 20, no. 2: 115-26. (Pubitemid 33295919)
    • (2001) Higher education research and development , vol.20 , Issue.2 , pp. 115-126
    • Yorke, M.1


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.