메뉴 건너뛰기




Volumn 29, Issue , 2009, Pages 90-100

Language assessment in education: Tests, curricula, and teaching

Author keywords

[No Author keywords available]

Indexed keywords


EID: 70350378124     PISSN: 02671905     EISSN: 14716356     Source Type: Book Series    
DOI: 10.1017/S0267190509090084     Document Type: Review
Times cited : (45)

References (77)
  • 1
    • 2442631498 scopus 로고    scopus 로고
    • Assessment accommodations for English language learners: Implications for policy-based empirical research
    • Abedi, J., Hofstetter, C., & Lord, C. (2004). Assessment accommodations for English language learners: Implications for policy-based empirical research. Review of Educational Research, 74(1), 1-28.
    • (2004) Review of Educational Research , vol.74 , Issue.1 , pp. 1-28
    • Abedi, J.1    Hofstetter, C.2    Lord, C.3
  • 4
    • 34248640348 scopus 로고    scopus 로고
    • Ethical considerations in the assessment of the language and content knowledge of U.S. school-age learners
    • 2&3
    • Bailey, A., & Butler, F. (2004). Ethical considerations in the assessment of the language and content knowledge of U.S. school-age learners. Language Assessment Quarterly, 1(2&3), 177-193.
    • (2004) Language Assessment Quarterly , vol.1 , pp. 177-193
    • Bailey, A.1    Butler, F.2
  • 5
    • 0002495644 scopus 로고    scopus 로고
    • Working for washback: A review of the washback concept in language testing
    • Bailey, K. (1996). Working for washback: A review of the washback concept in language testing. Language Testing, 13(2), 257-279.
    • (1996) Language Testing , vol.13 , Issue.2 , pp. 257-279
    • Bailey, K.1
  • 6
    • 0035648498 scopus 로고    scopus 로고
    • Making sense of language teaching: Teachers' principles and classroom practices
    • Breen, M., Hird, B., Milton, M., Oliver, R., & Thwaite, A. (2001). Making sense of language teaching: Teachers' principles and classroom practices. Applied Linguistics, 22(4), 470-501.
    • (2001) Applied Linguistics , vol.22 , Issue.4 , pp. 470-501
    • Breen, M.1    Hird, B.2    Milton, M.3    Oliver, R.4    Thwaite, A.5
  • 7
    • 0007289482 scopus 로고    scopus 로고
    • Outcomes-based assessment and reporting in language learning programmes: A review of the issues
    • Brindley, G. (1998). Outcomes-based assessment and reporting in language learning programmes: A review of the issues. Language Testing, 15(1), 45-85.
    • (1998) Language Testing , vol.15 , Issue.1 , pp. 45-85
    • Brindley, G.1
  • 8
    • 35848948862 scopus 로고    scopus 로고
    • Perspectives
    • Byrnes, H. (Ed.). (2007). Perspectives. Modern Language Journal, 91(4), 641-685.
    • (2007) Modern Language Journal , vol.91 , Issue.4 , pp. 641-685
    • Byrnes, H.1
  • 9
    • 84990342818 scopus 로고    scopus 로고
    • Standardized assessment of the content knowledge of English language learners K-12: Current trends and old dilemmas
    • Butler, F., & Stevens, R. (2001). Standardized assessment of the content knowledge of English language learners K-12: Current trends and old dilemmas. Language Testing, 18, 409-427.
    • (2001) Language Testing , vol.18 , pp. 409-427
    • Butler, F.1    Stevens, R.2
  • 11
    • 85044796115 scopus 로고    scopus 로고
    • Changing communicative needs, revised assessment objectives: Testing English as an international language
    • Canagarajah, S. (2006). Changing communicative needs, revised assessment objectives: Testing English as an international language. Language Assessment Quarterly, 3(3), 229-242.
    • (2006) Language Assessment Quarterly , vol.3 , Issue.3 , pp. 229-242
    • Canagarajah, S.1
  • 13
    • 34248682156 scopus 로고    scopus 로고
    • The challenges of the Ontario Secondary School Literacy Test for second language students
    • Cheng, L., Klinger, D., & Zheng, Y. (2007). The challenges of the Ontario Secondary School Literacy Test for second language students. Language Testing, 24(2), 185-208.
    • (2007) Language Testing , vol.24 , Issue.2 , pp. 185-208
    • Cheng, L.1    Klinger, D.2    Zheng, Y.3
  • 18
    • 84866972824 scopus 로고    scopus 로고
    • High-stakes testing and assessment: English language teacher benchmarking
    • In J. Cummins & C. Davison (Eds.) New York Springer
    • Coniam, D., & Falvey, P. (2007). High-stakes testing and assessment: English language teacher benchmarking. In J. Cummins & C. Davison (Eds.), International handbook of English language teaching: Part one (pp. 456-471). New York: Springer.
    • (2007) International Handbook of English Language Teaching: Part One , pp. 456-471
    • Coniam, D.1    Falvey, P.2
  • 19
    • 2342635374 scopus 로고    scopus 로고
    • Council Of Europe Teaching, Assessment. Cambridge, England: Cambridge University Press
    • Council of Europe. (2001). Common European Framework of Reference for Languages: Learning, Teaching, Assessment. Cambridge, England: Cambridge University Press.
    • (2001) Common European Framework of Reference for Languages: Learning
  • 20
    • 61149531958 scopus 로고    scopus 로고
    • The difficulty of standards, for example in second language writing
    • In T. Silva & P. Matsuda (Eds.) Mahwah, NJ Erlbaum
    • Cumming, A. (2001a). The difficulty of standards, for example in second language writing. In T. Silva & P. Matsuda (Eds.), On second language writing (pp. 209-229). Mahwah, NJ: Erlbaum.
    • (2001) On Second Language Writing , pp. 209-229
    • Cumming, A.1
  • 21
    • 84990361361 scopus 로고    scopus 로고
    • ESL/EFL instructors' practices for writing assessment: Specific or general purposes
    • Cumming, A. (2001b). ESL/EFL instructors' practices for writing assessment: Specific or general purposes? Language Testing, 18,(2), 207-224.
    • (2001) Language Testing , vol.18 , Issue.2 , pp. 207-224
    • Cumming, A.1
  • 22
    • 0040065840 scopus 로고    scopus 로고
    • Language, power, and pedagogy: Bilingual children in the crossfire
    • Multilingual Matters
    • Cummins, J. (2000). Language, power, and pedagogy: Bilingual children in the crossfire. Clevedon, England: Multilingual Matters.
    • (2000) Clevedon, England
    • Cummins, J.1
  • 24
    • 24144443549 scopus 로고    scopus 로고
    • The contradictory culture of classroom-based assessment: Teacher assessment practices in senior secondary English
    • Davison, C. (2004). The contradictory culture of classroom-based assessment: Teacher assessment practices in senior secondary English. Language Testing, 21(3), 304-334.
    • (2004) Language Testing , vol.21 , Issue.3 , pp. 304-334
    • Davison, C.1
  • 25
    • 84990385488 scopus 로고    scopus 로고
    • Teacher assessment: The concept of "diagnostic competence"
    • Edelenbos, P., & Kubanek-German, A. (2004). Teacher assessment: The concept of "diagnostic competence." Language Testing, 21(2), 259-283.
    • (2004) Language Testing , vol.21 , Issue.2 , pp. 259-283
    • Edelenbos, P.1    Kubanek-German, A.2
  • 28
    • 84917352046 scopus 로고    scopus 로고
    • Benchmarking the English language demands of the nursing profession across Canada
    • Report submitted to the Centre for Canadian Language Benchmarks. Retrieved February 18, 2009, from
    • Epp, L., Stawychny, M., Bonham, A., & Cumming, A. (2002). Benchmarking the English language demands of the nursing profession across Canada. Winnipeg: Red River Community College. Report submitted to the Centre for Canadian Language Benchmarks. Retrieved February 18, 2009, from http://www.language.ca.
    • (2002) Winnipeg: Red River Community College
    • Epp, L.1    Stawychny, M.2    Bonham, A.3    Cumming, A.4
  • 30
    • 47749156417 scopus 로고    scopus 로고
    • Transforming talk and phonics practice: Or how do crabs clap
    • Gardner, S. (2008). Transforming talk and phonics practice: Or, how do crabs clap? TESOL Quarterly, 2(2), 61-284.
    • (2008) TESOL Quarterly , vol.2 , Issue.2 , pp. 61-284
    • Gardner, S.1
  • 32
    • 84866973347 scopus 로고    scopus 로고
    • Assessing literacies
    • In N. Bascia, A. Cumming, A. Datnow, K. Leithwood, & D. Livingstone (Eds.) Dordrecht Netherlands Springer
    • Gipps, C., & Cumming, J. J. (2005). Assessing literacies. In N. Bascia, A. Cumming, A. Datnow, K. Leithwood, & D. Livingstone (Eds.), International handbook of educational policy (Vol. 2, pp. 695-713). Dordrecht, Netherlands. Springer.
    • (2005) International Handbook Of Educational Policy , vol.2 , pp. 695-713
    • Gipps, C.1    Cumming, J.J.2
  • 33
    • 34247403478 scopus 로고    scopus 로고
    • Teacher written commentary in second language writing classrooms
    • University of Michigan Press
    • Goldstein, L. (2005). Teacher written commentary in second language writing classrooms. Ann Arbor: University of Michigan Press.
    • (2005) Ann Arbor
    • Goldstein, L.1
  • 34
    • 70350408657 scopus 로고
    • Classroom-Based assessment in intensive english centres
    • In G. Brindley (Ed.) Macquarie University: National Centre for English Language Teaching and Research, Australia
    • Grierson, J. (1995). Classroom-based assessment in Intensive English Centres. In G. Brindley (Ed.), Language assessment in action (pp. 195-236). Macquarie University: National Centre for English Language Teaching and Research, Australia.
    • (1995) Language Assessment in Action , pp. 195-236
    • Grierson, J.1
  • 35
    • 41149179083 scopus 로고    scopus 로고
    • The impact of testing practices on teaching: Ideologies and alternatives
    • In J. Cummins & C. Davison (Eds.) New York Springer
    • Hamp-Lyons, L. (2007). The impact of testing practices on teaching: Ideologies and alternatives. In J. Cummins & C. Davison (Eds.), International handbook of English language teaching: Part one (pp. 487-504). New York: Springer.
    • (2007) International Handbook of English Language Teaching: Part One , pp. 487-504
    • Hamp-Lyons, L.1
  • 36
    • 35448979922 scopus 로고    scopus 로고
    • Marching in unison: Florida ESL teachers and No Child Left Behind
    • Harper, C., Platt, E., Naranjo, C., & Boynton, S. (2007). Marching in unison: Florida ESL teachers and No Child Left Behind. TESOL Quarterly, 41(3), 642-651.
    • (2007) TESOL Quarterly , vol.41 , Issue.3 , pp. 642-651
    • Harper, C.1    Platt, E.2    Naranjo, C.3    Boynton, S.4
  • 38
    • 33745744973 scopus 로고    scopus 로고
    • The discursive construction of a high-stakes test: The many faces of a test-taker
    • Huhta, A., Kalaja, P., & Pitkanen-Huhta, A. (2006). The discursive construction of a high-stakes test: The many faces of a test-taker. Language Testing, 23(3), 326-350.
    • (2006) Language Testing , vol.23 , Issue.3 , pp. 326-350
    • Huhta, A.1    Kalaja, P.2    Pitkanen-Huhta, A.3
  • 39
    • 33751222044 scopus 로고    scopus 로고
    • Feedback on second language students' writing
    • Hyland, K., & Hyland, F. (2006). Feedback on second language students' writing. Language Teaching, 39(2), 83-101.
    • (2006) Language Teaching , vol.39 , Issue.2 , pp. 83-101
    • Hyland, K.1    Hyland, F.2
  • 40
    • 84970169623 scopus 로고
    • Interpreting an English competency exam: The frustrations of an ESL science student
    • Johns, A. (1991). Interpreting an English competency exam: The frustrations of an ESL science student. Written Communication, 8(3), 379-401.
    • (1991) Written Communication , vol.8 , Issue.3 , pp. 379-401
    • Johns, A.1
  • 41
    • 84990379644 scopus 로고    scopus 로고
    • Context-sensitive assessment of modern languages in primary (elementary) and early secondary education: Scotland and the European experience
    • Johnstone, R. (2000). Context-sensitive assessment of modern languages in primary (elementary) and early secondary education: Scotland and the European experience. Language Testing, 17(2), 123-143.
    • (2000) Language Testing , vol.17 , Issue.2 , pp. 123-143
    • Johnstone, R.1
  • 42
    • 68049126979 scopus 로고    scopus 로고
    • Dynamic assessment
    • In E. Shohamy (Vol. Ed.) & N. Hornberger (Series d.), Language testing and assessment 2nd ed. New York Springer
    • Lantolf, J., & Poehner, M. (2008). Dynamic assessment. In E. Shohamy (Vol. Ed.) & N. Hornberger (Series d.), Language testing and assessment: Vol. 7. Encyclopedia of language and education (2nd ed., pp. 273-284). New York: Springer.
    • (2008) Encyclopedia of Language and Education , vol.7 , pp. 273-284
    • Lantolf, J.1    Poehner, M.2
  • 43
    • 85045166764 scopus 로고    scopus 로고
    • Dynamic assessment: Assessment for and as teaching
    • Leung, C. (2007). Dynamic assessment: Assessment for and as teaching. Language Assessment Quarterly, 4(3), 257-278.
    • (2007) Language Assessment Quarterly , vol.4 , Issue.3 , pp. 257-278
    • Leung, C.1
  • 44
    • 33847692011 scopus 로고    scopus 로고
    • Expanding horizons and unresolved conundrums: Language testing and assessment
    • Leung, C., & Lewkowicz, J. (2006). Expanding horizons and unresolved conundrums: Language testing and assessment. TESOL Quarterly, 40(1), 211-234.
    • (2006) TESOL Quarterly , vol.40 , Issue.1 , pp. 211-234
    • Leung, C.1    Lewkowicz, J.2
  • 45
    • 84990374217 scopus 로고    scopus 로고
    • Teacher formative assessment and talk in classroom contexts: Assessment as discourse and assessment of discourse
    • Leung, C., & Mohan, B. (2004). Teacher formative assessment and talk in classroom contexts: Assessment as discourse and assessment of discourse. Language Testing, 21(3), 335-359.
    • (2004) Language Testing , vol.21 , Issue.3 , pp. 335-359
    • Leung, C.1    Mohan, B.2
  • 46
    • 84993812320 scopus 로고    scopus 로고
    • Assessment and accountability
    • Linn, R. L. (2000). Assessment and accountability. Educational Researcher, 29(2), 4-16.
    • (2000) Educational Researcher , vol.29 , Issue.2 , pp. 4-16
    • Linn, R.L.1
  • 47
    • 21744441851 scopus 로고    scopus 로고
    • Involving learners and their judgements in the assessment process language testing
    • Little, D. (2005). The Common European Framework and the European Language Portfolio: Involving learners and their judgements in the assessment process. Language Testing, 22(3), 321-336.
    • (2005) The Common European Framework and the European Language Portfolio , vol.22 , Issue.3 , pp. 321-336
    • Little, D.1
  • 48
    • 84982719183 scopus 로고
    • Criterion-reference test development: Linking curricula, teachers, and tests
    • Lynch, B., & Davidson, F. (1994). Criterion-reference test development: Linking curricula, teachers, and tests. TESOL Quarterly, 28(4), 727-743.
    • (1994) TESOL Quarterly , vol.28 , Issue.4 , pp. 727-743
    • Lynch, B.1    Davidson, F.2
  • 50
    • 79960769414 scopus 로고    scopus 로고
    • The standards movement and ELT for school-aged learners: Cross national perspectives
    • In J. Cummins & C. Davison (Eds.) New York Springer
    • McKay, P. (2007). The standards movement and ELT for school-aged learners: Cross national perspectives. In J. Cummins & C. Davison (Eds.), International handbook of English language teaching: Part one (pp. 439-456). New York: Springer.
    • (2007) International Handbook of English Language Teaching: Part One , pp. 439-456
    • McKay, P.1
  • 53
    • 0347937787 scopus 로고    scopus 로고
    • Telling what is real: Competing views in assessing ESL development
    • Moore, H. (2005). Telling what is real: Competing views in assessing ESL development. Linguistics and Education, 8(2), 189-228.
    • (2005) Linguistics and Education , vol.8 , Issue.2 , pp. 189-228
    • Moore, H.1
  • 54
    • 84890110303 scopus 로고    scopus 로고
    • Planning change, changing plans: Innovations in second language teaching
    • University of Michigan Press
    • Murray, D. (Ed.). (2008). Planning change, changing plans: Innovations in second language teaching. Ann Arbor: University of Michigan Press.
    • (2008) Ann Arbor
    • Murray, D.1
  • 55
    • 67549103065 scopus 로고    scopus 로고
    • Standards-based approaches to the evaluation of esl instruction
    • J. Cummins & C. Davison (Eds. New York Springer
    • Nunan, D. (2007). Standards-based approaches to the evaluation of ESL instruction. In J. Cummins & C. Davison (Eds.), International handbook of English language teaching: Part one (pp. 421-438). New York: Springer.
    • (2007) International Handbook of English Language Teaching: Part One , pp. 421-438
    • Nunan, D.1
  • 56
    • 85055360980 scopus 로고    scopus 로고
    • Recommending a nursing-specific passing standard for the IELTS examination
    • O'Neil, T., Buckendahl, C., Plake, B., & Taylor, L. (2007). Recommending a nursing-specific passing standard for the IELTS examination. Language Assessment Quarterly, 4(4), 295-317.
    • (2007) Language Assessment Quarterly , vol.4 , Issue.4 , pp. 295-317
    • O'Neil, T.1    Buckendahl, C.2    Plake, B.3    Taylor, L.4
  • 57
    • 21744450634 scopus 로고    scopus 로고
    • Dynamic assessment in the language classroom
    • Poehner, M., & Lantolf, J. (2005). Dynamic assessment in the language classroom. Language Teaching Research, 9(3), 233-265.
    • (2005) Language Teaching Research , vol.9 , Issue.3 , pp. 233-265
    • Poehner, M.1    Lantolf, J.2
  • 58
    • 77949951224 scopus 로고    scopus 로고
    • Assessing communicative language ability: Models and their components
    • In E. Shohamy (Vol. Ed.) & N. Hornberger (Series Ed.) 7. Encyclopedia of language and education (2nd ed New York Springer
    • Purpura, J. (2008). Assessing communicative language ability: Models and their components. In E. Shohamy (Vol. Ed.) & N. Hornberger (Series Ed.), Language testing and assessment: Vol. 7. Encyclopedia of language and education (2nd ed., pp. 53-68). New York: Springer.
    • (2008) Language Testing And Assessment , pp. 53-68
    • Purpura, J.1
  • 59
    • 84990321113 scopus 로고    scopus 로고
    • Mirror, mirror on the wall: Identifying processes of classroom assessment
    • Rea-Dickins, P. (2001). Mirror, mirror on the wall: Identifying processes of classroom assessment. Language Testing, 18(4), 429-462.
    • (2001) Language Testing , vol.18 , Issue.4 , pp. 429-462
    • Rea-Dickins, P.1
  • 60
    • 41549108079 scopus 로고    scopus 로고
    • In J. Cummins & C. Davison (Eds.), International handbook of English language teaching: Part one (pp. 505-520). New York Springer
    • Rea-Dickins, P. (2007). Classroom-based assessment: Possibilities and pitfalls. In J. Cummins & C. Davison (Eds.), International handbook of English language teaching: Part one (pp. 505-520). New York: Springer.
    • (2007) Classroom-Based Assessment: Possibilities and Pitfalls
    • Rea-Dickins, P.1
  • 61
    • 0040147162 scopus 로고    scopus 로고
    • Self-assessment in second language testing: A meta-analysis and analysis of experiential factors
    • Ross, S. (1998). Self-assessment in second language testing: A meta-analysis and analysis of experiential factors. Language Testing, 15(1), 1-20.
    • (1998) Language Testing , vol.15 , Issue.1 , pp. 1-20
    • Ross, S.1
  • 62
    • 41149145144 scopus 로고    scopus 로고
    • A new washback model of students' learning
    • In A. Cumming & M. Laurier (Eds.)
    • Shi, C. (2007). A new washback model of students' learning. In A. Cumming & M. Laurier (Eds.), Language assessment, special issue of Canadian Modern Language Review, 64(1), 133-160.
    • (2007) Language Assessment Special Issue of Canadian Modern Language Review , vol.64 , Issue.1 , pp. 133-160
    • Shi, C.1
  • 64
    • 78149437639 scopus 로고    scopus 로고
    • The power of language tests, the power of the english language and the role of elt
    • In J. Cummins & C. Davison (Eds.) New York Springer
    • Shohamy, E. (2007). The power of language tests, the power of the English language and the role of ELT. In J. Cummins & C. Davison (Eds.), International handbook of English language teaching: Part one (pp. 521-531). New York: Springer.
    • (2007) International Handbook of English Language Teaching: Part One , pp. 521-531
    • Shohamy, E.1
  • 66
    • 85050371740 scopus 로고    scopus 로고
    • Responding to change in English language assessment
    • Slayter, H. (2003). Responding to change in English language assessment. Prospect, 18(1), 42-52.
    • (2003) Prospect , vol.18 , Issue.1 , pp. 42-52
    • Slayter, H.1
  • 67
    • 61649113025 scopus 로고    scopus 로고
    • Who is given tests in what language by whom, when, and where? The need for probabilities views of language in the testing of English language learners
    • Solano-Flores, G. (2008). Who is given tests in what language by whom, when, and where? The need for probabilities views of language in the testing of English language learners. Educational Researcher, 37(4), 189-199.
    • (2008) Educational Researcher , vol.37 , Issue.4 , pp. 189-199
    • Solano-Flores, G.1
  • 68
    • 84993767863 scopus 로고    scopus 로고
    • Examining language in context: The need for new research and practice paradigms in the testing of English-language learners
    • Solano-Flores, G., & Trumbull, E. (2003). Examining language in context: The need for new research and practice paradigms in the testing of English-language learners. Educational Researcher, 32(2), 3-13.
    • (2003) Educational Researcher , vol.32 , Issue.2 , pp. 3-13
    • Solano-Flores, G.1    Trumbull, E.2
  • 69
    • 34248693423 scopus 로고    scopus 로고
    • Test translation and adaptation in public education in the USA
    • Stansfield, C. (2003). Test translation and adaptation in public education in the USA. Language Testing, 20(2), 188-206.
    • (2003) Language Testing , vol.20 , Issue.2 , pp. 188-206
    • Stansfield, C.1
  • 71
    • 70350422940 scopus 로고    scopus 로고
    • Teachers Of English To Speakers Of Other Languages (TESOL Alexandria, VA: TESOL
    • Teachers of English to Speakers of Other Languages (TESOL). (2001). Scenarios for ESL standards-based assessment. Alexandria, VA: TESOL.
    • (2001) Scenarios for ESL standards-based assessment
  • 74
    • 0034411947 scopus 로고    scopus 로고
    • The impact of high-stakes testing on teaching and learning: Can this be predicted or controlled
    • Wall, D. (2000). The impact of high-stakes testing on teaching and learning: Can this be predicted or controlled? System, 28(4), 499-509.
    • (2000) System , vol.28 , Issue.4 , pp. 499-509
    • Wall, D.1
  • 75
    • 84858808128 scopus 로고    scopus 로고
    • The impact of changes in the toefl examination on teaching and learning in central and eastern europe: Phase 1, the baseline study
    • Princeton, NJ Educational Testing Service. Retrieved February 18, 2009, from
    • Wall, D., & Horak, T. (2006). The impact of changes in the TOEFL examination on teaching and learning in central and eastern Europe: Phase 1, the baseline study. TOEFL Monograph MS 34. Princeton, NJ: Educational Testing Service. Retrieved February 18, 2009, from http://www.ets.org/portal/site/ets
    • (2006) TOEFL Monograph MS , vol.34
    • Wall, D.1    Horak, T.2
  • 76
    • 33645450171 scopus 로고    scopus 로고
    • Language education policy in Japan - The problem of espoused objectives versus practice
    • Yoshida, K. (2003). Language education policy in Japan - The problem of espoused objectives versus practice. Modern Language Journal, 87(2), 290-292.
    • (2003) Modern Language Journal , vol.87 , Issue.2 , pp. 290-292
    • Yoshida, K.1
  • 77
    • 85055360832 scopus 로고    scopus 로고
    • Validating TOEFL iBT speaking and setting score requirements for ITA screening
    • Xi, X. (2007). Validating TOEFL iBT speaking and setting score requirements for ITA screening. Language Assessment Quarterly, 4(4), 318-351.
    • (2007) Language Assessment Quarterly , vol.4 , Issue.4 , pp. 318-351
    • Xi, X.1


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.