메뉴 건너뛰기




Volumn , Issue , 2014, Pages 1-185

Cognitive Interviewing Methodology

Author keywords

[No Author keywords available]

Indexed keywords


EID: 84892844500     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781118838860     Document Type: Book
Times cited : (122)

References (166)
  • 3
    • 0003600480 scopus 로고    scopus 로고
    • Washington, DC: American Educational Research Association
    • AERA, APA, NCME. (1999). Standards for Educational and Psychological Testing. Washington, DC: American Educational Research Association.
    • (1999) Standards for Educational and Psychological Testing
  • 5
    • 29244440130 scopus 로고    scopus 로고
    • The strong program in cultural sociology
    • JC Alexander (ed), New York: Oxford University Press
    • Alexander JC, Smith P. (2004). The strong program in cultural sociology. In: JC Alexander (ed) The Meanings of Social Life. New York: Oxford University Press. pp. 11-26.
    • (2004) The Meanings of Social Life , pp. 11-26
    • Alexander, J.C.1    Smith, P.2
  • 6
    • 84905388458 scopus 로고    scopus 로고
    • Paradigms of cognitive interviewing practice and their implications for developing standards of best practices
    • Zentrum fur Umfragen, Methoden Und Analysen (ZUMA)
    • Beatty P. (2004). Paradigms of cognitive interviewing practice and their implications for developing standards of best practices. Proceedings of the 4th Conference on Question Evaluation Standards. Zentrum fur Umfragen, Methoden Und Analysen (ZUMA).
    • (2004) Proceedings of the 4th Conference on Question Evaluation Standards
    • Beatty, P.1
  • 7
    • 34547756300 scopus 로고    scopus 로고
    • Research synthesis: the practice of cognitive interviewing
    • Beatty P, Willis G. (2007). Research synthesis: the practice of cognitive interviewing. Public Opinion Quarterly, 71(2), 287-311.
    • (2007) Public Opinion Quarterly , vol.71 , Issue.2 , pp. 287-311
    • Beatty, P.1    Willis, G.2
  • 8
    • 84891068449 scopus 로고    scopus 로고
    • Analysis of non-equivalent assessments across different linguistic groups using a mixed methods approach: understanding the causes of differential item functioning by cognitive interviewing
    • Benítez I, Padilla JL. (2014). Analysis of non-equivalent assessments across different linguistic groups using a mixed methods approach: understanding the causes of differential item functioning by cognitive interviewing. Journal of Mixed Methods Research, 8(1), 52-68.
    • (2014) Journal of Mixed Methods Research , vol.8 , Issue.1 , pp. 52-68
    • Benítez, I.1    Padilla, J.L.2
  • 10
    • 79951586435 scopus 로고    scopus 로고
    • Total survey error: design, implementation, and evaluation
    • accessed March 15, 2013
    • Biemer PP. (2011). Total survey error: design, implementation, and evaluation. Public Opinion Quarterly, 74(5), 817-848. http://poq.oxfordjournals.org/cgi/doi/10.1093/poq/nfq058 (accessed March 15, 2013).
    • (2011) Public Opinion Quarterly , vol.74 , Issue.5 , pp. 817-848
    • Biemer, P.P.1
  • 11
    • 84927650494 scopus 로고    scopus 로고
    • Methods for the analysis of cognitive interviews
    • Washington, DC: American Statistical Association
    • Blair J, Brick PD. (2010). Methods for the analysis of cognitive interviews. Proceedings of the Section on Survey Research Methods. Washington, DC: American Statistical Association.
    • (2010) Proceedings of the Section on Survey Research Methods
    • Blair, J.1    Brick, P.D.2
  • 13
    • 73849142010 scopus 로고    scopus 로고
    • Cognitive interview techniques reveal specific behaviors and issues that could affect patient satisfaction relative to hospitalists
    • Blanden AR, Rohr RE. (2009). Cognitive interview techniques reveal specific behaviors and issues that could affect patient satisfaction relative to hospitalists. Journal of Hospital Medicine, 4(9), E1-E6.
    • (2009) Journal of Hospital Medicine , vol.4 , Issue.9 , pp. E1-E6
    • Blanden, A.R.1    Rohr, R.E.2
  • 15
    • 84883498015 scopus 로고    scopus 로고
    • The cognitive interviewing reporting framework (CIRF): towards the harmonization of cognitive testing reports. Methodology
    • Boeije H, Willis G. (2013). The cognitive interviewing reporting framework (CIRF): towards the harmonization of cognitive testing reports. Methodology. European Journal of Research Methods for the Behavioral and Social Sciences, 9(3), 87-95.
    • (2013) European Journal of Research Methods for the Behavioral and Social Sciences , vol.9 , Issue.3 , pp. 87-95
    • Boeije, H.1    Willis, G.2
  • 16
    • 0038755346 scopus 로고
    • An exploratory investigation of questionnaire pretesting with verbal protocol analysis
    • RH Holman, MR Solomon (eds), Provo, UT: Association for Consumer Research
    • Bolton R. (1991). An exploratory investigation of questionnaire pretesting with verbal protocol analysis. In: RH Holman, MR Solomon (eds) Advances in Consumer Research, Volume 18. Provo, UT: Association for Consumer Research. pp. 558-565.
    • (1991) Advances in Consumer Research , vol.18 , pp. 558-565
    • Bolton, R.1
  • 17
    • 84901624820 scopus 로고    scopus 로고
    • Text and context: challenges to comparability in survey questions
    • JHP Hoffmeyer-Zlotnik, JA Harkness (eds), Mannheim, Germany: ZUMA, accessed July 8, 2013
    • Braun M, Harkness JA. (2005). Text and context: challenges to comparability in survey questions. In: JHP Hoffmeyer-Zlotnik, JA Harkness (eds) Methodological Aspects in Cross-National Research (ZUMA-Nachrichten Spezial 11). Mannheim, Germany: ZUMA. pp. 95-107. http://www.gesis.org/fileadmin/upload/forschung/publikationen/zeitschriften/zuma_nachrichten_spezial/znspezial11.pdf (accessed July 8, 2013).
    • (2005) Methodological Aspects in Cross-National Research (ZUMA-Nachrichten Spezial 11) , pp. 95-107
    • Braun, M.1    Harkness, J.A.2
  • 19
    • 34548261916 scopus 로고    scopus 로고
    • The Rutgers School: a Zerubavelian culturalist cognitive sociology
    • Brekhus W. (2007). The Rutgers School: a Zerubavelian culturalist cognitive sociology. European Journal of Social Theory, 10(3), 448-464.
    • (2007) European Journal of Social Theory , vol.10 , Issue.3 , pp. 448-464
    • Brekhus, W.1
  • 21
    • 51449083409 scopus 로고    scopus 로고
    • Identities and behavior
    • PJ Burke, TJ Owens, RT Sherpe, PA Thoits (eds), New York: Kluwer Academic/Plenum Publishers
    • Cast AD. (2003). Identities and behavior. In: PJ Burke, TJ Owens, RT Sherpe, PA Thoits (eds) Advances in Identity Theory and Research. New York: Kluwer Academic/Plenum Publishers. pp. 41-53.
    • (2003) Advances in Identity Theory and Research , pp. 41-53
    • Cast, A.D.1
  • 22
    • 0030360761 scopus 로고    scopus 로고
    • Effects of Interviewer Gender, Interviewer Choice, and Item Wording on Responses to Questions Concerning Sexual Behavior
    • Catania, JA, Binson D, Canchola J, Pollack LM, Hauck W, Coates TJ. (1996). Effects of Interviewer Gender, Interviewer Choice, and Item Wording on Responses to Questions Concerning Sexual Behavior. Public Opinion Quarterly, 60(3), 345-375.
    • (1996) Public Opinion Quarterly , vol.60 , Issue.3 , pp. 345-375
    • Catania, J.A.1    Binson, D.2    Canchola, J.3    Pollack, L.M.4    Hauck, W.5    Coates, T.J.6
  • 24
    • 0031510165 scopus 로고    scopus 로고
    • Quantifying qualitative analyses of verbal data: a practical guide
    • Chi M. (1997). Quantifying qualitative analyses of verbal data: a practical guide. The Journal of Learning Sciences, 6(3), 271-315.
    • (1997) The Journal of Learning Sciences , vol.6 , Issue.3 , pp. 271-315
    • Chi, M.1
  • 25
    • 84893558070 scopus 로고    scopus 로고
    • Intersectionality
    • G Waylen, K Celis, J Kantola, L Weldon (eds), New York: Oxford University Press
    • Collins P, Chepp V. (2013). Intersectionality. In: G Waylen, K Celis, J Kantola, L Weldon (eds) The Oxford Handbook of Gender and Politics. New York: Oxford University Press. pp. 57-87.
    • (2013) The Oxford Handbook of Gender and Politics , pp. 57-87
    • Collins, P.1    Chepp, V.2
  • 26
    • 84926475644 scopus 로고    scopus 로고
    • Cross-Cultural Survey Guidelines (CCSG)
    • accessed on April 17, 2014
    • Comparative Survey Design and Implementation Workgroup (2011). Cross-Cultural Survey Guidelines (CCSG). http://ccsg.isr.umich.edu/index.cfm (accessed on April 17, 2014).
    • (2011)
  • 27
    • 0141933065 scopus 로고    scopus 로고
    • From impressions to data: increasing the objectivity of cognitive interviews
    • Washington, DC: American Statistical Association
    • Conrad F, Blair J. (1996). From impressions to data: increasing the objectivity of cognitive interviews. Proceedings of the Section on Survey Research Methods. Washington, DC: American Statistical Association.
    • (1996) Proceedings of the Section on Survey Research Methods
    • Conrad, F.1    Blair, J.2
  • 28
    • 33750286204 scopus 로고    scopus 로고
    • Data quality in cognitive interviews: the case for verbal reports
    • S Presser, J Rothgeb, M Couper, J Lessler, E Martin, J Martin, E Singer (eds), Hoboken, NJ: John Wiley & Sons
    • Conrad F, Blair J. (2004). Data quality in cognitive interviews: the case for verbal reports. In: S Presser, J Rothgeb, M Couper, J Lessler, E Martin, J Martin, E Singer (eds) Methods for Testing and Evaluating Survey Questionnaires. Hoboken, NJ: John Wiley & Sons.
    • (2004) Methods for Testing and Evaluating Survey Questionnaires
    • Conrad, F.1    Blair, J.2
  • 29
    • 68349160349 scopus 로고    scopus 로고
    • Sources of error in cognitive interviews
    • Conrad FG, Blair J. (2009). Sources of error in cognitive interviews. Public Opinion Quarterly, 73, 32-55.
    • (2009) Public Opinion Quarterly , vol.73 , pp. 32-55
    • Conrad, F.G.1    Blair, J.2
  • 37
    • 0002219115 scopus 로고
    • The art and politics of interpretation
    • K Norman, K Denzin, YS Lincoln (eds), Thousand Oaks, CA: Sage Publications
    • Denzin N. (1994). The art and politics of interpretation In: K Norman, K Denzin, YS Lincoln (eds) Handbook of Qualitative Research. Thousand Oaks, CA: Sage Publications.
    • (1994) Handbook of Qualitative Research
    • Denzin, N.1
  • 42
    • 0001302512 scopus 로고    scopus 로고
    • Autoethnography, personal narrative, reflexivity
    • NK. Denzin, YS. Lincoln (eds), 2nd edition. Thousand Oaks, CA: Sage Publications
    • Ellis C, Bochner AP. (2000). Autoethnography, personal narrative, reflexivity. In: NK. Denzin, YS. Lincoln (eds) Handbook of Qualitative Research, 2nd edition. Thousand Oaks, CA: Sage Publications. pp. 733-768.
    • (2000) Handbook of Qualitative Research , pp. 733-768
    • Ellis, C.1    Bochner, A.P.2
  • 46
    • 84926452694 scopus 로고    scopus 로고
    • ESS Round 6 Translation Guidelines
    • Mannheim, European Social Survey GESIS, accessed July 8, 2013
    • European Social Survey. (2012). ESS Round 6 Translation Guidelines. Mannheim, European Social Survey GESIS. http://www.europeansocialsurvey.org/index.php?option=com_docman&task=doc_download&gid=943&Itemid=80 (accessed July 8, 2013).
    • (2012)
  • 47
    • 84857076522 scopus 로고    scopus 로고
    • Testing for equivalence using crossnational cognitive interviewing
    • Centre for Comparative Social Surveys Working Paper Series, Paper no. 01, accessed July 8, 2013
    • Fitzgerald R, Widdop S, Gray M, Collins D. (2009). Testing for equivalence using crossnational cognitive interviewing. Centre for Comparative Social Surveys Working Paper Series, Paper no. 01. http://www.city.ac.uk/__data/assets/pdf_file/0014/125132/CCSSWorking-Paper-No-01.pdf (accessed July 8, 2013).
    • (2009)
    • Fitzgerald, R.1    Widdop, S.2    Gray, M.3    Collins, D.4
  • 48
    • 0002361638 scopus 로고
    • Cognitive laboratory methods: a taxonomy
    • P Biemer, R Groves, L Lyberg, N Mathiowetz, S Sudman (eds), New York: John Wiley & Sons
    • Forsyth B, Lessler J. (1991). Cognitive laboratory methods: a taxonomy. In: P Biemer, R Groves, L Lyberg, N Mathiowetz, S Sudman (eds) Measurement Error in Surveys. New York: John Wiley & Sons.
    • (1991) Measurement Error in Surveys
    • Forsyth, B.1    Lessler, J.2
  • 49
    • 0032326988 scopus 로고    scopus 로고
    • Narrative analysis-or why (and how) sociologists should be interested in narrative
    • Franzosi R. (1998). Narrative analysis-or why (and how) sociologists should be interested in narrative. Annual Review of Sociology, 24, 517-554.
    • (1998) Annual Review of Sociology , vol.24 , pp. 517-554
    • Franzosi, R.1
  • 51
    • 0001891889 scopus 로고    scopus 로고
    • The view from anthropology: ethnography and the cognitive interview
    • MG Sirken, DJ Herrmann, S Schechter, N Schwarz, JM Tanur, R Tourangeau (eds), New York: John Wiley & Sons, Inc
    • Gerber ER. (1999). The view from anthropology: ethnography and the cognitive interview. In: MG Sirken, DJ Herrmann, S Schechter, N Schwarz, JM Tanur, R Tourangeau (eds) Cognition and Survey Research. New York: John Wiley & Sons, Inc.
    • (1999) Cognition and Survey Research
    • Gerber, E.R.1
  • 52
    • 84996211261 scopus 로고    scopus 로고
    • Perspectives on pretesting: 'cognition' in the cognitive interview?
    • Gerber ER, Wellens TR. (1997). Perspectives on pretesting: 'cognition' in the cognitive interview? Bulletin de Methodologie Sociologique, 55, 18-39.
    • (1997) Bulletin de Methodologie Sociologique , vol.55 , pp. 18-39
    • Gerber, E.R.1    Wellens, T.R.2
  • 54
    • 84873295088 scopus 로고    scopus 로고
    • Reflexivity and qualitative research
    • accessed February 28, 2013
    • Gilgun J. (2010). Reflexivity and qualitative research. Current Issues in Qualitative Research, 1(2), 1-8. http://www.scribd.com/doc/35787948/Reflexivity-and-Qualitative-Research (accessed February 28, 2013).
    • (2010) Current Issues in Qualitative Research , vol.1 , Issue.2 , pp. 1-8
    • Gilgun, J.1
  • 56
    • 0035999690 scopus 로고    scopus 로고
    • Using focus groups to develop a culturally sensitive methodology for epidemiological surveys in a Latino population: findings from the Los Angeles Latino Eye Study (LALES)
    • Globe D, Schoua-Glusberg A, Paz S, Yu E, Preston-Martin S, Azen S, Varma R. (2002). Using focus groups to develop a culturally sensitive methodology for epidemiological surveys in a Latino population: findings from the Los Angeles Latino Eye Study (LALES). Ethnicity and Disease, 12, 259-266.
    • (2002) Ethnicity and Disease , vol.12 , pp. 259-266
    • Globe, D.1    Schoua-Glusberg, A.2    Paz, S.3    Yu, E.4    Preston-Martin, S.5    Azen, S.6    Varma, R.7
  • 57
    • 75749125954 scopus 로고    scopus 로고
    • Adapting cognitive interview techniques for use in pretesting Spanish language survey instruments
    • Statistical Research Division Research Report Series, Survey Methodology #2006-2003. US Census Bureau, accessed July 8, 2013
    • Goerman P. (2006). Adapting cognitive interview techniques for use in pretesting Spanish language survey instruments. Statistical Research Division Research Report Series, Survey Methodology #2006-2003. US Census Bureau. http://www.census.gov/srd/papers/pdf/rsm2006-03.pdf (accessed July 8, 2013).
    • (2006)
    • Goerman, P.1
  • 58
    • 84956487291 scopus 로고    scopus 로고
    • Managing the cognitive pretesting of multilingual survey instruments: a case study of pretesting in the U.S. Census Bureau Bilingual Spanish/English Questionnaire
    • JA Harkness, M Braun, B Edwards, T Johnson, L Lyberg, PPh. Mohler, B-E Pennell, TW Smith (eds), Hoboken, NJ: John Wiley & Sons
    • Goerman PL, Caspar RA. (2010). Managing the cognitive pretesting of multilingual survey instruments: a case study of pretesting in the U.S. Census Bureau Bilingual Spanish/English Questionnaire. In: JA Harkness, M Braun, B Edwards, T Johnson, L Lyberg, PPh. Mohler, B-E Pennell, TW Smith (eds) Survey Methods in Multinational, Multiregional, and Multicultural Contexts. Hoboken, NJ: John Wiley & Sons.
    • (2010) Survey Methods in Multinational, Multiregional, and Multicultural Contexts
    • Goerman, P.L.1    Caspar, R.A.2
  • 62
    • 0030503752 scopus 로고    scopus 로고
    • Narrative analysis and the new historical sociology
    • Gotham KF, Staples WG. (1996). Narrative analysis and the new historical sociology. The Sociological Quarterly, 37(3), 481-501.
    • (1996) The Sociological Quarterly , vol.37 , Issue.3 , pp. 481-501
    • Gotham, K.F.1    Staples, W.G.2
  • 65
    • 79951593501 scopus 로고    scopus 로고
    • Total survey error: past, present, and future
    • accessed March 15, 2013
    • Groves RM, Lyberg L. (2011). Total survey error: past, present, and future. Public Opinion Quarterly, 74(5), 849-879. http://poq.oxfordjournals.org/cgi/doi/10.1093/poq/nfq065 (accessed March 15, 2013).
    • (2011) Public Opinion Quarterly , vol.74 , Issue.5 , pp. 849-879
    • Groves, R.M.1    Lyberg, L.2
  • 67
    • 0027731119 scopus 로고
    • Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines
    • Guillemin F, Bombardier C, Beaton D. (1993). Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. Journal of Clinical Epidemiology, 46(12), 1417-1432.
    • (1993) Journal of Clinical Epidemiology , vol.46 , Issue.12 , pp. 1417-1432
    • Guillemin, F.1    Bombardier, C.2    Beaton, D.3
  • 68
    • 0043068525 scopus 로고    scopus 로고
    • Questionnaire translation
    • JA Harkness, F van de Vijver, PPh. Mohler (eds), Hoboken, NJ: John Wiley & Sons
    • Harkness JA. (2003). Questionnaire translation. In: JA Harkness, F van de Vijver, PPh. Mohler (eds) Cross-Cultural Survey Methods. Hoboken, NJ: John Wiley & Sons. pp. 35-56.
    • (2003) Cross-Cultural Survey Methods , pp. 35-56
    • Harkness, J.A.1
  • 69
    • 0042253493 scopus 로고    scopus 로고
    • Questionnaires in translation
    • JA Harkness (ed), [ZUMA-Nachrichten Spezial 3]. Mannheim, Germany: ZUMA
    • Harkness JA, Schoua-Glusberg A. (1998). Questionnaires in translation. In: JA Harkness (ed) Cross-Cultural Survey Equivalence [ZUMA-Nachrichten Spezial 3]. Mannheim, Germany: ZUMA. pp. 87-126.
    • (1998) Cross-Cultural Survey Equivalence , pp. 87-126
    • Harkness, J.A.1    Schoua-Glusberg, A.2
  • 70
    • 0043068525 scopus 로고    scopus 로고
    • Questionnaire design in comparative research
    • JA Harkness, F van de Vijver, PPh Mohler (eds), Hoboken, NJ: John Wiley & Sons
    • Harkness JA, Van de Vijver FJR, Johnson TP. (2003). Questionnaire design in comparative research. In: JA Harkness, F van de Vijver, PPh Mohler (eds) Cross-Cultural Survey Methods. Hoboken, NJ: John Wiley & Sons. pp. 19-34.
    • (2003) Cross-Cultural Survey Methods , pp. 19-34
    • Harkness, J.A.1    Van de Vijver, F.J.R.2    Johnson, T.P.3
  • 71
    • 2942609493 scopus 로고    scopus 로고
    • Questionnaire translation and assessment
    • S Presser, J Rothgeb, M Couper, J Lessler, E Martin, J Martin, E Singer (eds), Hoboken, NJ: John Wiley & Sons
    • Harkness JA, Pennell B-E, Schoua-Glusberg A. (2004). Questionnaire translation and assessment. In: S Presser, J Rothgeb, M Couper, J Lessler, E Martin, J Martin, E Singer (eds) Methods for Testing and Evaluating Survey Questionnaires. Hoboken, NJ: John Wiley & Sons. pp. 453-473.
    • (2004) Methods for Testing and Evaluating Survey Questionnaires , pp. 453-473
    • Harkness, J.A.1    Pennell, B.-E.2    Schoua-Glusberg, A.3
  • 72
    • 57149143350 scopus 로고    scopus 로고
    • Translation procedures and translation assessment in the world mental health survey initiative
    • RC Kessler, UT Bedirhan (eds), New York: Cambridge University Press
    • Harkness JA, Pennell B-E, Villar A, Gebler N, Aguilar-Gaxiola S, Bilgen I. (2008). Translation procedures and translation assessment in the world mental health survey initiative. In: RC Kessler, UT Bedirhan (eds) The World Health Organization Mental Health Survey. New York: Cambridge University Press. pp. 91-143.
    • (2008) The World Health Organization Mental Health Survey , pp. 91-143
    • Harkness, J.A.1    Pennell, B.-E.2    Villar, A.3    Gebler, N.4    Aguilar-Gaxiola, S.5    Bilgen, I.6
  • 73
    • 84956494743 scopus 로고    scopus 로고
    • Translation, adaptation, and design
    • JAHarkness, M Braun, B Edwards, T Johnson, L Lyberg, PPh. Mohler, B-E Pennell, TW Smith (eds), Hoboken, NJ: John Wiley & Sons
    • Harkness JA,Villar A, Edwards B. (2010). Translation, adaptation, and design. In: JAHarkness, M Braun, B Edwards, T Johnson, L Lyberg, PPh. Mohler, B-E Pennell, TW Smith (eds) Survey Methods in Multinational, Multicultural and Multiregional Contexts. Hoboken, NJ: John Wiley & Sons. pp. 117-140.
    • (2010) Survey Methods in Multinational, Multicultural and Multiregional Contexts , pp. 117-140
    • Harkness, J.A.1    Villar, A.2    Edwards, B.3
  • 74
    • 84926435196 scopus 로고    scopus 로고
    • Violence Against Children Survey (VACS) Cognitive Interview Study
    • Malawi: Final Report. Hyattsville, MD: Centers for Disease Control and Prevention, National Center for Health Statistics
    • Harwell D. (2013). Violence Against Children Survey (VACS) Cognitive Interview Study, Malawi: Final Report. Hyattsville, MD: Centers for Disease Control and Prevention, National Center for Health Statistics.
    • (2013)
    • Harwell, D.1
  • 76
    • 70350727609 scopus 로고    scopus 로고
    • Narrative psychology
    • C Willig, W Stainton-Rogers (eds), Thousand Oaks, CA: Sage Publications
    • Hiles D, Cermak I. (2008). Narrative psychology. In: C Willig, W Stainton-Rogers (eds) The Sage Handbook of Qualitative Research Psychology. Thousand Oaks, CA: Sage Publications.
    • (2008) The Sage Handbook of Qualitative Research Psychology
    • Hiles, D.1    Cermak, I.2
  • 78
    • 84993820511 scopus 로고    scopus 로고
    • Mixed methods research: a research paradigm whose time has come
    • Johnson RB, Onwuegbuzie AJ. (2004). Mixed methods research: a research paradigm whose time has come. Educational Researcher, 33(7), 14-26.
    • (2004) Educational Researcher , vol.33 , Issue.7 , pp. 14-26
    • Johnson, R.B.1    Onwuegbuzie, A.J.2
  • 79
    • 84875058768 scopus 로고    scopus 로고
    • Validation as a pragmatic, scientific activity
    • Kane MT. (2013). Validation as a pragmatic, scientific activity. Journal of Educational Measurement, 50, 115-122.
    • (2013) Journal of Educational Measurement , vol.50 , pp. 115-122
    • Kane, M.T.1
  • 80
    • 84954157441 scopus 로고    scopus 로고
    • Experiments for evaluating survey questions
    • K Miller, J Madans, G Willis, A Maitland (eds), New York: John Wiley & Sons
    • Krosnick JA. (2011). Experiments for evaluating survey questions. In: K Miller, J Madans, G Willis, A Maitland (eds) Question Evaluation Methods. New York: John Wiley & Sons.
    • (2011) Question Evaluation Methods
    • Krosnick, J.A.1
  • 81
    • 34247329930 scopus 로고
    • An evaluation of a cognitive theory of response order effects in survey measurement
    • Krosnick JA, Alwin DF. (1987). An evaluation of a cognitive theory of response order effects in survey measurement. Public Opinion Quarterly, 51, 201-219.
    • (1987) Public Opinion Quarterly , vol.51 , pp. 201-219
    • Krosnick, J.A.1    Alwin, D.F.2
  • 82
    • 77952547949 scopus 로고    scopus 로고
    • Questionnaire design
    • JD Wright, PV Marsden (eds), 2nd edition. West Yorkshire, UK: Emerald Group
    • Krosnick JA, Presser S. (2010). Questionnaire design. In: JD Wright, PV Marsden (eds) Handbook of Survey Research, 2nd edition. West Yorkshire, UK: Emerald Group.
    • (2010) Handbook of Survey Research
    • Krosnick, J.A.1    Presser, S.2
  • 83
    • 0004012131 scopus 로고
    • Chicago, IL: University of Chicago Press
    • Levi-Strauss C. ([1962] 1966). The Savage Mind. Chicago, IL: University of Chicago Press.
    • (1962) The Savage Mind
    • Levi-Strauss, C.1
  • 88
    • 84926504403 scopus 로고    scopus 로고
    • Testing of the Questions on Second Hand Smoke for the National Health and Nutrition Examination Survey (NHANES)
    • Results of Interviews Conducted 09/18/12-01/30/13. Hyattsville, MD: Centers for Disease Control and Prevention, National Center for Health Statistics
    • Massey M, Chepp V, Creamer L, Ramirez F. (2013). Testing of the Questions on Second Hand Smoke for the National Health and Nutrition Examination Survey (NHANES): Results of Interviews Conducted 09/18/12-01/30/13. Hyattsville, MD: Centers for Disease Control and Prevention, National Center for Health Statistics.
    • (2013)
    • Massey, M.1    Chepp, V.2    Creamer, L.3    Ramirez, F.4
  • 89
    • 33645909259 scopus 로고    scopus 로고
    • The me and the not-me: positive and negative poles of identity
    • PJ Burke, TJ Owens, RT Sherpe, PA Thoits (eds), New York: Kluwer Academic/Plenum Publishers
    • McCall GJ. (2003). The me and the not-me: positive and negative poles of identity. In: PJ Burke, TJ Owens, RT Sherpe, PA Thoits (eds) Advances in Identity Theory and Research. New York: Kluwer Academic/Plenum Publishers. pp. 11-25.
    • (2003) Advances in Identity Theory and Research , pp. 11-25
    • McCall, G.J.1
  • 90
    • 0003891615 scopus 로고
    • Chicago, IL: University of Chicago Press
    • Mead GH. (1934). Mind, Self, and Society. Chicago, IL: University of Chicago Press.
    • (1934) Mind, Self, and Society
    • Mead, G.H.1
  • 91
    • 0002438489 scopus 로고
    • Underreporting of Substance Use In a National Longitudinal Youth Cohort
    • Mensch, B, Kandel DB. (1988). Underreporting of Substance Use In a National Longitudinal Youth Cohort. Public Opinion Quarterly, 52(1), 100-124.
    • (1988) Public Opinion Quarterly , vol.52 , Issue.1 , pp. 100-124
    • Mensch, B.1    Kandel, D.B.2
  • 92
    • 27544515269 scopus 로고    scopus 로고
    • Assessing and evaluating qualitative research. In: SB Merriam (ed)
    • San Francisco, CA: Jossey-Bass
    • Merriam SB. (2002). Assessing and evaluating qualitative research. In: SB Merriam (ed). Qualitative Research in Practice. San Francisco, CA: Jossey-Bass.
    • (2002) Qualitative Research in Practice
    • Merriam, S.B.1
  • 95
    • 84555207576 scopus 로고    scopus 로고
    • Results of the Comparative Cognitive Test Workgroup Budapest initiative module
    • accessed April 17, 2014
    • Miller K. (2008). Results of the Comparative Cognitive Test Workgroup Budapest initiative module. http://wwwn.cdc.gov/QBANK/report%5CMiller_NCHS_2008BudapestReport.pdf (accessed April 17, 2014).
    • (2008)
    • Miller, K.1
  • 97
    • 84926466756 scopus 로고    scopus 로고
    • A mixed-method approach for measurement construction for cross-national studies
    • Joint Statistical Meetings, Vancouver, CA
    • Miller K, Maitland A. (2010). A mixed-method approach for measurement construction for cross-national studies. Joint Statistical Meetings, Vancouver, CA.
    • (2010)
    • Miller, K.1    Maitland, A.2
  • 98
    • 84872506652 scopus 로고    scopus 로고
    • Design, Development and Testing of the NHIS Sexual Identity Question
    • accessed April 17, 2014
    • Miller K, Ryan JM. (2011). Design, Development and Testing of the NHIS Sexual Identity Question. http://wwwn.cdc.gov/qbank/report/Miller_NCHS_2011_NHISSexualIdentity.pdf (accessed April 17, 2014).
    • (2011)
    • Miller, K.1    Ryan, J.M.2
  • 99
    • 84988090421 scopus 로고
    • Logistic discriminant function analysis for DIF identification of polytomously scored items
    • Miller TR, Spray JA. (1993). Logistic discriminant function analysis for DIF identification of polytomously scored items. Journal of Educational Measurement, 30, 107-122.
    • (1993) Journal of Educational Measurement , vol.30 , pp. 107-122
    • Miller, T.R.1    Spray, J.A.2
  • 100
    • 84976969380 scopus 로고
    • Methodology review: statistical approaches for assessing measurement bias
    • Millsap RE, Everson HT. (1993). Methodology review: statistical approaches for assessing measurement bias. Applied Psychological Measurement, 17, 297-334.
    • (1993) Applied Psychological Measurement , vol.17 , pp. 297-334
    • Millsap, R.E.1    Everson, H.T.2
  • 101
    • 33845327389 scopus 로고    scopus 로고
    • Standards and Guidelines for Statistical Surveys
    • accessed January 22, 2014
    • Office of Management and Budget. (2006). Standards and Guidelines for Statistical Surveys. http://www.whitehouse.gov/sites/default/files/omb/inforeg/statpolicy/standards_stat_surveys.pdf (accessed January 22, 2014).
    • (2006)
  • 103
    • 84926499293 scopus 로고    scopus 로고
    • PISA 2006 database. Retrieved July 20, 2010, from
    • Organisation for Economic Co-operation and Development. (2006). PISA 2006 database. Retrieved July 20, 2010, from http://pisa2006.acer.edu.au/downloads.php.
    • (2006)
  • 106
    • 84892888078 scopus 로고    scopus 로고
    • Validity evidence based on response processes
    • Padilla JL, Benítez I. (2014). Validity evidence based on response processes. Psicothema, 26, 136-144.
    • (2014) Psicothema , vol.26 , pp. 136-144
    • Padilla, J.L.1    Benítez, I.2
  • 107
    • 84883525455 scopus 로고    scopus 로고
    • Obtaining validity by cognitive interviewing to interpret psychometric results
    • Padilla JL, Benitez I, Castillo M. (2013). Obtaining validity by cognitive interviewing to interpret psychometric results. Methodology, 9, 113-122.
    • (2013) Methodology , vol.9 , pp. 113-122
    • Padilla, J.L.1    Benitez, I.2    Castillo, M.3
  • 108
    • 47349105110 scopus 로고    scopus 로고
    • Census Bureau guidelines for the translation of data collection instruments and supporting materials: documentation on how the guideline was developed (Research Report Series #2005-06)
    • Statistical Research Division, Washington, DC: US Bureau of the Census
    • Pan Y, de la Puente M(2005). Census Bureau guidelines for the translation of data collection instruments and supporting materials: documentation on how the guideline was developed (Research Report Series #2005-06). Statistical Research Division, Washington, DC: US Bureau of the Census.
    • (2005)
    • Pan, Y.1    de la Puente, M.2
  • 109
    • 84956564317 scopus 로고    scopus 로고
    • Cognitive interviewing in non-english languages: a cross-cultural perspective
    • J. Harkness, M. Braun, B. Edwards, T. Johnson, L. Lyberg, PPh. Mohler, B-E. Pennell, T. Smith (eds), Hoboken, NJ: John Wiley & Sons
    • Pan Y, Landreth A, Park H, Hinsdale-Shouse M, Schoua-Glusberg A. (2010). Cognitive interviewing in non-english languages: a cross-cultural perspective. In: J. Harkness, M. Braun, B. Edwards, T. Johnson, L. Lyberg, PPh. Mohler, B-E. Pennell, T. Smith (eds) Survey Methods in Multinational, Multicultural and Multiregional Contexts. Hoboken, NJ: John Wiley & Sons, pp. 91-115.
    • (2010) Survey Methods in Multinational, Multicultural and Multiregional Contexts , pp. 91-115
    • Pan, Y.1    Landreth, A.2    Park, H.3    Hinsdale-Shouse, M.4    Schoua-Glusberg, A.5
  • 110
    • 14544269013 scopus 로고    scopus 로고
    • DIFAS: differential item functioning analysis system
    • Penfield RD. (2005). DIFAS: differential item functioning analysis system. Applied Psychological Measurement, 29, 150-151.
    • (2005) Applied Psychological Measurement , vol.29 , pp. 150-151
    • Penfield, R.D.1
  • 111
    • 58149119982 scopus 로고    scopus 로고
    • Using a taxonomy of differential step functioning to improve the interpretation of DIF in polytomous items: an illustration
    • Penfield RD, Alvarez K, Lee O. (2009). Using a taxonomy of differential step functioning to improve the interpretation of DIF in polytomous items: an illustration. Applied Measurement in Education, 22, 61-78.
    • (2009) Applied Measurement in Education , vol.22 , pp. 61-78
    • Penfield, R.D.1    Alvarez, K.2    Lee, O.3
  • 112
    • 1542768699 scopus 로고
    • Homosexual categories: some research problems in the labeling perspective of homosexuality
    • K Plummer (ed), London: Hutchinson
    • Plummer K. (1981). Homosexual categories: some research problems in the labeling perspective of homosexuality. In: K Plummer (ed), The Making of the Modern Homosexual. London: Hutchinson. pp. 53-75.
    • (1981) The Making of the Modern Homosexual , pp. 53-75
    • Plummer, K.1
  • 115
    • 84929065860 scopus 로고
    • On narrative and sociology
    • Reed JS. (1989). On narrative and sociology. Social Forces, 68(1), 1-14.
    • (1989) Social Forces , vol.68 , Issue.1 , pp. 1-14
    • Reed, J.S.1
  • 116
    • 84955069580 scopus 로고    scopus 로고
    • Applying item response theory for questionnaire evaluation. In: J Madans, K Miller, A Maitland, G Willis (eds)
    • Hoboken, NJ: John Wiley & Sons
    • Reeve, B. (2011). Applying item response theory for questionnaire evaluation. In: J Madans, K Miller, A Maitland, G Willis (eds). Question Evaluation Methods. Hoboken, NJ: John Wiley & Sons. pp. 105-125.
    • (2011) Question Evaluation Methods , pp. 105-125
    • Reeve, B.1
  • 117
    • 0002097617 scopus 로고
    • Qualitative and quantitative inquiries are not incompatible: a call for a new partnership
    • Reichardt CS, Rallis SF. (1994). Qualitative and quantitative inquiries are not incompatible: a call for a new partnership. New Directions for Program Evaluation, 61, 85-91.
    • (1994) New Directions for Program Evaluation , vol.61 , pp. 85-91
    • Reichardt, C.S.1    Rallis, S.F.2
  • 119
    • 84926460287 scopus 로고    scopus 로고
    • Testing of NHANES A-CASI Reactions to Race Questions Results of Interviews Conducted November 2008-February 2009
    • Hyattsville, MD: Centers for Disease Control and Prevention, National Center for Health Statistics
    • Ridolfo H, Schoua-Glusberg A. (2009). Testing of NHANES A-CASI Reactions to Race Questions Results of Interviews Conducted November 2008-February 2009. Hyattsville, MD: Centers for Disease Control and Prevention, National Center for Health Statistics.
    • (2009)
    • Ridolfo, H.1    Schoua-Glusberg, A.2
  • 120
    • 84864040430 scopus 로고    scopus 로고
    • Measuring sexual identity using survey questionnaires: how valid are our measures?
    • Ridolfo H, Miller K, Maitland A. (2012). Measuring sexual identity using survey questionnaires: how valid are our measures? Sexuality Research and Social Policy, 9(2), 113-124.
    • (2012) Sexuality Research and Social Policy , vol.9 , Issue.2 , pp. 113-124
    • Ridolfo, H.1    Miller, K.2    Maitland, A.3
  • 123
    • 21144474590 scopus 로고
    • 'Coming out' in the age of social constructionism: sexual identity formation among lesbian and bisexual women
    • Rust PC. (1993). 'Coming out' in the age of social constructionism: sexual identity formation among lesbian and bisexual women. Gender & Society, 7(1), 50-77.
    • (1993) Gender & Society , vol.7 , Issue.1 , pp. 50-77
    • Rust, P.C.1
  • 124
    • 84926499291 scopus 로고    scopus 로고
    • Hispanic Adult Tobacco Survey: Cognitive Testing Report
    • Hyattsville, MD: Centers for Disease Control and Prevention, National Center for Health Statistics
    • Schoua-Glusberg A. (2005). Hispanic Adult Tobacco Survey: Cognitive Testing Report. Hyattsville, MD: Centers for Disease Control and Prevention, National Center for Health Statistics.
    • (2005)
    • Schoua-Glusberg, A.1
  • 125
    • 84926499290 scopus 로고    scopus 로고
    • Measuring Education among Latin American Immigrants in the U.S.:AQualitative Examination of Question Formulation and Error
    • Presented at the 3MC Conference, June 25-29. Berlin, Germany
    • Schoua-Glusberg, A, Carter, W, Martinez-Picazo, E. (2008). Measuring Education among Latin American Immigrants in the U.S.:AQualitative Examination of Question Formulation and Error. Presented at the 3MC Conference, June 25-29. Berlin, Germany.
    • (2008)
    • Schoua-Glusberg, A.1    Carter, W.2    Martinez-Picazo, E.3
  • 126
    • 33947207395 scopus 로고    scopus 로고
    • Cognitive aspects of survey methodology
    • Schwarz N. (2007). Cognitive aspects of survey methodology. Applied Cognitive Psychology, 21, 277-287.
    • (2007) Applied Cognitive Psychology , vol.21 , pp. 277-287
    • Schwarz, N.1
  • 128
    • 0002670926 scopus 로고
    • Questionnaire construction and item writing
    • P Rossie, J Wright, A Anderson (eds), New York: Academic Press
    • Sheatsley P. (1983). Questionnaire construction and item writing. In: P Rossie, J Wright, A Anderson (eds) Handbook of Survey Research. New York: Academic Press.
    • (1983) Handbook of Survey Research
    • Sheatsley, P.1
  • 129
    • 0001750056 scopus 로고
    • The Effect of Interviewer Characteristics and Expectations on Response
    • Singer, E, Frankel MR, Glassman, MB. (1983). The Effect of Interviewer Characteristics and Expectations on Response. Public Opinion Quarterly, 47(1), 68-83.
    • (1983) Public Opinion Quarterly , vol.47 , Issue.1 , pp. 68-83
    • Singer, E.1    Frankel, M.R.2    Glassman, M.B.3
  • 130
    • 84892854114 scopus 로고    scopus 로고
    • Validating assessments: introduction to the special section
    • Sireci S, Padilla JL. (2014). Validating assessments: introduction to the special section. Psicothema, 26, 97-99.
    • (2014) Psicothema , vol.26 , pp. 97-99
    • Sireci, S.1    Padilla, J.L.2
  • 131
    • 79960457246 scopus 로고    scopus 로고
    • How to conduct a mixed methods study: recent trends in a rapidly growing literature
    • Small ML. (2011). How to conduct a mixed methods study: recent trends in a rapidly growing literature. Annual Review of Sociology, 37, 57-86.
    • (2011) Annual Review of Sociology , vol.37 , pp. 57-86
    • Small, M.L.1
  • 132
    • 0017977434 scopus 로고
    • The Family APGAR: a proposal for family function test and its use by physicians
    • Smilkstein G. (1978). The Family APGAR: a proposal for family function test and its use by physicians. Journal of Family Practice, 6, 1231-1239.
    • (1978) Journal of Family Practice , vol.6 , pp. 1231-1239
    • Smilkstein, G.1
  • 133
    • 2942604788 scopus 로고
    • Little things matter: a sampler of how differences in questionnaire format can affect survey response
    • accessed April 17, 2014
    • Smith T. (1995). Little things matter: a sampler of how differences in questionnaire format can affect survey response. http://www.amstat.org/sections/srms/Proceedings/papers/1995_182.pdf (accessed April 17, 2014).
    • (1995)
    • Smith, T.1
  • 134
    • 59949100453 scopus 로고    scopus 로고
    • [National Health Survey in Spain 2006]. Madrid, Spain: Ministerio de Sanidad y Consumo
    • Spanish Ministry of Health and Consume. (2006). Encuesta Nacional de Salud de España 2006 [National Health Survey in Spain 2006]. Madrid, Spain: Ministerio de Sanidad y Consumo.
    • (2006) Encuesta Nacional de Salud de España 2006
  • 136
    • 0000855021 scopus 로고
    • Applied sampling
    • P Rossi, J Wright, A Anderson (eds), San Diego, CA: Academic Press
    • Sudman S. (1983). Applied sampling. In: P Rossi, J Wright, A Anderson (eds) Handbook of Survey Research. San Diego, CA: Academic Press.
    • (1983) Handbook of Survey Research
    • Sudman, S.1
  • 139
    • 84862168981 scopus 로고    scopus 로고
    • Guidelines for Best Practice in Cross-Cultural Surveys
    • Ann Arbor, MI: Survey Research Center, Institute for Social Research, University of Michigan, Retrieved August, 20, 2013, from
    • Survey Research Center. (2010). Guidelines for Best Practice in Cross-Cultural Surveys. Ann Arbor, MI: Survey Research Center, Institute for Social Research, University of Michigan. Retrieved August, 20, 2013, from http://www.ccsg.isr.umich.edu/.
    • (2010)
  • 141
    • 84990321371 scopus 로고    scopus 로고
    • Exploring the nature of research questions in mixed methods research
    • Tashakkori A, Creswell JW. (2007). Exploring the nature of research questions in mixed methods research. Journal of Mixed Methods Research, 1, 207-211.
    • (2007) Journal of Mixed Methods Research , vol.1 , pp. 207-211
    • Tashakkori, A.1    Creswell, J.W.2
  • 143
    • 0002746855 scopus 로고
    • Cognitive sciences and survey methods
    • T Jabine, M Straf, J Tanur, R Tourangeau (eds), Washington, DC: National Academy Press
    • Tourangeau R. (1984). Cognitive sciences and survey methods. In: T Jabine, M Straf, J Tanur, R Tourangeau (eds) Cognitive Aspects of Survey Methodology: Building a Bridge Between Disciplines, Washington, DC: National Academy Press. pp. 73-100.
    • (1984) Cognitive Aspects of Survey Methodology: Building a Bridge Between Disciplines , pp. 73-100
    • Tourangeau, R.1
  • 145
    • 84996156283 scopus 로고    scopus 로고
    • Methodological issues surrounding the application of cognitive psychology in survey research
    • June
    • Tucker C. (1997). Methodological issues surrounding the application of cognitive psychology in survey research. Bulletin de Methodologie Sociologique, 55 (June), 67-92.
    • (1997) Bulletin de Methodologie Sociologique , vol.55 , pp. 67-92
    • Tucker, C.1
  • 151
    • 0001949836 scopus 로고
    • Translating, working through interpreters, and the problem of decentering
    • R Naroll, R Cohen (eds), New York: American Museum of Natural History
    • Werner O, Campbell D. (1970). Translating, working through interpreters, and the problem of decentering. In: R Naroll, R Cohen (eds) Handbook of Cultural Anthropology. New York: American Museum of Natural History.
    • (1970) Handbook of Cultural Anthropology
    • Werner, O.1    Campbell, D.2
  • 153
    • 84926428802 scopus 로고    scopus 로고
    • European Social Survey Round 6 Cognitive Pretesting Report. London: Centre for Comparative Social Surveys
    • accessed April 17, 2014
    • Widdop S, Fitzgerald R, Gatrell L. (2011). European Social Survey Round 6 Cognitive Pretesting Report. London: Centre for Comparative Social Surveys. http://wwwn.cdc.gov/QBANK/report%5CESS_2011_Round%206%20Cognitive%20Interview%20Pretesting.pdf (accessed April 17, 2014).
    • (2011)
    • Widdop, S.1    Fitzgerald, R.2    Gatrell, L.3
  • 154
    • 0006971327 scopus 로고
    • Cognitive interviewing and questionnaire design: a training manual
    • Hyattsville, MD: Centers for Disease Control and Prevention, National Center for Health Statistics
    • Willis G. (1994). Cognitive interviewing and questionnaire design: a training manual. Cognitive Methods Staff Working Paper No.7. Hyattsville, MD: Centers for Disease Control and Prevention, National Center for Health Statistics.
    • (1994) Cognitive Methods Staff Working Paper No.7
    • Willis, G.1
  • 155
    • 33750366218 scopus 로고    scopus 로고
    • Cognitive interviewing revisited: a useful technique in theory?
    • S Presser, J Rothgeb, M Couper, J Lessler, E Martin, J Martin, E Singer (eds), New York: John Wiley & Sons
    • Willis G. (2004). Cognitive interviewing revisited: a useful technique in theory? In: S Presser, J Rothgeb, M Couper, J Lessler, E Martin, J Martin, E Singer (eds) Methods for Testing and Evaluating Survey Questionnaires. New York: John Wiley & Sons.
    • (2004) Methods for Testing and Evaluating Survey Questionnaires
    • Willis, G.1
  • 157
    • 84555189338 scopus 로고    scopus 로고
    • Cross-cultural cognitive interviewing: seeking comparability and enhancing understanding
    • Willis G, Miller K. (2011). Cross-cultural cognitive interviewing: seeking comparability and enhancing understanding. Field Methods, 23(4), 331-341.
    • (2011) Field Methods , vol.23 , Issue.4 , pp. 331-341
    • Willis, G.1    Miller, K.2
  • 163
    • 84906827790 scopus 로고    scopus 로고
    • Reporting case studies: how and what to compose
    • 4th edition. Thousand Oaks, CA: Sage Publications
    • Yin RK. (2009). Reporting case studies: how and what to compose. In: Case Study Research: Design and Methods, 4th edition. Thousand Oaks, CA: Sage Publications. pp. 165-192.
    • (2009) Case Study Research: Design and Methods , pp. 165-192
    • Yin, R.K.1
  • 165
    • 0002994297 scopus 로고
    • Practical questions in the use of DIF statistics in test development
    • PW Holland, H Wainer (eds), Hillsdale, NJ: Lawrence Erlbaum
    • Zieky M. (1993). Practical questions in the use of DIF statistics in test development. In: PW Holland, H Wainer (eds) Differential Item Functioning. Hillsdale, NJ: Lawrence Erlbaum. pp. 337-347.
    • (1993) Differential Item Functioning , pp. 337-347
    • Zieky, M.1
  • 166
    • 78649881740 scopus 로고    scopus 로고
    • Validity as contextualized and pragmatic explanation, and its implications for validation practice
    • RW Lissitz (ed), Charlotte, NC: Information Age
    • Zumbo BD. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In: RW Lissitz (ed) The Concept of Validity: Revisions, New Directions and Applications. Charlotte, NC: Information Age. pp. 65-82.
    • (2009) The Concept of Validity: Revisions, New Directions and Applications , pp. 65-82
    • Zumbo, B.D.1


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.