메뉴 건너뛰기




Volumn 32, Issue 6, 2011, Pages 2134-2147

Beyond matching on the mean in developmental disabilities research

Author keywords

Boxplot; Delta plot; Developmental disabilities; Differential item functioning; Homogeneity of variance; Kurtosis; Matching design; Skewness

Indexed keywords

DEVELOPMENTAL DISORDER; HUMAN; INTELLIGENCE QUOTIENT; MEDICAL RESEARCH; METHODOLOGY; POST HOC ANALYSIS; REVIEW; SAMPLE SIZE; SCORING SYSTEM; STATISTICAL ANALYSIS; STATISTICAL DISTRIBUTION;

EID: 80053630936     PISSN: 08914222     EISSN: 18733379     Source Type: Journal    
DOI: 10.1016/j.ridd.2011.07.029     Document Type: Review
Times cited : (23)

References (147)
  • 1
    • 33846955496 scopus 로고    scopus 로고
    • Language development in Down syndrome and Fragile X syndrome: Current research and implications for theory and practice
    • John Benjamins Publishing Company, Amsterdam, NL
    • Abbeduto L., Chapman R.S. Language development in Down syndrome and Fragile X syndrome: Current research and implications for theory and practice. Trends in language acquisition research: Developmental theory and language disorders 2005, Vol. 4:44-72. John Benjamins Publishing Company, Amsterdam, NL.
    • (2005) Trends in language acquisition research: Developmental theory and language disorders , vol.4 , pp. 44-72
    • Abbeduto, L.1    Chapman, R.S.2
  • 2
  • 3
    • 0003505498 scopus 로고    scopus 로고
    • American Psychological Association, Washington, DC, American Psychological Association
    • American Psychological Association Publication manual of the American Psychological Association 2001, American Psychological Association, Washington, DC. 5th ed.
    • (2001) Publication manual of the American Psychological Association
  • 4
    • 70349523245 scopus 로고    scopus 로고
    • American Psychological Association, Washington, DC, American Psychological Association
    • American Psychological Association Publication manual of the American Psychological Association 2010, American Psychological Association, Washington, DC. 6th ed.
    • (2010) Publication manual of the American Psychological Association
  • 5
    • 0001786673 scopus 로고
    • Use of difficulty and discrimination indices for detecting item bias
    • Johns Hopkins University Press, Baltimore, MD, R.A. Berk (Ed.)
    • Angoff W.H. Use of difficulty and discrimination indices for detecting item bias. Handbook of methods for detecting test bias 1982, 96-116. Johns Hopkins University Press, Baltimore, MD. R.A. Berk (Ed.).
    • (1982) Handbook of methods for detecting test bias , pp. 96-116
    • Angoff, W.H.1
  • 6
    • 0002635020 scopus 로고
    • Perspectives on differential item functioning methodology
    • Laurence Erlbaum Associates, Hillsdale, NJ, P.W. Holland, H. Wainer (Eds.)
    • Angoff W.H. Perspectives on differential item functioning methodology. Differential item functioning 1993, 3-24. Laurence Erlbaum Associates, Hillsdale, NJ. P.W. Holland, H. Wainer (Eds.).
    • (1993) Differential item functioning , pp. 3-24
    • Angoff, W.H.1
  • 7
  • 8
    • 61349149897 scopus 로고    scopus 로고
    • A cross-syndrome study of the development of holistic face recognition in children with autism, Down syndrome, and Williams syndrome
    • Annaz D., Karmiloff-Smith A., Johnson M.H., Thomas M.S.C. A cross-syndrome study of the development of holistic face recognition in children with autism, Down syndrome, and Williams syndrome. Journal of Experimental Child Psychology 2009, 102:456-486.
    • (2009) Journal of Experimental Child Psychology , vol.102 , pp. 456-486
    • Annaz, D.1    Karmiloff-Smith, A.2    Johnson, M.H.3    Thomas, M.S.C.4
  • 9
    • 84865126591 scopus 로고
    • A Comparison of IRT, delta plot, and Mantel-Haenszel techniques for detecting differential item functioning across subpopulations in the Maryland Test of Citizenship Skills. Paper presented at the annual meeting of the American Educational Research Association
    • San Francisco, CA, March 27-31 (Eric database, Report: ED324364).
    • Baghi, H. & Ferrara, S. F. (1989). A Comparison of IRT, delta plot, and Mantel-Haenszel techniques for detecting differential item functioning across subpopulations in the Maryland Test of Citizenship Skills. Paper presented at the annual meeting of the American Educational Research Association. San Francisco, CA, March 27-31 (Eric database, Report: ED324364).
    • (1989)
    • Baghi, H.1    Ferrara, S.F.2
  • 10
    • 33845632895 scopus 로고    scopus 로고
    • Best practices in quantitative methods for developmentalists: VII. The practical importance of findings
    • Bakeman R. Best practices in quantitative methods for developmentalists: VII. The practical importance of findings. Monographs of the Society for Research in Child Development 2006, 71:127-145.
    • (2006) Monographs of the Society for Research in Child Development , vol.71 , pp. 127-145
    • Bakeman, R.1
  • 11
    • 35148818818 scopus 로고    scopus 로고
    • A comparative study of the use and understanding of self-presentational display rules in children with high functioning autism and Asperger's disorder
    • Barbaro J., Dissanayake C. A comparative study of the use and understanding of self-presentational display rules in children with high functioning autism and Asperger's disorder. Journal of Autism and Developmental Disorders 2007, 37:1235-1246.
    • (2007) Journal of Autism and Developmental Disorders , vol.37 , pp. 1235-1246
    • Barbaro, J.1    Dissanayake, C.2
  • 12
    • 26844494535 scopus 로고
    • Problems in comparative studies of mental retardates and normals
    • Baumeister A.A. Problems in comparative studies of mental retardates and normals. American Journal of Mental Deficiency 1967, 71:869-875.
    • (1967) American Journal of Mental Deficiency , vol.71 , pp. 869-875
    • Baumeister, A.A.1
  • 13
    • 0034043290 scopus 로고    scopus 로고
    • I. The neurocognitive profile of Williams syndrome: A complex pattern of strengths and weaknesses
    • Bellugi U., Lichtenberger L., Jones W., Lai Z. I. The neurocognitive profile of Williams syndrome: A complex pattern of strengths and weaknesses. Journal of Cognitive Neuroscience 2000, 12:7-29.
    • (2000) Journal of Cognitive Neuroscience , vol.12 , pp. 7-29
    • Bellugi, U.1    Lichtenberger, L.2    Jones, W.3    Lai, Z.4
  • 14
    • 0009205499 scopus 로고
    • The relation of short-term memory to development and intelligence
    • Academic Press, New York, L.P. Lipsitt, H.W. Reese (Eds.)
    • Belmont J.M., Butterfield E.C. The relation of short-term memory to development and intelligence. Advances in child development and behavior 1969, 29-82. Academic Press, New York. L.P. Lipsitt, H.W. Reese (Eds.).
    • (1969) Advances in child development and behavior , pp. 29-82
    • Belmont, J.M.1    Butterfield, E.C.2
  • 15
    • 33845352767 scopus 로고    scopus 로고
    • Statistical issues in developmental epidemiology and developmental disabilities research: Confounding variables, small sample size, and numerous outcome variables
    • Blackford J.U. Statistical issues in developmental epidemiology and developmental disabilities research: Confounding variables, small sample size, and numerous outcome variables. International Review of Research in Mental Retardation 2007, 33:93-120.
    • (2007) International Review of Research in Mental Retardation , vol.33 , pp. 93-120
    • Blackford, J.U.1
  • 16
    • 74249105261 scopus 로고    scopus 로고
    • Propensity scores: Method for matching on multiple variables in Down syndrome research
    • Blackford J.U. Propensity scores: Method for matching on multiple variables in Down syndrome research. Intellectual and Developmental Disabilities 2009, 47:348-357.
    • (2009) Intellectual and Developmental Disabilities , vol.47 , pp. 348-357
    • Blackford, J.U.1
  • 17
    • 42449142388 scopus 로고    scopus 로고
    • Accommodating students with disabilities in large-scale testing: A comparison of differential item functioning (DIF) identified across disability types
    • Bolt S., Ysseldyke J. Accommodating students with disabilities in large-scale testing: A comparison of differential item functioning (DIF) identified across disability types. Journal of Psychoeducational Assessment 2008, 26:121-138.
    • (2008) Journal of Psychoeducational Assessment , vol.26 , pp. 121-138
    • Bolt, S.1    Ysseldyke, J.2
  • 18
    • 34548095125 scopus 로고    scopus 로고
    • Do children with Williams syndrome really have good vocabulary knowledge? Methods for comparing cognitive and linguistic abilities in developmental disorders
    • Brock J., Jarrold C., Farran E.K., Laws G., Riby D.M. Do children with Williams syndrome really have good vocabulary knowledge? Methods for comparing cognitive and linguistic abilities in developmental disorders. Journal of Clinical Linguistics and Phonetics 2007, 21:273-688.
    • (2007) Journal of Clinical Linguistics and Phonetics , vol.21 , pp. 273-688
    • Brock, J.1    Jarrold, C.2    Farran, E.K.3    Laws, G.4    Riby, D.M.5
  • 20
    • 0009115708 scopus 로고
    • Comparative studies of item biased items
    • The Johns Hopkins University Press, Baltimore, MD, R.A. Berk (Ed.)
    • Burrill L.E. Comparative studies of item biased items. Handbook of methods for detecting test bias 1982, 161-179. The Johns Hopkins University Press, Baltimore, MD. R.A. Berk (Ed.).
    • (1982) Handbook of methods for detecting test bias , pp. 161-179
    • Burrill, L.E.1
  • 23
    • 21844485644 scopus 로고
    • On methodology in the study of cognitive abilities
    • Carroll J.B. On methodology in the study of cognitive abilities. Multivariate Behavioral Research 1995, 30:429-452.
    • (1995) Multivariate Behavioral Research , vol.30 , pp. 429-452
    • Carroll, J.B.1
  • 24
    • 43849086038 scopus 로고    scopus 로고
    • The three-stratum theory of cognitive Abilities
    • Guilford Press, New York, D.P. Flanagan, P.L. Harrison (Eds.)
    • Carroll J.B. The three-stratum theory of cognitive Abilities. Contemporary intellectual assessment: Theories, tests, and issues 2005, 69-76. Guilford Press, New York. D.P. Flanagan, P.L. Harrison (Eds.).
    • (2005) Contemporary intellectual assessment: Theories, tests, and issues , pp. 69-76
    • Carroll, J.B.1
  • 26
    • 0015759078 scopus 로고
    • Problems in the measurement of cognitive deficit
    • Chapman L.J., Chapman J.P. Problems in the measurement of cognitive deficit. Psychological Bulletin 1973, 79:380-385.
    • (1973) Psychological Bulletin , vol.79 , pp. 380-385
    • Chapman, L.J.1    Chapman, J.P.2
  • 27
    • 0642292334 scopus 로고
    • Methodological problems in the study of differential deficits in retarded groups
    • Ablex Publishing Corporation, Norwood, NJ, D.K. Detterman (Ed.)
    • Chapman L.J., Chapman J.P. Methodological problems in the study of differential deficits in retarded groups. Current topics in human intelligence: Vol. 1. Research methodology 1985, 141-153. Ablex Publishing Corporation, Norwood, NJ. D.K. Detterman (Ed.).
    • (1985) Current topics in human intelligence: Vol. 1. Research methodology , pp. 141-153
    • Chapman, L.J.1    Chapman, J.P.2
  • 29
    • 0039802908 scopus 로고
    • The earth is round (p<.05)
    • Cohen J. The earth is round (p<.05). American Psychologist 1994, 49:997-1003.
    • (1994) American Psychologist , vol.49 , pp. 997-1003
    • Cohen, J.1
  • 31
    • 34147138912 scopus 로고    scopus 로고
    • Do children with autism have a theory of mind? A non-verbal test of autism vs. specific language impairment
    • Colle L., Baron-Cohen S., Hill J. Do children with autism have a theory of mind? A non-verbal test of autism vs. specific language impairment. Journal of Autism and Developmental Disorders 2007, 37:716-723.
    • (2007) Journal of Autism and Developmental Disorders , vol.37 , pp. 716-723
    • Colle, L.1    Baron-Cohen, S.2    Hill, J.3
  • 32
    • 0001109141 scopus 로고
    • The two disciplines of scientific psychology
    • Cronbach L.J. The two disciplines of scientific psychology. The American Psychologist 1957, 12:671-684.
    • (1957) The American Psychologist , vol.12 , pp. 671-684
    • Cronbach, L.J.1
  • 33
    • 76549241080 scopus 로고
    • The use of intelligence tests with children of retarded mental development: II. Clinical considerations
    • Cruickshank W.M., Qualtere T.J. The use of intelligence tests with children of retarded mental development: II. Clinical considerations. American Journal of Mental Deficiency 1950, 54:370-381.
    • (1950) American Journal of Mental Deficiency , vol.54 , pp. 370-381
    • Cruickshank, W.M.1    Qualtere, T.J.2
  • 34
    • 0001521368 scopus 로고    scopus 로고
    • On the meaning and use of kurtosis
    • DeCarlo L.T. On the meaning and use of kurtosis. Psychological Methods 1997, 2:292-307.
    • (1997) Psychological Methods , vol.2 , pp. 292-307
    • DeCarlo, L.T.1
  • 35
    • 35348934184 scopus 로고    scopus 로고
    • The contribution of memory to the behavioural phenotype of Down syndrome
    • John Wiley & Sons, Chichester, UK, J.-A. Rondal, J. Perera (Eds.)
    • Devenny D.A. The contribution of memory to the behavioural phenotype of Down syndrome. Down syndrome: Neurobehavioural specificity 2006, 85-100. John Wiley & Sons, Chichester, UK. J.-A. Rondal, J. Perera (Eds.).
    • (2006) Down syndrome: Neurobehavioural specificity , pp. 85-100
    • Devenny, D.A.1
  • 36
    • 0001888006 scopus 로고
    • DIF detection and description: Mantel-Haenszel and standardization
    • Lawrence Erlbaum Associates, Hillsdale, NJ, P.W. Holland, H. Wainer (Eds.)
    • Dorans N.J., Holland P.W. DIF detection and description: Mantel-Haenszel and standardization. Differential item functioning 1993, 35-66. Lawrence Erlbaum Associates, Hillsdale, NJ. P.W. Holland, H. Wainer (Eds.).
    • (1993) Differential item functioning , pp. 35-66
    • Dorans, N.J.1    Holland, P.W.2
  • 38
    • 0042427641 scopus 로고    scopus 로고
    • The Williams syndrome behavioral phenotype: The "whole person" is missing
    • Dykens E.M. The Williams syndrome behavioral phenotype: The "whole person" is missing. Current Opinion in Psychiatry 2003, 16:523-528.
    • (2003) Current Opinion in Psychiatry , vol.16 , pp. 523-528
    • Dykens, E.M.1
  • 39
    • 68949141602 scopus 로고    scopus 로고
    • Using item response theory and model-data fit to conceptualize differential item and person functioning for students with disabilities
    • Engelhard G. Using item response theory and model-data fit to conceptualize differential item and person functioning for students with disabilities. Educational and Psychological Measurement 2009, 69:585-602.
    • (2009) Educational and Psychological Measurement , vol.69 , pp. 585-602
    • Engelhard, G.1
  • 40
    • 70449535772 scopus 로고    scopus 로고
    • An item analysis of Raven's Colored Progressive Matrices among participants with Down syndrome
    • Facon B., Nuchadee M. An item analysis of Raven's Colored Progressive Matrices among participants with Down syndrome. Research in Developmental Disabilities 2010, 31:243-249.
    • (2010) Research in Developmental Disabilities , vol.31 , pp. 243-249
    • Facon, B.1    Nuchadee, M.2
  • 41
    • 0027216678 scopus 로고
    • Overestimation of mentally retarded persons' IQs using the PPVT: A re-analysis and some implications for future research
    • Facon B., Bollengier T., Grubar J. Overestimation of mentally retarded persons' IQs using the PPVT: A re-analysis and some implications for future research. Journal of Intellectual Disability Research 1993, 37:373-379.
    • (1993) Journal of Intellectual Disability Research , vol.37 , pp. 373-379
    • Facon, B.1    Bollengier, T.2    Grubar, J.3
  • 42
    • 80052022074 scopus 로고    scopus 로고
    • Do Raven's Colored Progressive Matrices function in the same way in typical and clinical populations? Insight from the intellectual disability field
    • Intelligence, in press. doi:10.1016/j.intell.2011.04.002
    • Facon, B., Magis, D., Nuchadee, M.-L., & De Boeck, P. Do Raven's Colored Progressive Matrices function in the same way in typical and clinical populations? Insight from the intellectual disability field. Intelligence, in press. doi:10.1016/j.intell.2011.04.002.
    • Facon, B.1    Magis, D.2    Nuchadee, M.-L.3    De Boeck, P.4
  • 45
    • 0028855801 scopus 로고
    • Accepting the null hypothesis
    • Frick R.W. Accepting the null hypothesis. Memory & Cognition 1995, 132(23):138.
    • (1995) Memory & Cognition , vol.132 , Issue.23 , pp. 138
    • Frick, R.W.1
  • 47
    • 0035995698 scopus 로고    scopus 로고
    • Let's practice what we preach: Turning tables into graphs
    • Gelman A., Pasarica C., Dodhia R. Let's practice what we preach: Turning tables into graphs. The American Statistician 2002, 56:121-130.
    • (2002) The American Statistician , vol.56 , pp. 121-130
    • Gelman, A.1    Pasarica, C.2    Dodhia, R.3
  • 49
    • 0041189820 scopus 로고
    • The measurement of mental growth in childhood
    • John Wiley & Sons, New York, L. Carmichael (Ed.)
    • Goodenough F.L. The measurement of mental growth in childhood. Manual of child psychology 1954, 459-491. John Wiley & Sons, New York. L. Carmichael (Ed.).
    • (1954) Manual of child psychology , pp. 459-491
    • Goodenough, F.L.1
  • 50
    • 34147185472 scopus 로고
    • Kolmogorov-Smirnov tests for psychological research
    • Goodman L. Kolmogorov-Smirnov tests for psychological research. Psychological Bulletin 1954, 51:160-168.
    • (1954) Psychological Bulletin , vol.51 , pp. 160-168
    • Goodman, L.1
  • 51
    • 2942715036 scopus 로고    scopus 로고
    • Raven's matrices performance in Down syndrome: Evidence of unusual errors
    • Gunn D., Jarrold C. Raven's matrices performance in Down syndrome: Evidence of unusual errors. Research in Developmental Disabilities 2004, 25:443-457.
    • (2004) Research in Developmental Disabilities , vol.25 , pp. 443-457
    • Gunn, D.1    Jarrold, C.2
  • 52
    • 59649118435 scopus 로고    scopus 로고
    • Genetic influences on sociability: Heightened amygdala reactivity and event-related responses to positive social stimuli in Williams syndrome
    • Haas B.W., Mills D., Yam A., Hoeft F., Bellugi U., Reiss A. Genetic influences on sociability: Heightened amygdala reactivity and event-related responses to positive social stimuli in Williams syndrome. Journal of Neuroscience 2009, 29:1132-1139.
    • (2009) Journal of Neuroscience , vol.29 , pp. 1132-1139
    • Haas, B.W.1    Mills, D.2    Yam, A.3    Hoeft, F.4    Bellugi, U.5    Reiss, A.6
  • 55
    • 84894454320 scopus 로고    scopus 로고
    • A solution to limitations of cognitive testing in children with intellectual disabilities: The case of fragile X syndrome
    • Hessl D., Nguyen D., Green C., Chavez A., Tassone F., Hagerman R.J., et al. A solution to limitations of cognitive testing in children with intellectual disabilities: The case of fragile X syndrome. Journal of Neurodevelopmental Disorders 2009, 1:33-45.
    • (2009) Journal of Neurodevelopmental Disorders , vol.1 , pp. 33-45
    • Hessl, D.1    Nguyen, D.2    Green, C.3    Chavez, A.4    Tassone, F.5    Hagerman, R.J.6
  • 56
    • 70449521030 scopus 로고    scopus 로고
    • Behavioral effects of genetic mental retardation disorders
    • Springer Publishing Company, New York, J. Rojahn, J.W. Jacobson, J.A. Mulick (Eds.)
    • Hodapp R.M., Dykens E.M. Behavioral effects of genetic mental retardation disorders. Handbook of intellectual and developmental disabilities 2007, 115-131. Springer Publishing Company, New York. J. Rojahn, J.W. Jacobson, J.A. Mulick (Eds.).
    • (2007) Handbook of intellectual and developmental disabilities , pp. 115-131
    • Hodapp, R.M.1    Dykens, E.M.2
  • 57
    • 0041425151 scopus 로고    scopus 로고
    • Advances in educational strategies for children with Down syndrome
    • Hodapp R.M., Freeman S.F.N. Advances in educational strategies for children with Down syndrome. Current Opinion in Psychiatry 2003, 16:511-516.
    • (2003) Current Opinion in Psychiatry , vol.16 , pp. 511-516
    • Hodapp, R.M.1    Freeman, S.F.N.2
  • 58
    • 0037389809 scopus 로고    scopus 로고
    • Genetic syndromes of mental retardation: Should they matter for the early interventionist?
    • Hodapp R.M., DesJardin J.L., Ricci L.A. Genetic syndromes of mental retardation: Should they matter for the early interventionist?. Infants and Young Children 2003, 16:152-160.
    • (2003) Infants and Young Children , vol.16 , pp. 152-160
    • Hodapp, R.M.1    DesJardin, J.L.2    Ricci, L.A.3
  • 59
    • 0344829695 scopus 로고
    • Tests for normality and measures of skewness and kurtosis: Their place in research reporting
    • Hopkins K., Weeks D. Tests for normality and measures of skewness and kurtosis: Their place in research reporting. Educational and Psychological Measurement 1990, 50:717-729.
    • (1990) Educational and Psychological Measurement , vol.50 , pp. 717-729
    • Hopkins, K.1    Weeks, D.2
  • 61
    • 1842730980 scopus 로고    scopus 로고
    • To match or not to match? Methodological issues in autism-related research
    • Jarrold C., Brock J. To match or not to match? Methodological issues in autism-related research. Journal of Autism and Developmental Disorders 2004, 34:81-86.
    • (2004) Journal of Autism and Developmental Disorders , vol.34 , pp. 81-86
    • Jarrold, C.1    Brock, J.2
  • 64
    • 34548065478 scopus 로고    scopus 로고
    • Patterns of syntactic development in children with Williams syndrome and Down's syndrome: Evidence from passives and wh-questions
    • Joffe V., Varlokosta S. Patterns of syntactic development in children with Williams syndrome and Down's syndrome: Evidence from passives and wh-questions. Clinical Linguistics & Phonetics 2007, 21:705-727.
    • (2007) Clinical Linguistics & Phonetics , vol.21 , pp. 705-727
    • Joffe, V.1    Varlokosta, S.2
  • 66
    • 70849135366 scopus 로고    scopus 로고
    • Beanplot: A boxplot alternative for visual comparison of distributions
    • Kampstra P. Beanplot: A boxplot alternative for visual comparison of distributions. Journal of Statistical Software 2008, 28:1-9.
    • (2008) Journal of Statistical Software , vol.28 , pp. 1-9
    • Kampstra, P.1
  • 67
    • 0037253503 scopus 로고    scopus 로고
    • Dethroning the myth: Cognitive dissociations and innate modularity in Williams syndrome
    • Karmiloff-Smith A., Brown J.H., Grice S., Paterson S. Dethroning the myth: Cognitive dissociations and innate modularity in Williams syndrome. Developmental Neuropsychology 2003, 23:229-244.
    • (2003) Developmental Neuropsychology , vol.23 , pp. 229-244
    • Karmiloff-Smith, A.1    Brown, J.H.2    Grice, S.3    Paterson, S.4
  • 68
    • 70249147298 scopus 로고    scopus 로고
    • Designing better graphs by including distributional information and integrating words, numbers, and images
    • Lane D., Sándor A. Designing better graphs by including distributional information and integrating words, numbers, and images. Psychological Methods 2009, 14:239-257.
    • (2009) Psychological Methods , vol.14 , pp. 239-257
    • Lane, D.1    Sándor, A.2
  • 70
    • 73849141236 scopus 로고    scopus 로고
    • Gene, brain, and behavior relationships in fragile X syndrome: Evidence from neuroimaging studies
    • Lightbody A., Reiss A. Gene, brain, and behavior relationships in fragile X syndrome: Evidence from neuroimaging studies. Developmental Disabilities Research Reviews 2009, 15:343-352.
    • (2009) Developmental Disabilities Research Reviews , vol.15 , pp. 343-352
    • Lightbody, A.1    Reiss, A.2
  • 71
    • 0030299532 scopus 로고    scopus 로고
    • Psychology will be a much better science when we change the way we analyze data
    • Loftus G.R. Psychology will be a much better science when we change the way we analyze data. Current Directions in Psychological Science 1996, 5:161-171.
    • (1996) Current Directions in Psychological Science , vol.5 , pp. 161-171
    • Loftus, G.R.1
  • 72
    • 72149132571 scopus 로고    scopus 로고
    • Word learning in children with autism spectrum disorders
    • Luyster R., Lord C. Word learning in children with autism spectrum disorders. Developmental Psychology 2009, 45:1774-1786.
    • (2009) Developmental Psychology , vol.45 , pp. 1774-1786
    • Luyster, R.1    Lord, C.2
  • 73
    • 77957723379 scopus 로고    scopus 로고
    • A general framework and an R package for the detection of dichotomous differential item functioning
    • Magis D., Béland S., Tuerlinckx F., De Boeck P. A general framework and an R package for the detection of dichotomous differential item functioning. Behavior Research Methods 2010, 42:847-862.
    • (2010) Behavior Research Methods , vol.42 , pp. 847-862
    • Magis, D.1    Béland, S.2    Tuerlinckx, F.3    De Boeck, P.4
  • 74
    • 80053646587 scopus 로고    scopus 로고
    • Angoff's method revisited: Improving the DIF detection under small samples
    • in press. doi:10.1111/j.2044-8317.2011.02025.x
    • Magis, D. & Facon, B. Angoff's method revisited: Improving the DIF detection under small samples. British Journal of Mathematical and Statistical Psychology, in press. doi:10.1111/j.2044-8317.2011.02025.x.
    • British Journal of Mathematical and Statistical Psychology
    • Magis, D.1    Facon, B.2
  • 75
    • 63449089726 scopus 로고    scopus 로고
    • Serial order short-term memory capacities and specific language impairment: No evidence for a causal association
    • Majerus S., Leclercq A.-L., Grossmann A., Billard C., Van der Linden M., Poncelet M. Serial order short-term memory capacities and specific language impairment: No evidence for a causal association. Cortex 2009, 4:708-720.
    • (2009) Cortex , vol.4 , pp. 708-720
    • Majerus, S.1    Leclercq, A.-L.2    Grossmann, A.3    Billard, C.4    Van der Linden, M.5    Poncelet, M.6
  • 76
    • 34548275888 scopus 로고    scopus 로고
    • How skewed are psychological data? A standardized index of effect size
    • Malgady R.G. How skewed are psychological data? A standardized index of effect size. Journal of General Psychology 2007, 134:355-359.
    • (2007) Journal of General Psychology , vol.134 , pp. 355-359
    • Malgady, R.G.1
  • 78
    • 0008496321 scopus 로고
    • A method of clinical evaluation of the responses to the Stanford-Binet intelligence test
    • Martinson B., Strauss A.A. A method of clinical evaluation of the responses to the Stanford-Binet intelligence test. American Journal of Mental Deficiency 1941, 46:48-59.
    • (1941) American Journal of Mental Deficiency , vol.46 , pp. 48-59
    • Martinson, B.1    Strauss, A.A.2
  • 79
    • 0032328739 scopus 로고    scopus 로고
    • Multidimensional DIF analyses: The effects of matching on unidimensional subtest scores
    • Mazor K.M., Hambleton R.K., Clauser B.E. Multidimensional DIF analyses: The effects of matching on unidimensional subtest scores. Applied Psychological Measurement 1998, 22:357-367.
    • (1998) Applied Psychological Measurement , vol.22 , pp. 357-367
    • Mazor, K.M.1    Hambleton, R.K.2    Clauser, B.E.3
  • 82
    • 48749128243 scopus 로고    scopus 로고
    • Vocabulary abilities of children with Williams syndrome: Strengths, weaknesses, and relation to visuospatial construction ability
    • Mervis C.B., John A.E. Vocabulary abilities of children with Williams syndrome: Strengths, weaknesses, and relation to visuospatial construction ability. Journal of Speech, Language, and Hearing Research 2008, 51:967-982.
    • (2008) Journal of Speech, Language, and Hearing Research , vol.51 , pp. 967-982
    • Mervis, C.B.1    John, A.E.2
  • 83
    • 77951537179 scopus 로고    scopus 로고
    • Cognitive and behavioral characteristics of children with Williams syndrome: Implications for intervention approaches
    • Mervis C.B, John A.E. Cognitive and behavioral characteristics of children with Williams syndrome: Implications for intervention approaches. American Journal of Medical Genetics Part C 2010, 154C:229-248.
    • (2010) American Journal of Medical Genetics Part C , vol.154 C , pp. 229-248
    • Mervis, C.B.1    John, A.E.2
  • 84
    • 1842680818 scopus 로고    scopus 로고
    • Methodological issues in group-matching designs: α-levels for control variable comparisons and measurement characteristics of control and target variables
    • Mervis C.B., Klein-Tasman B.P. Methodological issues in group-matching designs: α-levels for control variable comparisons and measurement characteristics of control and target variables. Journal of Autism and Developmental Disorders 2004, 34:7-17.
    • (2004) Journal of Autism and Developmental Disorders , vol.34 , pp. 7-17
    • Mervis, C.B.1    Klein-Tasman, B.P.2
  • 86
    • 0032603080 scopus 로고    scopus 로고
    • Methodological issues in cross-syndrome comparisons: Matching procedures, sensitivity (Se), and specificity (Sp)
    • Mervis C.B., Robinson B.F. Methodological issues in cross-syndrome comparisons: Matching procedures, sensitivity (Se), and specificity (Sp). Monographs of the Society for Research in Child Development 1999, 64:115-130.
    • (1999) Monographs of the Society for Research in Child Development , vol.64 , pp. 115-130
    • Mervis, C.B.1    Robinson, B.F.2
  • 87
    • 12444279986 scopus 로고    scopus 로고
    • Designing measures for profiling and genotype/phenotype studies of individuals with genetic syndromes or developmental language disorders
    • Mervis C.B., Robinson B.F. Designing measures for profiling and genotype/phenotype studies of individuals with genetic syndromes or developmental language disorders. Applied Psycholinguistics 2005, 26:41-64.
    • (2005) Applied Psycholinguistics , vol.26 , pp. 41-64
    • Mervis, C.B.1    Robinson, B.F.2
  • 88
    • 70449531411 scopus 로고
    • An empirical investigation of six methods for examining test item bias
    • Sacramento, CA: California State University (Eric database, Report: ED178566).
    • Merz, W. R. & Grossen, N. E. (1978). An empirical investigation of six methods for examining test item bias. Sacramento, CA: California State University (Eric database, Report: ED178566).
    • (1978)
    • Merz, W.R.1    Grossen, N.E.2
  • 89
    • 33745698871 scopus 로고    scopus 로고
    • Neural mechanisms in Williams syndrome: A unique window to genetic influences on cognition and behaviour
    • Meyer-Lindenberg A., Mervis C.B., Berman K.F. Neural mechanisms in Williams syndrome: A unique window to genetic influences on cognition and behaviour. Nature Reviews Neuroscience 2006, 7:380-393.
    • (2006) Nature Reviews Neuroscience , vol.7 , pp. 380-393
    • Meyer-Lindenberg, A.1    Mervis, C.B.2    Berman, K.F.3
  • 90
    • 1842630333 scopus 로고    scopus 로고
    • Matching strategies in cognitive research with individuals with high-functioning autism: Current practices, instrument biases, and recommendations
    • Mottron L. Matching strategies in cognitive research with individuals with high-functioning autism: Current practices, instrument biases, and recommendations. Journal of Autism and Developmental Disorders 2004, 34:19-27.
    • (2004) Journal of Autism and Developmental Disorders , vol.34 , pp. 19-27
    • Mottron, L.1
  • 93
    • 35348942175 scopus 로고    scopus 로고
    • Neuropsychological aspects of Down syndrome
    • John Wiley & Sons, Chichester, UK, J.-A. Rondal, J. Perera (Eds.)
    • Nadel L. Neuropsychological aspects of Down syndrome. Down syndrome: Neurobehavioural specificity 2006, 67-83. John Wiley & Sons, Chichester, UK. J.-A. Rondal, J. Perera (Eds.).
    • (2006) Down syndrome: Neurobehavioural specificity , pp. 67-83
    • Nadel, L.1
  • 94
    • 34347242083 scopus 로고    scopus 로고
    • Mathematical skill in individuals with Williams syndrome: Evidence from a standardized mathematics battery
    • O'Hearn K., Landau B. Mathematical skill in individuals with Williams syndrome: Evidence from a standardized mathematics battery. Brain and Cognition 2007, 64:238-246.
    • (2007) Brain and Cognition , vol.64 , pp. 238-246
    • O'Hearn, K.1    Landau, B.2
  • 95
    • 60849086173 scopus 로고    scopus 로고
    • Working memory impairment in people with Williams syndrome: Effects of delay, task and stimuli
    • O'Hearn K., Courtney S., Street W., Landau B. Working memory impairment in people with Williams syndrome: Effects of delay, task and stimuli. Brain and Cognition 2009, 69:495-503.
    • (2009) Brain and Cognition , vol.69 , pp. 495-503
    • O'Hearn, K.1    Courtney, S.2    Street, W.3    Landau, B.4
  • 96
    • 0004066135 scopus 로고
    • Test item bias. Sage university paper series on quantitative applications in the social sciences, no 30. Newbury Park, CA: Sage Publications
    • Osterlind, S. J. (1983). Test item bias. Sage university paper series on quantitative applications in the social sciences, no 30. Newbury Park, CA: Sage Publications.
    • (1983)
    • Osterlind, S.J.1
  • 98
    • 34548190281 scopus 로고    scopus 로고
    • Links between theory of mind and executive function in young children with autism: Clues to developmental primacy
    • Pellicano E. Links between theory of mind and executive function in young children with autism: Clues to developmental primacy. Developmental Psychology 2007, 43:974-990.
    • (2007) Developmental Psychology , vol.43 , pp. 974-990
    • Pellicano, E.1
  • 99
    • 67649394338 scopus 로고    scopus 로고
    • Differential item functioning and item bias
    • Elsevier, Amsterdam, NL, C.R. Rao, S. Sinharay (Eds.)
    • Penfield R.D., Camilli G. Differential item functioning and item bias. Handbook of statistics: Vol. 26. Psychometrics 2007, 125-167. Elsevier, Amsterdam, NL. C.R. Rao, S. Sinharay (Eds.).
    • (2007) Handbook of statistics: Vol. 26. Psychometrics , pp. 125-167
    • Penfield, R.D.1    Camilli, G.2
  • 100
    • 1642411853 scopus 로고    scopus 로고
    • Comprehension of spatial language terms in Williams syndrome: Evidence for an interaction between domains of strength and weakness
    • Phillips C.E., Jarrold C., Baddeley A.D., Grant J., Karmiloff-Smith A. Comprehension of spatial language terms in Williams syndrome: Evidence for an interaction between domains of strength and weakness. Cortex 2004, 40:85-101.
    • (2004) Cortex , vol.40 , pp. 85-101
    • Phillips, C.E.1    Jarrold, C.2    Baddeley, A.D.3    Grant, J.4    Karmiloff-Smith, A.5
  • 101
    • 0034616271 scopus 로고    scopus 로고
    • Theory of mind abilities of children with schizophrenia, children with autism, and normally developing children
    • Pilowsky T., Yirmiya N., Arbelle S., Mozes T. Theory of mind abilities of children with schizophrenia, children with autism, and normally developing children. Schizophrenia Research 2000, 42:145-155.
    • (2000) Schizophrenia Research , vol.42 , pp. 145-155
    • Pilowsky, T.1    Yirmiya, N.2    Arbelle, S.3    Mozes, T.4
  • 103
    • 63049084313 scopus 로고    scopus 로고
    • Early intervention: Background, research findings, and future directions
    • Springer Publishing Company, New York, J.W. Jacobson, J.A. Mulick, J. Rojahn (Eds.)
    • Ramey S.L., Ramey C.T., Lanzi R.G. Early intervention: Background, research findings, and future directions. Handbook of intellectual developmental disabilities 2007, 445-463. Springer Publishing Company, New York. J.W. Jacobson, J.A. Mulick, J. Rojahn (Eds.).
    • (2007) Handbook of intellectual developmental disabilities , pp. 445-463
    • Ramey, S.L.1    Ramey, C.T.2    Lanzi, R.G.3
  • 105
    • 84965400546 scopus 로고
    • The difficulty of test items that measure more than one ability
    • Reckase M.D. The difficulty of test items that measure more than one ability. Applied Psychological Measurement 1985, 9:401-412.
    • (1985) Applied Psychological Measurement , vol.9 , pp. 401-412
    • Reckase, M.D.1
  • 106
    • 84970385680 scopus 로고
    • The discriminating power of items that measure more than one dimension
    • Reckase M.D., McKinley R.L. The discriminating power of items that measure more than one dimension. Applied Psychological Measurement 1991, 15:361-373.
    • (1991) Applied Psychological Measurement , vol.15 , pp. 361-373
    • Reckase, M.D.1    McKinley, R.L.2
  • 107
    • 0031993018 scopus 로고    scopus 로고
    • Extended early childhood intervention and school achievement: Age thirteen findings from the Chicago Longitudinal Study
    • Reynolds A.J., Temple J.A. Extended early childhood intervention and school achievement: Age thirteen findings from the Chicago Longitudinal Study. Child Development 1998, 69:231-246.
    • (1998) Child Development , vol.69 , pp. 231-246
    • Reynolds, A.J.1    Temple, J.A.2
  • 108
    • 26944494846 scopus 로고    scopus 로고
    • Distinct patterns of language impairment in Down's syndrome and Williams syndrome: The case of syntactic chains
    • Ring M., Clahsen H. Distinct patterns of language impairment in Down's syndrome and Williams syndrome: The case of syntactic chains. Journal of Neurolinguistics 2005, 18:479-501.
    • (2005) Journal of Neurolinguistics , vol.18 , pp. 479-501
    • Ring, M.1    Clahsen, H.2
  • 110
    • 27144444182 scopus 로고    scopus 로고
    • Evaluating the equivalence of different language versions of a credentialing exam
    • Robin R., Sireci S.G., Hambleton R.K. Evaluating the equivalence of different language versions of a credentialing exam. International Journal of Testing 2003, 3:1-20.
    • (2003) International Journal of Testing , vol.3 , pp. 1-20
    • Robin, R.1    Sireci, S.G.2    Hambleton, R.K.3
  • 111
    • 35348961962 scopus 로고    scopus 로고
    • Specific language profiles in Down syndrome and other genetic syndromes of mental retardation
    • John Wiley & Sons, Chichester, UK, J.-A. Rondal, J. Perera (Eds.)
    • Rondal J.-A. Specific language profiles in Down syndrome and other genetic syndromes of mental retardation. Down syndrome: Neurobehavioural specificity 2006, 101-123. John Wiley & Sons, Chichester, UK. J.-A. Rondal, J. Perera (Eds.).
    • (2006) Down syndrome: Neurobehavioural specificity , pp. 101-123
    • Rondal, J.-A.1
  • 113
    • 80053639936 scopus 로고
    • An evaluation of select approaches for biased item identification. Paper presented at the annual meeting of the American Educational Research Association
    • Toronto, CAN, March 27-31 (Eric database, Report: ED157942).
    • Rudner, L. M. & Convey, J. J. (1978). An evaluation of select approaches for biased item identification. Paper presented at the annual meeting of the American Educational Research Association. Toronto, CAN, March 27-31 (Eric database, Report: ED157942).
    • (1978)
    • Rudner, L.M.1    Convey, J.J.2
  • 116
    • 0008454179 scopus 로고
    • Les caractères spécifiques du préadolescent débile à l'épreuve du Binet-Simon
    • Armand Colin, Paris, R. Zazzo (Ed.)
    • Santucci H., Hélal A. Les caractères spécifiques du préadolescent débile à l'épreuve du Binet-Simon. Les débilités mentales 1969, 288-316. Armand Colin, Paris. R. Zazzo (Ed.).
    • (1969) Les débilités mentales , pp. 288-316
    • Santucci, H.1    Hélal, A.2
  • 117
    • 0037301486 scopus 로고    scopus 로고
    • Early play behaviour in children with 5p-(Cri-du-Chat) syndrome
    • Sarimski K. Early play behaviour in children with 5p-(Cri-du-Chat) syndrome. Journal of Intellectual Disability Research 2003, 47:113-120.
    • (2003) Journal of Intellectual Disability Research , vol.47 , pp. 113-120
    • Sarimski, K.1
  • 118
    • 84973066670 scopus 로고
    • A consumer's guide to statistics for identifying differential item functioning
    • Scheuneman J.D., Bleistein C.A. A consumer's guide to statistics for identifying differential item functioning. Applied Measurement in Education 1989, 2:255-275.
    • (1989) Applied Measurement in Education , vol.2 , pp. 255-275
    • Scheuneman, J.D.1    Bleistein, C.A.2
  • 120
    • 0038026292 scopus 로고
    • The effects of the Perry Preschool Program on youths through age 15
    • Lawrence Erlbaum Associates, Hillsdale, NJ, Consortium for Longitudinal Studies (Ed.)
    • Schweinhart L.J., Weikart D.P. The effects of the Perry Preschool Program on youths through age 15. As the twig is bent...lasting effects of preschool programs 1983, 71-101. Lawrence Erlbaum Associates, Hillsdale, NJ. Consortium for Longitudinal Studies (Ed.).
    • (1983) As the twig is bent...lasting effects of preschool programs , pp. 71-101
    • Schweinhart, L.J.1    Weikart, D.P.2
  • 121
    • 21144479363 scopus 로고
    • A model-based standardization approach that separates true bias/DIF from group ability differences and detects test bias/DTF as well as item bias/DIF
    • Shealy R., Stout W. A model-based standardization approach that separates true bias/DIF from group ability differences and detects test bias/DTF as well as item bias/DIF. Psychometrika 1993, 58:159-194.
    • (1993) Psychometrika , vol.58 , pp. 159-194
    • Shealy, R.1    Stout, W.2
  • 122
    • 0000613518 scopus 로고
    • Comparison of procedures for detecting test-item bias with both internal and external ability criteria
    • Shepard L., Camilli G., Averill M. Comparison of procedures for detecting test-item bias with both internal and external ability criteria. Journal of Educational Statistics 1981, 6:317-375.
    • (1981) Journal of Educational Statistics , vol.6 , pp. 317-375
    • Shepard, L.1    Camilli, G.2    Averill, M.3
  • 124
    • 84917044599 scopus 로고    scopus 로고
    • Statistical methods for identifying flawed items in the test adaptation process
    • Lawrence Erlbaum Associates, Hillsdale, NJ, R.K. Hambleton, P.F. Merenda, C.D. Spielberger (Eds.)
    • Sireci S.G., Patsula L., Hambleton R.K. Statistical methods for identifying flawed items in the test adaptation process. Adapting educational and psychological tests for cross-cultural assessment 2005, 93-115. Lawrence Erlbaum Associates, Hillsdale, NJ. R.K. Hambleton, P.F. Merenda, C.D. Spielberger (Eds.).
    • (2005) Adapting educational and psychological tests for cross-cultural assessment , pp. 93-115
    • Sireci, S.G.1    Patsula, L.2    Hambleton, R.K.3
  • 125
    • 0001734731 scopus 로고
    • Intellectual extremes, mental age, and the nature of human intelligence
    • Spitz H.H. Intellectual extremes, mental age, and the nature of human intelligence. Merrill-Palmer Quarterly of Behavior and Development 1982, 28:167-192.
    • (1982) Merrill-Palmer Quarterly of Behavior and Development , vol.28 , pp. 167-192
    • Spitz, H.H.1
  • 126
    • 35948992125 scopus 로고    scopus 로고
    • Disability research methodology: Current issues and future challenges
    • Guilford Press, New York, S.L. Odom, R.H. Horner, M.E. Snell, J. Blacher (Eds.)
    • Stoneman Z. Disability research methodology: Current issues and future challenges. Handbook of developmental disabilities 2007, 35-54. Guilford Press, New York. S.L. Odom, R.H. Horner, M.E. Snell, J. Blacher (Eds.).
    • (2007) Handbook of developmental disabilities , pp. 35-54
    • Stoneman, Z.1
  • 127
    • 0009379221 scopus 로고
    • Empirical comparison of selected item bias detection procedures with bias manipulation
    • Subkoviak M., Mack J., Ironson G., Craig R. Empirical comparison of selected item bias detection procedures with bias manipulation. Journal of Educational Measurement 1984, 21:49-58.
    • (1984) Journal of Educational Measurement , vol.21 , pp. 49-58
    • Subkoviak, M.1    Mack, J.2    Ironson, G.3    Craig, R.4
  • 128
    • 12444303206 scopus 로고    scopus 로고
    • Designing studies to investigate the relationships between genes, environments, and developmental language disorders
    • Tager-Flusberg H. Designing studies to investigate the relationships between genes, environments, and developmental language disorders. Applied Psycholinguistics 2005, 26:29-39.
    • (2005) Applied Psycholinguistics , vol.26 , pp. 29-39
    • Tager-Flusberg, H.1
  • 134
    • 33748636900 scopus 로고    scopus 로고
    • Short-term memory deficits are not uniform in Down and Williams syndromes
    • Vicari S., Carlesimo G.A. Short-term memory deficits are not uniform in Down and Williams syndromes. Neuropsychology Review 2006, 16:87-94.
    • (2006) Neuropsychology Review , vol.16 , pp. 87-94
    • Vicari, S.1    Carlesimo, G.A.2
  • 135
    • 31144466884 scopus 로고    scopus 로고
    • Evidence from two genetic syndromes for the independence of spatial and visual working memory
    • Vicari S., Bellucci S., Carlesimo G.A. Evidence from two genetic syndromes for the independence of spatial and visual working memory. Developmental Medicine & Child Neurology 2006, 48:126-131.
    • (2006) Developmental Medicine & Child Neurology , vol.48 , pp. 126-131
    • Vicari, S.1    Bellucci, S.2    Carlesimo, G.A.3
  • 136
    • 0036411342 scopus 로고    scopus 로고
    • Language acquisition in special populations: A comparison between Down and Williams syndrome
    • Vicari S., Caselli M., Gagliardi C., Tonucci F., Volterra V. Language acquisition in special populations: A comparison between Down and Williams syndrome. Neuropsychologia 2002, 40:2461-2470.
    • (2002) Neuropsychologia , vol.40 , pp. 2461-2470
    • Vicari, S.1    Caselli, M.2    Gagliardi, C.3    Tonucci, F.4    Volterra, V.5
  • 137
    • 35948940081 scopus 로고    scopus 로고
    • Implicit memory is independent from IQ and age but not from etiology: Evidence from Down and Williams syndromes
    • Vicari S., Verucci L., Carlesimo G.A. Implicit memory is independent from IQ and age but not from etiology: Evidence from Down and Williams syndromes. Journal of Intellectual Disability Research 2007, 51:932-941.
    • (2007) Journal of Intellectual Disability Research , vol.51 , pp. 932-941
    • Vicari, S.1    Verucci, L.2    Carlesimo, G.A.3
  • 138
    • 67650323669 scopus 로고    scopus 로고
    • Implicit and explicit motor learning in children with and without Down's syndrome
    • Vinter A., Detable C. Implicit and explicit motor learning in children with and without Down's syndrome. British Journal of Developmental Psychology 2008, 26:507-523.
    • (2008) British Journal of Developmental Psychology , vol.26 , pp. 507-523
    • Vinter, A.1    Detable, C.2
  • 140
  • 143
    • 0001653457 scopus 로고    scopus 로고
    • Statistical methods in psychology journals
    • the Task Force on Statistical Inference
    • Wilkinson L., the Task Force on Statistical Inference Statistical methods in psychology journals. American Psychologist 1999, 54:594-604.
    • (1999) American Psychologist , vol.54 , pp. 594-604
    • Wilkinson, L.1
  • 144
  • 145
    • 80053645615 scopus 로고
    • Methodological issues in psychological research with retarded persons
    • Psychological Dimensions, Inc., New York, I. Bialer, M. Sternlicht (Eds.)
    • Winters J.J. Methodological issues in psychological research with retarded persons. The psychology of mental retardation: Issues and approaches 1977, 185-240. Psychological Dimensions, Inc., New York. I. Bialer, M. Sternlicht (Eds.).
    • (1977) The psychology of mental retardation: Issues and approaches , pp. 185-240
    • Winters, J.J.1
  • 147
    • 85055361086 scopus 로고    scopus 로고
    • Three generations of DIF analyses: Considering where it has been, where it is now, and where it is going
    • Zumbo B.D. Three generations of DIF analyses: Considering where it has been, where it is now, and where it is going. Language Assessment Quarterly 2007, 4:223-233.
    • (2007) Language Assessment Quarterly , vol.4 , pp. 223-233
    • Zumbo, B.D.1


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.