Integrative Data Analysis: The Simultaneous Analysis of Multiple Data Sets

Psychological Methods

Volumn 14, Issue 2, 2009, Pages 81-100

  Curran, Patrick J ^a   Hussong, Andrea M ^a  

^a University of North Carolina at Chapel Hill   (United States)

Author keywords

cumulative science; integrative data analysis; longitudinal modeling; pooled data analysis

Indexed keywords

ARTICLE; HUMAN; INFORMATION PROCESSING; META ANALYSIS; METHODOLOGY; RESEARCH; STATISTICAL ANALYSIS; STATISTICS;

DATA COLLECTION; DATA INTERPRETATION, STATISTICAL; HUMANS; META-ANALYSIS AS TOPIC; RESEARCH; RESEARCH DESIGN;

EID: 66349089005     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0015914     Document Type: Article

References (92)

1. Achenbach T., and Edelbrock C. The classification of child psychopathology: A review and analysis of empirical efforts. Psychological Bulletin 85 (1978) 1275-1301
2. American Association for the Advancement of Science, Intersociety Working Group. AAAS Report XXXIII: Research and Development FY 2009 (AAAS Publication No. 08-1A) (2008), American Association for the Advancement of Science, Washington, DC
3. American Heritage dictionary of the English language. fourth edition (2006). http://dictionary.reference.com/browse/integrate Retrieved January 29, 2009, from http://dictionary.reference.com/browse/integrate
4. American Psychological Association. Ethical principles of psychologists and code of conduct. American Psychologist 57 (2003) 1060-1073
5. Baltes P.B., Reese H.W., and Nesselroade J.R. Life-span developmental psychology: Introduction to research methods (1988), Erlbaum, Hillsdale, NJ
6. Bauer D.J., and Curran P.J. Probing interactions in fixed and multilevel regression: Inferential and graphical techniques. Multivariate Behavioral Research 40 (2005) 373-400
7. Bauer D.J., and Hussong A.M. Psychometric approaches for developing commensurate measures across independent studies: Traditional and new models. Psychological Methods 14 (2009) 101-125
8. Berlin J.A., Santanna J., Schmid C.H., Szczech L.A., and Feldman H.I. Individual patient- versus group-level data meta-regressions for the investigation of treatment effect modifiers: Ecological bias rears its ugly head. Statistics in Medicine 21 (2002) 371-387
9. Bollen K.A. Latent variables in psychology and the social sciences. Annual Review of Psychology 53 (2002) 605-634
10. Bureau of Labor Statistics, U.S. Department of Labor. National Longitudinal Survey of Youth 1979 cohort, 1979-2002 (rounds 1-20) [Data file] (2002), Center for Human Resource Research, Ohio State University, Columbus
11. Chassin L., Rogosch F., and Barrera M. Substance use and symptomatology among adolescent children of alcoholics. Journal of Abnormal Psychology 100 (1991) 449-463
12. Cochran W.G. Sampling techniques. 3rd ed. (1977), Wiley, New York
13. Cohen J. A power primer. Psychological Bulletin 112 (1992) 155-159
14. Cooper H.M., Hedges L.V., and Valentine J.C. The handbook of research synthesis and meta-analysis. 2nd ed. (2009), Russell Sage Foundation, New York
15. Cooper H.M., and Patall E.A. The relative benefits of meta-analysis conducted with individual participant data versus aggregated data. Psychological Methods 14 (2009) 165-176
16. Cudeck R., and MacCallum R.C. Factor analysis at 100: Historical developments and future directions (2007), Erlbaum, Mahwah, NJ
17. Curran P.J., Edwards M.C., Wirth R.J., Hussong A.M., and Chassin L. The incorporation of categorical measurement models in the analysis of individual growth. In: Little T., Bovaird J., and Card N. (Eds). Modeling ecological and contextual effects in longitudinal studies of human development (2007), Erlbaum, Mahwah, NJ 89-120
18. Curran P.J., Hussong A.M., Cai L., Huang W., Chassin L., Sher K.J., and Zucker R.A. Pooling data from multiple prospective studies: The role of item response theory in integrative analysis. Developmental Psychology 44 (2008) 365-380
19. Derogatis L.R., and Spencer P. Brief Symptom Inventory (BSI) (1982), Clinical Psychometric Research, Baltimore
20. DeRubeis R.J., Gelfand L.A., Tang T.Z., and Simons A.D. Medications versus cognitive behavior therapy for severely depressed outpatients: Mega-analysis of four randomized comparisons. American Journal of Psychiatry 156 (1999) 1007-1013
21. Fisher R.A. On the mathematical foundations of theoretical statistics. Philosophical Transactions of the Royal Society of London, Series A 222 (1922) 309-368
22. Flora D.B., and Curran P.J. An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods 9 (2004) 466-491
23. Flora D.B., Curran P.J., Hussong A.M., and Edwards M.C. Incorporating measurement non-equivalence in a cross-study latent growth curve analysis. Structural Equation Modeling 15 (2008) 676-704
24. Fox J.-P., and Glas C.A.W. Bayesian estimation of a multilevel IRT model using Gibbs sampling. Psychometrika 66 (2001) 271-288
25. Gans H.J. Sociological amnesia: The noncumulation of normal social science. Sociological Forum 7 (1992) 701-710
26. Glass G.V. Primary, secondary, and meta-analysis. Educational Researcher 5 (1976) 3-8
27. Grice J.W. Computing and evaluating factor scores. Psychological Methods 6 (2001) 430-450
28. Guo S., and Hussey D.L. Non-probability sampling in social work research: Dilemmas, consequences, strategies. Journal of Social Service Research 30 (2004) 1-18
29. Harford T.C. The effects of order of questions on reported alcohol consumption. Addiction 89 (1994) 421-424
30. Harris K.M., Halpern C.T., Entzel P., Tabor J., Bearman P.S., and Udry J.R. The National Longitudinal Study of Adolescent Health: Study design (2008). http://www.cpc.unc.edu/projects/addhealth/design Retrieved February 12, 2009, from http://www.cpc.unc.edu/projects/addhealth/design
31. Higgins J.P.T., Whitehead A., Turner R., Omar R.Z., and Thompson S.G. Meta-analysis of continuous outcome data from individual patients. Statistics in Medicine 20 (2001) 2219-2241
32. Hofer S.M., and Picinnin A.M. Integrative data analysis through coordination of measurement and analysis protocol across independent longitudinal studies. Psychological Methods 14 (2009) 150-164
33. Horn J.L., and McArdle J. A practical guide to measurement invariance in research on aging. Experimental Aging Research 18 (1992) 117-144
34. Hunter D.J., Spiegelman D., Adami H.O., Beeson L., van den Brandt P.A., Folsom A.R., et al. Cohort studies of fat intake and the risk of breast cancer: A pooled analysis. New England Journal of Medicine 334 (1996) 356-361
35. Hunter J.E., and Schmidt F.L. Cumulative research knowledge and social policy formulation: The critical role of meta-analysis. Psychology, Public Policy, and Law 2 (1996) 324-347
36. Hussong A.M., Bauer D.J., Huang W., Chassin L., Sher K.J., and Zucker R.A. Characterizing the life stressors of children of alcoholic parents. Journal of Family Psychology 22 (2008) 819-832
37. Hussong A.M., Cai L., Curran P.J., Flora D.B., Chassin L.A., and Zucker R.A. Disaggregating the distal, proximal, and time-varying effects of parent alcoholism on children's internalizing symptoms. Journal of Abnormal Child Psychology 36 (2008) 335-346
38. Hussong A.M., Flora D.B., Curran P.J., Chassin L.A., and Zucker R.A. Defining risk heterogeneity for internalizing symptoms among children of alcoholic parents: A prospective cross-study analysis. Development and Psychopathology 20 (2008) 165-193
39. Hussong A.M., Wirth R.J., Edwards M.C., Curran P.J., Chassin L.A., and Zucker R.A. Externalizing symptoms among children of alcoholic parents: Entry points for an antisocial pathway to alcoholism. Journal of Abnormal Psychology 116 (2007) 529-542
40. Johnston L.D., Bachman J.G., and O'Malley P.M. Monitoring the Future: Questionnaire responses from the nation's high school seniors, 2005 (2006), Institute for Social Research, Ann Arbor, MI
41. Kaplow J.B., Curran P.J., Dodge K., and the Conduct Problems Prevention Research Group. Child, parent, and peer predictors of early-onset substance use: A multi-site longitudinal study. Journal of Abnormal Child Psychology 30 (2002) 199-216
42. Kiecolt K.J., and Nathan L. Secondary analysis of survey data (1985), Sage, Thousand Oaks, CA
43. Kolen M.J., and Brennan R.L. Test equating, scaling, and linking: Methods and practices. 2nd ed. (2004), Springer, New York
44. Kreft I., and de Leeuw J. Introducing multilevel modeling (1998), Sage, London
45. Lambert P.C., Sutton A.J., Abrams K.R., and Jones D.R. A comparison of summary patient-level covariates in mega-regression with individual patient data meta-analysis. Journal of Clinical Epidemiology 55 (2002) 86-94
46. Lenhard J. Models and statistical inference: The controversy between Fisher and Neyman-Pearson. British Journal of Philosophy of Science 57 (2006) 69-91
47. Lerer B., Segman R.H., Fangerau H., Daly A.K., Basile V.S., and Cavallaro R. Pharmacogenetics of tardive dyskinesia: Combined analysis of 780 patients supports association with dopamine D3 receptor Gene Ser9Gly polymorphism. Neuropsychopharmacology 27 (2002) 105-119
48. Little R.J.A. To model or not to model? Competing modes of inference for finite population sampling. Journal of the American Statistical Association 88 (2004) 546-556
49. Little T.D., Cunningham W.A., Shahar G., and Widaman K.F. To parcel or not to parcel: Exploring the question, weighing the merits. Structural Equation Modeling 9 (2002) 151-173
50. Lorenz F.O., Simons R.L., Conger R.D., Elder G.H., Johnson C., and Chao W. Married and recently divorced mothers' stressful events and distress: Tracing change across time. Journal of Marriage and the Family 59 (1997) 219-232
51. MacCallum R.C., Widaman K.F., Zhang S., and Hong S. Sample size in factor analysis. Psychological Methods 4 (1999) 84-99
52. Maxwell S.E. The persistence of underpowered studies in psychological research: Causes, consequences, and remedies. Psychological Methods 9 (2004) 147-163
53. Maxwell S.E., and Delaney H.D. Designing experiments and analyzing data: A model comparison perspective. 2nd ed. (2004), Erlbaum, Mahwah, NJ
54. McArdle J.J., Grimm K.J., Hamagami F., Bowles R.P., and Meredith W. Modeling life span growth curves of cognition using longitudinal data with multiple samples and changing scales of measurement. Psychological Methods 14 (2009) 126-149
55. McArdle J.J., Hamagami F., Meredith W., and Bradway K.P. Modeling the dynamic hypotheses of Gf-Gc theory using longitudinal life-span data. Learning and Individual Differences 12 (2000) 53-79
56. McArdle J.J., Prescott C.A., Hamagami F., and Horn J.L. A contemporary method for developmental-genetic analyses of age changes in intellectual abilities. Developmental Neuropsychology 14 (1998) 69-114
57. Meehl P.E. Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology 46 (1978) 806-834
58. Mehta P.D., and West S.G. Putting the individual back into individual growth curves. Psychological Methods 5 (2000) 23-43
59. Meredith W. Measurement invariance, factor analysis and factorial invariance. Psychometrika 58 (1993) 525-543
60. Millsap R.E. Measurement invariance, predictive invariance, and the duality paradox. Multivariate Behavioral Research 30 (1995) 577-605
61. Millsap R.E. Invariance in measurement and prediction: Their relationship in the single factor case. Psychological Methods 2 (1997) 248-260
62. Miyazaki Y., and Raudenbush S.W. A test for linkage of multiple cohorts from an accelerated longitudinal design. Psychological Methods 5 (2000) 44-63
63. Muthén B.O., and Kaplan D. A comparison of some methodologies for the factor-analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Psychology 38 (1985) 171-180
64. Muthén B.O., and Kaplan D. A comparison of some methodologies for the factor analysis of non-normal Likert variables: A note on the size of the model. British Journal of Mathematical and Statistical Psychology 45 (1992) 19-30
65. Muthén B.O., and Satorra A. Complex sample data in structural equation modeling. Sociological Methodology 25 (1995) 267-316
66. National Institute on Alcohol Abuse and Alcoholism. Task Force on Recommended Alcohol Questions, National Council on Alcohol Abuse and Alcoholism recommended sets of alcohol consumption questions, October 15-16, 2003 (2003). http://www.niaaa.nih.gov/Resources/ResearchResources/TaskForce.htm Retrieved February 9, 2009, from http://www.niaaa.nih.gov/Resources/ResearchResources/TaskForce.htm
67. Nesselroade J.R., Gerstorf D., Hardy S.A., and Ram N. Idiographic filters for psychological constructs. Measurement 5 (2007) 217-235
68. Neyman J. On the two different aspects of the representative method: The method of stratified sampling and the method of purposive selection. Journal of the Royal Statistical Society 109 (1934) 558-606
69. Palmore E. When can age, period, and cohort be separated?. Social Forces 57 (1978) 282-295
70. Pentz M.A., and Chou C.P. Measurement invariance in longitudinal clinical research assuming change from development and intervention. Journal of Consulting and Clinical Psychology 62 (1994) 450-462
71. Pfeffermann D. The role of sampling weights when modeling survey data. International Statistical Review 61 (1993) 317-337
72. Rabe-Hesketh S., Skrondal A., and Pickles A. Generalized multilevel structural equation modeling. Psychometrika 69 (2004) 167-190
73. Raudenbush S.W., and Bryk A.S. Hierarchical linear models: Applications and data analysis methods. 2nd ed. (2002), Sage, Thousand Oaks, CA
74. Rothstein H.R., Sutton A.J., and Borenstein M. Publication bias in meta-analysis: Prevention, assessment and adjustments (2005), Wiley, West Sussex, England
75. Rusticus S.A., Hubley A.M., and Zumbo B.D. Measurement invariance of the Appearance Schemas Inventory-Revised and the Body Image Quality of Life Inventory across age and gender. Assessment 15 (2008) 60-71
76. Schaie K. A general model for the study of developmental problems. Psychological Bulletin 64 (1965) 92-107
77. Schaie K. Developmental designs revisited. In: Cohen S.H., and Reese H.W. (Eds). Life-span developmental psychology: Theoretical issues revisited (1994), Erlbaum, Hillsdale, NJ
78. Schmidt, F. L. (1984, August). Meta-analysis: Implications for cumulative knowledge in the behavioral and social sciences. Paper presented at the annual convention of the American Psychological Association, Toronto, Ontario, Canada.
79. Schmidt F.L. Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods 1 (1996) 115-129
80. Shadish W.R., Cook T.D., and Campbell D.T. Experimental and quasi-experimental designs for generalized causal inference (2002), Houghton Mifflin, Boston
81. Sher K.J., Walitzer K.S., Wood P.K., and Brent E.E. Characteristics of children of alcoholics: Putative risk factors, substance use and abuse, and psychopathology. Journal of Abnormal Psychology 100 (1991) 427-448
82. Skrondal A., and Rabe-Hesketh S. Generalized latent variable modeling: Multilevel, longitudinal and structural equation models (2004), Chapman & Hall/CRC, Boca Raton, FL
83. Smith M.L., and Glass G.V. Meta-analysis of psychotherapy outcome studies. American Psychologist 32 (1977) 752-760
84. Stark L.J., Janicke D.M., McGrath A.M., Mackner L.M., Hommel K.A., and Lovell D. Prevention of osteoporosis: A randomized clinical trial to increase calcium intake in children with juvenile rheumatoid arthritis. Journal of Pediatric Psychology 30 (2005) 377-386
85. Sterba, S. K. (2009). Alternative inferential frameworks for non-probability sampling in psychology and probability sampling in allied fields: Polarization to reconciliation. Manuscript submitted for publication.
86. Stevens S.S. On the theory of scales of measurement. Science 103 (1946) 677-680
87. Thissen D., and Wainer H. Test scoring (2001), Erlbaum, Mahwah, NJ
88. Thurstone L.L. Multiple-factor analysis (1947), University of Chicago Press, Chicago
89. Vandenberg R.J., and Lance C.E. A review and synthesis of the measurement in-variance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods 3 (2000) 4-69
90. van den Brandt P.A., Spiegelman D., Yaun S.S., Adami H.O., Beeson L., Folsom A.R., et al. Pooled analysis of prospective cohort studies on height, weight, and breast cancer risk. American Journal of Epidemiology 152 (2000) 514-527
91. Wirth R.J., and Edwards M.C. Item factor analysis: Current approaches and future directions. Psychological Methods 12 (2007) 58-79
92. Zucker R.A., Fitzgerald H.E., Refior S.K., Puttler L.I., Pallas D.M., and Ellis D.A. The clinical and social ecology of childhood for children of alcoholics: Description of a study and implications for a differentiated social policy. In: Fitzgerald H.E., Lester B.M., and Zuckerman B.S. (Eds). Children of addiction: Research, health and policy issues (2000), Garland Press, New York 174-222