Multilevel modeling: Overview and applications to research in counseling psychology

Journal of Counseling Psychology

Volumn 58, Issue 2, 2011, Pages 257-271

  Kahn, Jeffrey H ^a  

^a ILLINOIS STATE UNIVERSITY   (United States)

Author keywords

Hierarchical linear models; Longitudinal data; Multilevel modeling; Nested data; Regression

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; BEHAVIORAL RESEARCH; COUNSELING; HUMAN; LONGITUDINAL STUDY; METHODOLOGY; MULTILEVEL ANALYSIS; PSYCHOLOGICAL ASPECT; STATISTICAL MODEL; STATISTICS; STUDENT;

ANALYSIS OF VARIANCE; BEHAVIORAL RESEARCH; COUNSELING; HUMANS; LONGITUDINAL STUDIES; MODELS, STATISTICAL; MULTILEVEL ANALYSIS; STUDENTS;

EID: 79954541203     PISSN: 00220167     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0022680     Document Type: Article

References (54)

1. Arnold C. An introduction to hierarchical linear models. Measurement and Evaluation in Counseling and Development 1992, 25:58-90.
2. Atkins D.C. Using multilevel models to analyze couple and family treatment data: Basic and advanced issues. Journal of Family Psychology 2005, 19:98-110. doi: 10.1037/0893-3200.19.1.98.
3. Baldwin S.A., Murray D.M., Shadish W.R. Empirically supported treatments or Type I errors? Problems with the analysis of data from group-administered treatments. Journal of Consulting and Clinical Psychology 2005, 73:924-935. doi: 10.1037/0022-006X.73.5.924.
4. Baldwin S.A., Wampold B.E., Imel Z.E. Untangling the alliance-outcome correlation: Exploring the relative importance of therapist and patient variability in the alliance. Journal of Consulting and Clinical Psychology 2007, 75:842-852. doi: 10.1037/0022-006X.75.6.842.
5. Cerdá M., Buka S.L., Rich-Edwards J.W. Neighborhood influences on the association between maternal age and birth weight: A multilevel investigation of age-related disparities in health. Social Science & Medicine 2008, 66:2048-2060. doi: 10.1016/j.socscimed.2008.01.027.
6. Conner T.S., Barrett L.F., Tugade M.M., Tennen H. Idiographic personality: The theory and practice of experience sampling. Handbook of research methods in personality psychology 2007, 79-98. Guilford Press, New York, NY. R.W. Robins, R.C. Fraley, R. Kreuger (Eds.).
7. de la Torre J., Camilli G., Vargas S., Vernon R.F. Illustration of a multilevel model for meta-analysis. Measurement and Evaluation in Counseling and Development 2007, 40:169-180.
8. Duffy R.D., Lent R.W. Test of a social cognitive model of work satisfaction in teachers. Journal of Vocational Behavior 2009, 75:212-223. doi: 10.1016/j.jvb.2009.06.001.
9. Elliott T.R., Shewchuk R.M., Richards J.S. Family caregiver social problem-solving abilities and adjustment during the initial year of the caregiving role. Journal of Counseling Psychology 2001, 48:223-232. doi: 10.1037/0022-0167.48.2.223.
10. Enders C.K., Tofighi D. Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods 2007, 12:121-138. doi: 10.1037/1082-989X.12.2.121.
11. Fleeson W. Toward a structure- and process-integrated view of personality: Traits as density distributions of states. Journal of Personality and Social Psychology 2001, 80:1011-1027. doi: 10.1037/0022-3514.80.6.1011.
12. Frazier P.A., Tix A.P., Barron K.E. Testing moderator and mediator effects in counseling psychology research. Journal of Counseling Psychology 2004, 51:115-134. doi: 10.1037/0022-0167.51.1.115.
13. Garrison A.M., Kahn J.H. Intraindividual relations between the intensity and disclosure of daily emotional events: The moderating role of depressive symptoms. Journal of Counseling Psychology 2010, 57:187-197. doi: 10.1037/a0018386.
14. Gelso C.J. On the making of a scientist-practitioner: A theory of research training in professional psychology. Professional Psychology: Research and Practice 1993, 24:468-476. doi: 10.1037/0735-7028.24.4.468.
15. Goddard R.D. Collective efficacy: A neglected construct in the study of schools and student achievement. Journal of Educational Psychology 2001, 93:467-476. doi: 10.1037/0022-0663.93.3.467.
16. Heck R.H., Thomas S.L. An introduction to multilevel modeling techniques 2009, Routledge, New York, NY. 2nd ed.
17. Heppner M.J., Multon K.D., Gysbers N.C., Ellis C.A., Zook C.E. The relationship of trainee self-efficacy to the process and outcome of career counseling. Journal of Counseling Psychology 1998, 45:393-402. doi: 10.1037/0022-0167.45.4.393.
18. Hofmann D.A. An overview of the logic and rationale of hierarchical linear models. Journal of Management 1997, 23:723-744. doi: 10.1177/014920639702300602.
19. Holland J.L. Making vocational choices: A theory of vocational personalities and work environments 1997, Psychological Assessment Resources, Odessa, FL. 3rd ed.
20. Hox J. Multilevel analysis: Techniques and applications 2010, Erlbaum, Mahwah, NJ. 2nd ed.
21. Jex S.M., Bliese P.D. Efficacy beliefs as a moderator of the impact of work-related stressors: A multilevel study. Journal of Applied Psychology 1999, 84:349-361. doi: 10.1037/0021-9010.84.3.349.
22. Kahn J.H. Predicting the scholarly activity of counseling psychology students: A refinement and extension. Journal of Counseling Psychology 2001, 48:344-354. doi: 10.1037/0022-0167.48.3.344.
23. Kahn J.H., Schlosser L.Z. The graduate research training environment in professional psychology: A multilevel investigation. Training and Education in Professional Psychology 2010, 4:183-193. doi: 10.1037/a0018968.
24. Kenny D.A., Hoyt W.T. Multiple levels of analysis in psychotherapy research. Psychotherapy Research 2009, 19:462-468. doi: 10.1080/10503300902806681.
25. Kim D.-M., Wampold B.E., Bolt D.M. Therapist effects in psychotherapy: A random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychotherapy Research 2006, 16:161-172. doi: 10.1080/10503300500264911.
26. Kivlighan D.M., Shaughnessy P. Analysis of the development of the working alliance using hierarchical linear modeling. Journal of Counseling Psychology 1995, 42:338-349. doi: 10.1037/0022-0167.42.3.338.
27. Kwok O.-M., Underhill A.T., Berry J.W., Luo W., Elliott T.R., Yoon M. Analyzing longitudinal data with multilevel models: An example with individuals living with lower extremity intra-articular fractures. Rehabilitation Psychology 2008, 53:370-386. doi: 10.1037/a0012765.
28. Lutz W., Leon S.C., Martinovich Z., Lyons J.S., Stiles W.B. Therapist effects in outpatient psychotherapy: A three-level growth curve approach. Journal of Counseling Psychology 2007, 54:32-39. doi: 10.1037/0022-0167.54.1.32.
29. Maas C.J.M., Hox J.J. Sufficient sample sizes for multilevel modeling. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences 2005, 1:85-92. doi: 10.1027/1614-2241.1.3.85.
30. Marcus D.K., Kashy D.A., Baldwin S.A. Studying psychotherapy using the one-with-many design: The therapeutic alliance as an exemplar. Journal of Counseling Psychology 2009, 56:537-548. doi: 10.1037/a0017291.
31. Marmarosh C.L., Gelso C.J., Markin R.D., Majors R., Mallery C., Choi J. The real relationship in psychotherapy: Relationship to adult attachments, working alliance, transference, and therapy outcome. Journal of Counseling Psychology 2009, 56:337-350. doi: 10.1037/a0015169.
32. Matsumoto D., Yoo S.H., Fontaine J., Anguas-Wong A.M., Arriola M., Ataca B., Granskaya J.V. Mapping expressive differences around the world: The relationship between emotional display rules and individualism versus collectivism. Journal of Cross-Cultural Psychology 2008, 39:55-74. doi: 10.1177/0022022107311854.
33. Nezlek J.B., Zyzniewski L.E. Using hierarchical linear modeling to analyze grouped data. Group Dynamics: Theory, Research, and Practice 1998, 2:313-320. doi: 10.1037/1089-2699.2.4.313.
34. Park S., Lake E.T. Multilevel modeling of a clustered continuous outcome: Nurses' work hours and burnout. Nursing Research 2005, 54:406-413. doi: 10.1097/00006199-200511000-00007.
35. Patton M.J., Kivlighan D.M. Relevance of the supervisory alliance to the counseling alliance and to treatment adherence in counselor training. Journal of Counseling Psychology 1997, 44:108-115. doi: 10.1037/0022-0167.44.1.108.
36. Peugh J.L., Enders C.K. Using the SPSS MIXED procedure to fit cross-sectional and longitudinal multilevel models. Educational and Psychological Measurement 2005, 65:717-741. doi: 10.1177/0013164405278558.
37. Pituch K.A., Murphy D.L., Tate R.L. Three-level models for indirect effects in school- and class-randomized experiments in education. Journal of Experimental Education 2010, 78:60-95. doi: 10.1080/00220970903224685.
38. Preacher K.J., Zyphur M.J., Zhang Z. A general multilevel SEM framework for assessing multilevel mediation. Psychological Methods 2010, 15:209-233. doi: 10.1037/a0020141.
39. Raudenbush S.W., Bryk A.S. Hierarchical linear models: Applications and data analysis 2002, Sage, Newbury Park, CA. 2nd ed.
40. Raudenbush S.W., Bryk A.S., Cheong Y.F., Congdon R.T. HLM 6: Hierarchical linear and nonlinear modeling 2004, Scientific Software International, Lincolnwood, IL.
41. Reise S.P., Duan N. Multilevel modeling and its application in counseling psychology research. Counseling Psychologist 1999, 27:528-551. doi: 10.1177/0011000099274003.
42. Sauer E.M., Lopez F.G., Gormley B. Respective contributions of therapist and client adult attachment orientations to the development of the early working alliance: A preliminary growth modeling study. Psychotherapy Research 2003, 13:371-382. doi: 10.1093/ptr/kpg027.
43. Schlomer G.L., Bauman S., Card N.A. Best practices for missing data management in counseling psychology. Journal of Counseling Psychology 2010, 57:1-10. doi: 10.1037/a0018082.
44. Siemer M., Joormann J. Power and measures of effect size in analysis of variance with fixed versus random nested factors. Psychological Methods 2003, 8:497-517. doi: 10.1037/1082-989X.8.4.497.
45. Singer J.D. Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. Journal of Educational and Behavioral Statistics 1998, 23:323-355.
46. Singer J.D., Willett J.B. Applied longitudinal data analysis: Modeling change and event occurrence 2003, Oxford University Press, Oxford, England.
47. Snijders T.A.B. Power and sample size in multilevel models. Encyclopedia of statistics in behavioral science 2005, 3:1570-1573. Wiley, Chichester, England. B.S. Everitt, D.C. Howell (Eds.).
48. Snijders T.A.B., Bosker R.J. Multilevel analysis: An introduction to basic and advanced multilevel modeling 1999, Sage, London, England.
49. Steger M.F., Kashdan T.B. Depression and everyday social activity, belonging, and well-being. Journal of Counseling Psychology 2009, 56:289-300. doi: 10.1037/a0015416.
50. Tasca G.A., Illing V., Ogrodniczuk J.S., Joyce A.S. Assessing and adjusting for dependent observations in group treatment research using multilevel models. Group Dynamics: Theory, Research, and Practice 2009, 13:151-162. doi: 10.1037/a0014837.
51. Tynkkynen L., Nurmi J., Salmela-Aro K. Career goal-related social ties during two educational transitions: Antecedents and consequences. Journal of Vocational Behavior 2010, 76:448-457. doi: 10.1016/j.jvb.2009.12.001.
52. Wampold B.E., Brown G.S. Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology 2005, 73:914-923. doi: 10.1037/0022-006X.73.5.914.
53. West S.G., Ryu E., Kwok O., Cham H. Multilevel modeling: Current and future applications in personality research. Journal of Personality 2011, 79:2-50. doi: 10.1111/j.1467-6494.2010.00681.x.
54. Yalom I.D. The theory and practice of group psychotherapy 2005, Basic Books, New York, NY. 5th ed.