Data aggregation in multilevel analysis: A review of conceptual and statistical issues

Measurement in Physical Education and Exercise Science

Volumn 10, Issue 2, 2006, Pages 85-107

  Dixon, Marlene A ^a   Cunningham, George B ^b  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Aggregation; Multilevel analysis; Organizational behavior; Physical activity; Sport

Indexed keywords

BEHAVIOR; DATA ANALYSIS; HUMAN; JOB SATISFACTION; ORGANIZATION; PHYSICAL ACTIVITY; RATING SCALE; REVIEW; SCORING SYSTEM; SPORT; STATISTICAL ANALYSIS;

EID: 33744908016     PISSN: 1091367X     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15327841mpee1002_2     Document Type: Review

References (52)

1. Allen, N. J., & Meyer, J. P. (1990). The measurement and antecedents of affective, continuance, and normative commitment to the organization. Journal of Occupational Psychology, 63, 1-18.
2. Arnett, M., & Lutz, R. (2003). Measurement of moderate to vigorous physical activity of middle school girls, using TriTrac Activity Monitors during small-sided, game-based lessons. Measurement in Physical Education and Exercise Science, 7, 149-159.
3. Bartko, J. J. (1976). On various intraclass correlation reliability coefficients. Psychological Bulletin, 83, 762-765.
4. Baumgartner, T. A., Jackson, A. S., Mahar, M. T., & Rowe, D. A. (2003). Measurement for evaluation in physical education and exercise science (7th ed.). Boston: McGraw-Hill.
5. Behling, O. (1978). Some problems in the philosophy of science of organizations. Academy of Management Review, 3, 193-201.
6. Bliese, P. D. (1998). Group size, ICC values, and group-level correlations: A simulation. Organizational Research Methods, 1, 355-373
7. Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 349-381). San Francisco: Jossey-Bass.
8. Brayfield, A. H., & Rothe, H. F. (1951). An index of job satisfaction. Journal of Applied Psychology, 35, 307-311.
9. Castro, S. L. (2002). Data analytic methods for the analysis of multilevel questions: A comparison of intraclass correlation coefficients, rwg, hierarchical linear modeling, within-and-between analysis, and random group resampling. The Leadership Quarterly, 13, 69-93.
10. Dansereau, F., Alutto, J. A., & Yammarino, F. J. (1984). Theory testing in organizational behavior: The varient approach. Englewood Cliffs, NJ: Prentice Hall.
11. Dansereau, F., & Yammarino, F. J. (2000). Within and between analysis: The variant paradigm as an underlying approach to theory building and testing. In K. J. Klein & S. W. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 512-553). San Francisco: Jossey-Bass.
12. Dixon, M. A. (2002). Human resource management in non-profit sport organizations: A multilevel approach. Unpublished doctoral dissertation, The Ohio State University, Columbus.
13. Duncan, S., Duncan, T., Strycker, L., & Chaumeton, N. (2002). Neighborhood physical activity opportunity: A multilevel contextual model. Research Quarterly for Exercise and Sport, 73, 457-464.
14. Duncan, S., Duncan, T., Strycker, L., & Chaumeton, N. (2004). A multilevel analysis of sibling physical activity. Journal of Span and Exercise Psychology, 26, 57-79.
15. Eccles, D. W., & Tenenbaum, G. (2004). Why an expert team is more than a team of experts: A social-cognitive conceptualization of team coordination and communication in sport. Journal of Sport and Exercise Psychology, 26, 542-560.
16. Eitle, D., & Eitle, T. (2003). Segregation and school violence. Social Forces, 82, 589-617.
17. Firebaugh, G. (1980). Groups as contexts and frog ponds. In K. H. Roberts & L. Burnstein (Eds.), Issues in aggregation: New directions for methodology of social and behavioral sciences, no. 6 (pp. 43-52). San Francisco: Jossey-Bass.
18. Fisher, K., Li, F., Michael, Y., & Cleveland, M. (2004). Neighborhood-level influences on physical activity among older adults: A multilevel analysis. Journal of Aging and Physical Activity, 12, 45-64.
19. Hofmann, D. A. (1997). An overview of the logic and rationale of hierarchical linear models. Journal of Management, 23, 723-744.
20. Hofmann, D. A., & Gavin, M. B. (1998). Centering decisions in hierarchical linear models: Theoretical and methodological implications for organizational science. Journal of Management, 23, 623-641.
21. Inglis, S., Danylchuk, K. E., & Pastore, D. (1996). Understanding retention factors in coaching and athletic management positions. Journal of Span Management, 10, 237-249.
22. James, L. R. (1982). Aggregation bias in estimate of perceptual agreement. Journal of Applied Psychology, 67, 219-229.
23. James, L. R., Demaree, R. G., & Wolf, G. (1984). Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, 69, 85-98.
24. wg: An assessment of within-group interrater agreement. Journal of Applied Psychology, 78, 306-309.
25. James, L. R., & Williams, L. J. (2000). The Cross-level operator in regression, ANCOVA, and contextual analysis. Multilevel analytical techniques: Commonalities, differences, and continuing questions. In K. J. Klein & S. W. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 382-424). San Francisco: Jossey-Bass.
26. Jehn, K. A. (1995). A multimethod examination of the benefits and detriments of intragroup conflict. Administrative Science Quarterly, 40, 256-282.
27. Jehn, K. A., Northcraft, G. B., & Neale, M. A. (1999). Why differences make a difference: A field study of diversity conflict, and performance in workgroups. Administrative Science Quarterly, 44, 741-763.
28. Katz, D., & Kahn, R. L. (1966). The social psychology of organizations. New York: Wiley.
29. Klein, K. J., Bliese, P. D., Kozlowski, S. W., Dansereau, F., Gavin, M. B., Griffin, M. A., et al. (2000). Multilevel analytical techniques: Commonalities, differences, and continuing questions. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 512-553). San Francisco: Jossey-Bass.
30. Klein, K. J., Dansereau, F., & Hall, R. J. (1994). Levels issues in theory development, data collection, and analysis. Academy of Management Review, 19, 195-229.
31. Klein, K. J., Tosi, H., & Cannella, Jr., A. A. (1999). Multilevel theory building: Benefits, barriers, and new developments. Academy of Management Review, 24, 243-248.
32. Knoppers, A. (1992). Explaining male dominance and sex segregation in coaching: Three approaches. Quest, 44, 210-227.
33. Kozlowski, S. W. J., & Hattrup, K. (1992). A disagreement about within-group agreement: Disentangling issues of consistency versus consensus. Journal of Applied Psychology, 77, 161-167.
34. Kozlowski, S. W J., & Klein, K. J. (2000). A multilevel approach to theory and research in organizations: Contextual, temporal, and emergent processes. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 3-90). San Francisco: Jossey-Bass.
35. wg(J). Organizational Research Methods, 8, 123-138.
36. Lewin, K. (1951). Field theory in the social sciences. New York: HarperCollins.
37. Maes, L., & Lievens, J. (2003). Can the school make a difference? A multilevel analysis of adolescent risk and health behavior. Social Science and Medicine, 56, 517-530.
38. Maiga, F., Haddad, S., Fournier, P., & Gauvin, L. (2003). Public and private sector responses to essential drugs policies: A multilevel analysis of drug prescription and selling practices in Mali. Social Science and Medicine, 57, 937-959.
39. McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 30-46.
40. O'Connell, A., & McCoach, D. (2004). Applications of hierarchical linear models for evaluations of health interventions. Evaluation and the Health Professions, 27, 119-150.
41. Ostroff, C. (1992). The relationship between satisfaction, attitudes, and performance: An organizational level analysis. Journal of Applied Psychology, 77, 963-974.
42. Ostroff, C., & Bowen, D. E. (2000). Moving HR to a higher level: HR practices and organizational effectiveness. In K. J. Klein & S. W. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 211-266). San Francisco: Jossey-Bass.
43. Raudenbush, S. W., & Bryk, A. S. (2001). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
44. Richter, K. P., Harris, K., Paine-Andrews, A., Fawcett, S., Schmid, T., Lankenau, B., et al. (2000). Measuring the health environment for physical activity and nutrition among youth: A review of the literature and applications for community initiatives. Preventive Medicine, 31, S98-S111.
45. Rousseau, D. (1985). Issues of level in organizations: Multilevel and cross-level perspectives. In L. L. Cummings & B. M. Staw (Eds.), Research in organizational behavior (Vol. 7, pp. 1-37). Greenwich, CT: JAI.
46. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428.
47. Silverman, S. (2004). Analyzing data from field research: The unit of analysis issue. Research Quarterly for Exercise and Span, 75, iii-iv.
48. Silverman, S., & Solmon, M. (1998). The unit of analysis in field research: Issues and approaches to design and data analysis. Journal of Teaching in Physical Education, 17, 270-284.
49. Thompson, J. (1967). Organizations in action. New York: McGraw-Hill.
50. Xiang, P., McBride, R., & Guan, J. (2004). Children's motivation in elementary physical education: A longitudinal study. Research Quarterly for Exercise and Sport, 75, 71-80.
51. Zhu, W. (1997a). A multilevel analysis of school factors associated with health-related fitness. Research Quarterly for Exercise and Sport, 68, 125-136.
52. Zhu, W. (1997b). A new solution for assessing and modeling effects of school physical education on children's abdominal strength-endurance. Research Quarterly for Exercise and Sport, 68, 97-100.