Understanding meta-analysis: A review of the methodological literature

Leisure Sciences

Volumn 30, Issue 2, 2008, Pages 96-110

  Shelby, Lori B ^a   Vaske, Jerry ^a  

^a Department of Environmental and Radiological Health Sciences   (United States)

Author keywords

Comparative analysis; Effect size; Literature review; Meta analysis

Indexed keywords

COMPARATIVE STUDY; HUMAN GEOGRAPHY; LITERATURE REVIEW; META-ANALYSIS; SIZE EFFECT;

EID: 40749102823     PISSN: 01490400     EISSN: 15210588     Source Type: Journal    
DOI: 10.1080/01490400701881366     Document Type: Review

References (71)

1. Beal, D. J., Corey, D. M. and Dunlap, W. P. (2002) On the bias of Huffcutt and Arthur's (1995) procedure for identifying outliers in meta-analysis of correlations. Journal of Applied Psychology, 87:3, pp. 583-589.
2. Brown, S. A., Upchurch, S. L. and Acton, G. J. (2003) A framework for developing a coding scheme for meta-analysis. Western Journal of Nursing Research, 25:2, pp. 205-222.
3. Campbell, D. T. and Stanley, J. C. (1966) Experimental and quasi-experimental designs for research, Rand McNally, Chicago
4. Chen, P. Y. and Popovich, P. M. (2002) Correlation: Parametric and nonparametric measures, Sage, Thousand Oaks, CA
5. Cheung, S. F. and Chan, D. K. S. (2004) Dependent effect sizes in meta-analysis: Incorporating the degree of interdependence. Journal of Applied Psychology, 89:5, pp. 780-791.
6. Cook, T. D. and Campbell, D. T. (1979) Quasi-experimentation: Design & analysis issues for field settings, Houghton Mifflin, Boston, MA
7. Cooper, H. M. (1982) Scientific guidelines for conducting integrative research reviews. Review of Educational Research, 52:2, pp. 291-302.
8. Cooper, H. M. (1984) The integrative literature review: A systematic approach, Sage, Beverly Hills, CA
9. (1994) The handbook of research synthesis, Sage, New York, NY
10. Copas, J. and Shi, J. Q. (2000) Meta-analysis, funnel plots and sensitivity analysis. Biostatistics, 1:3, pp. 247-262.
11. Donnelly, M. P., Vaske, J. J., Whittaker, D. and Shelby, B. (2000) Toward an understanding of norm prevalence: A comparative analysis of 20 years of research. Environmental Management, 25:4, pp. 403-414.
12. Duval, S. and Tweedie, R. (2000) A nonparametric "trim and fill" method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association, 95:449, pp. 89-98.
13. Givens, G. H., Smith, D. D. and Tweedie, R. L. (1997) Publication bias in meta-analysis: A Bayesian data-augmentation approach to account for issues exemplified in the passive smoking debate. Statistical Science, 12:4, pp. 221-250.
14. Glass, G. V. (1976) Primary, secondary, and meta-analysis of research. Educational Researcher, 5:10, pp. 3-8.
15. Glass, G. V. (1982) Meta-analysis: An approach to the synthesis of research results. Journal of Research in Science Teaching, 19:2, pp. 93-112.
16. Glass, G. V. (2000)
17. Glass, G. V., McGaw, B. and Smith, M. L. (1981) Meta-analysis in social research, Sage, Beverly Hills, CA
18. Gleser, L. J. and Olkin, I. (1994) Stochastically dependent effect sizes. The handbook of research synthesis, pp. 339-355. Sage, New York
19. Gliner, J. A., Morgan, G. A. and Harmon, R. J. (2003) Meta-analysis: Formulation and interpretation. Journal of the American Academy of Child and Adolescent Psychiatry, 42:11, pp. 1376-1379.
20. Gliner, J. A., Vaske, J. J. and Morgan, G. A. (2001) Null hypothesis significance testing: Effect size matters. Human Dimensions of Wildlife, 6:4, pp. 291-301.
21. Grissom, R. J. and Kim, J. J. (2005) Effect sizes for research: A broad practical approach, Lawrence Erlbaum, Mahwah, NJ
22. Hall, J. A. and Rosenthal, R. (1995) Interpreting and evaluating meta-analysis. Evaluation and the Health Professions, 18:4, pp. 393-407.
23. Hall, J. A., Tickle-Degnen, L., Rosenthal, R. and Mosteller, F. (1994) Formulating a problem for a research synthesis. The handbook of research synthesis, pp. 17-28. Sage, New York
24. Halvorsen, K. T. (1994) The reporting format. The handbook of research synthesis, pp. 425-437. Sage, New York
25. Hedges, L. V. (1982) Issues in meta-analysis. Review of Research in Education, 13, pp. 353-398.
26. Hedges, L. V. (1992) Modeling publication selection effects in meta-analysis. Statistical Science, 7:2, pp. 246-256.
27. Hedges, L. V. (1994) Statistical considerations. The handbook of research synthesis, pp. 29-38. Sage, New York
28. Hedges, L. V. and Olkin, I. (1985) Statistical methods for meta-analysis, Academic Press, Orlando, FL
29. Hedges, L. V. and Vevea, J. L. (1998) Fixed- and random-effects models in meta-analysis. Psychological Methods, 3:4, pp. 486-504.
30. Huffcutt, A. I. and Arthur, W. (1995) Development of a new outlier statistic for meta-analytic data. Journal of Applied Psychology, 80:2, pp. 327-334.
31. Hunter, J. E. and Schmidt, F. L. (1990) Methods of meta-analysis: Correcting error and bias in research findings, Sage, Newbury Park, CA
32. Hunter, J. E., Schmidt, F. L. and Jackson, G. B. (1982) Meta-analysis: Cumulating research findings across studies, Sage, Beverly Hills, CA
33. Iyengar, S. and Greenhouse, J. B. (1988) Selection models and the file drawer problem. Statistical Science, 3:1, pp. 109-135.
34. Jackson, G. B. (1980) Methods for integrative reviews. Review of Educational Research, 50:3, pp. 438-460.
35. Kalaian, H. A. and Raudenbush, S. W. (1996) A multivariate mixed linear model for meta-analysis. Psychological Methods, 1, pp. 227-235.
36. Kraemer, H. C., Gardner, C., Brooks III, J. O. and Yesavage, J. A. (1998) Advantages of excluding underpowered studies in meta-analysis: Inclusionist versus exclusionist viewpoints. Psychological Methods, 3, pp. 23-31.
37. Laven, D. N., Manning, R. E. and Krymkowski, D. H. (2005) The relationship between visitor-based standards of quality and existing conditions in parks and outdoor recreation. Leisure Sciences, 27, pp. 157-173.
38. Light, R. J. and Pillemer, D. B. (1984) Summing up: The science of reviewing research, Harvard University Press, Cambridge, MA
39. Light, R. J., Singer, J. D. and Willett, J. B. (1994) The visual presentation and interpretation of meta-analyses. The handbook of research synthesis, pp. 439-453. Sage, New York
40. Lipsey, M. W. and Wilson, D. B. (2001) Practical meta-analysis, Sage, Thousand Oaks, CA
41. Little, R. J. A. and Rubin, D. B. (2002) Statistical analysis with missing data,, Wiley, Hoboken, NJ
42. Manfredo, M. J., Driver, B. L. and Tarrant, M. A. (1996) Measuring leisure motivation: A meta-analysis of the recreation experience preference scales. Journal of Leisure Research, 28:3, pp. 188-213.
43. Matt, G. E. and Cook, T. D. (1994) Threats to the validity of research syntheses. The handbook of research synthesis, pp. 503-520. Sage, New York
44. Murtaugh, P. A. (2002) Journal quality, effect size, and publication bias in meta-analysis. Ecology, 84:4, pp. 1162-1166.
45. Orwin, R. G. (1994) Evaluating coding decisions. The handbook of research synthesis, pp. 140-155. Sage, New York
46. Overton, R. C. (1998) A comparison of fixed-effects and mixed (random-effects) models for meta-analysis tests of moderator variable effects. Psychological Methods, 3, pp. 354-379.
47. Pearson, K. (1904) Report on certain enteric fever inoculation statistics. The British Medical Journal, 3, pp. 1243-1246.
48. Pham, B., Platt, R., McAuley, L., Klassen, T. P. and Moher, D. (2001) Is there a "best" way to detect and minimize publication bias?. Evaluation and the Health Professions, 24:2, pp. 109-125.
49. Raudenbush, S. W. (1994) Random effects models. The handbook of research synthesis, pp. 301-321. Sage, New York
50. Robinson, D. H. and Levin, J. R. (1997) Reflections on statistical and substantive significance, with a slice of replication. Educational Researcher, 26, pp. 21-26.
51. Rosenthal, R. (1979) The "file drawer problem" and tolerance for null results. Psychological Bulletin, 86, pp. 638-641.
52. Rosenthal, R. (1984) Meta-analytic procedures for social research, Sage, Beverly Hills, CA
53. Rosenthal, R. (1995) Writing meta-analytic reviews. Psychological Bulletin, 118:2, pp. 183-192.
54. Rosenthal, R. and DiMatteo, M. R. (2001) Meta-analysis: Recent developments in quantitative methods for literature review. Annual Review of Psychology, 52, pp. 59-82.
55. Rosenthal, R., Rosnow, R. L. and Rubin, D. B. (2000) Contrasts and effect sizes in behavioral research, Cambridge University Press, Cambridge, UK
56. Schafer, W. D. (1999) Methods, plainly speaking: An overview of meta-analysis. Measurement and Evaluation in Counseling and Development, 32, pp. 43-61.
57. Schmidt, F. L. and Hunter, J. E. (1977) Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, pp. 529-540.
58. Schmitt, N. (1996) Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods, 1, pp. 114-129.
59. Shadish, W. R. and Haddock, C. K. (1994) Combining estimates of effect size. The handbook of research synthesis, pp. 261-282. Sage, New York
60. Shelby, B., Heberlein, T. A., Vaske, J. J. and Alfano, G. (1983) Expectations, preferences, and feeling crowded in recreational activities. Leisure Sciences, 6:1, pp. 1-14.
61. Shelby, B., Vaske, J. J. and Heberlein, T. A. (1989) Comparative analysis of crowding in multiple locations: Results from fifteen years of research. Leisure Sciences, 11, pp. 269-291.
62. Shelby, L. B. and Vaske, J. J. (2007) Perceived crowding among hunters and anglers: A meta-analysis. Human Dimensions of Wildlife, 12:4, pp. 241-261.
63. Snedecor, G. W. (1946) Statistical methods,, Iowa State College Press, Ames, IA
64. Stock, W. A., Benito, J. G. and Lasa, N. B. (1996) Research synthesis: Coding and conjectures. Evaluation and the Health Professions, 19, pp. 104-117.
65. Sutton, A. J., Song, F., Gilbody, S. M. and Abrams, K. R. (2000) Modeling publication bias in meta-analysis: A review. Statistical Methods in Medical Research, 9, pp. 421-455.
66. Tippett, L. H. C. (1931) The methods of statistics, Williams & Norgate, London
67. Vaske, J. J. and Donnelly, M. P. (2002) Generalizing the encounter-norm-crowding relationship. Leisure Sciences, 24, pp. 255-269.
68. Vaske, J. J., Donnelly, M. P., Heberlein, T. A. and Shelby, B. (1982) Differences in reported satisfaction ratings by consumptive and nonconsujmptive recreationists. Journal of Leisure Research, 14, pp. 195-206.
69. Vaske, J. J., Gliner, J. A. and Morgan, G. A. (2002) Communicating judgments about practical significance: Effect size, confidence intervals and odds ratios. Human Dimensions of Wildlife, 7:4, pp. 287-300.
70. Vaske, J. J., Shelby, L. B. and Manfredo, M. (2006) Bibliometric reflections on the first decade of Human Dimensions of Wildlife. Human Dimensions of Wildlife, 11:2, pp. 79-87.
71. Yeaton, W. H. and Wortman, P. M. (1993) On the reliability of meta-analytic reviews: The role of intercoder agreement. Evaluation Review, 17:3, pp. 292-309.