Neither fixed nor random: weighted least squares meta-regression

Research Synthesis Methods

Volumn 8, Issue 1, 2017, Pages 19-42

  Stanley, T D ^a   Doucouliagos, Hristos ^b  

^a HENDRIX COLLEGE   (United States)

^b DEAKIN UNIVERSITY   (Australia)

Author keywords

fixed effect; meta regression; random effects; weighted least squares

Indexed keywords

ALGORITHM; COMPUTER SIMULATION; HUMAN; LEAST SQUARE ANALYSIS; MARKOV CHAIN; METHODOLOGY; PUBLISHING; REGRESSION ANALYSIS; SAMPLE SIZE; STATISTICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; HUMANS; LEAST-SQUARES ANALYSIS; MARKOV CHAINS; MODELS, STATISTICAL; PUBLICATION BIAS; PUBLISHING; REGRESSION ANALYSIS; RESEARCH DESIGN; SAMPLE SIZE;

EID: 84977514879     PISSN: None     EISSN: 17592887     Source Type: Journal    
DOI: 10.1002/jrsm.1211     Document Type: Article

References (61)

1. Aitken AC 1935. On least squares and linear combinations of observations. Proceedings of the Royal Society of Edinburgh 55: 42–48.
2. Baker RD, Jackson D 2013. Meta-analysis inside and outside of particle physics: two traditions that should converge? Research Synthesis Methods 4: 109–124.
3. Baker WL, White CM, Cappelleri JC, Kluger J, Coleman CI 2009. Understanding heterogeneity in meta-analysis: the role of meta-regression. The International Journal of Clinical Practice 63: 1426–1434.
4. Borenstein M, Hedges LV, Higgins JPT, Rothstein HR 2009. Introduction to Meta-analysis. Chichester: John Wiley and Sons.
5. Copas JB, Lozada C 2009. The radial plot in meta-analysis: approximations and applications. Journal of the Royal Statistical Society, Series C 58: 329–344.
6. Costa-Font J, McGuire A, Stanley TD 2013. Publication selection in health policy research: the winner's curse hypothesis. Health Policy 109: 78–87.
7. Davidson R, MacKinnon JG 2004. Econometric Theory and Methods. Oxford: Oxford University Press.
8. De Linde Leonard M, Stanley TD, Doucouliagos H(C) 2014. Does the UK minimum wage reduce employment? A meta-regression analysis. British Journal of Industrial Relations 52: 499–520.
9. Doucouliagos C(H), Haman J, Stanley TD 2012. Pay for performance and corporate governance reform. Industrial Relations 51: 670–703.
10. Doucouliagos C(H), Stanley TD 2009. Publication selection bias in minimum-wage research? A meta-regression analysis. British Journal of Industrial Relations 47: 406–29.
11. Doucouliagos C(H), Stanley TD 2013. Theory competition and selectivity: are all economic facts greatly exaggerated? Journal of Economic Surveys 27: 316–39.
12. Doucouliagos C(H), Stanley TD, Giles M 2012. Are estimates of the value of a statistical life exaggerated? Journal of Health Economics 31: 197–206.
13. Doucouliagos C, Stanley TD, Viscusi WK 2014. Publication selection and the income elasticity of the value of a statistical life. Journal of Health Economics 33: 67–75.
14. Egger M, Smith GD, Scheider M, Minder C 1997. Bias in meta-analysis detected by a simple, graphical test. British Medical Journal 316: 629–34.
15. Gauss CF 1823. Theoria Combinationis Observationum Erroribus Minimis Obnoxiae. Gӧttingen: Dieterich.
16. Gerber AS, Green DP, Nickerson D 2001. Testing for publication bias in political science. Political Analysis 9: 385–92.
17. Gerber AS, Malhorta N 2008. Publication bias in empirical sociological research. Sociological Methods and Research 25: 1–28.
18. Greene WE 1990. Econometric Analysis. New York: Macmillan.
19. Hedges LV 1994. Fixed effects models. In Cooper H, Hedges LV (eds.). The Handbook of Research Synthesis(pp. 285–299). New York: Russell Sage.
20. Hedges LV, Olkin I 1985. Statistical Methods for Meta-analysis. Orlando: Academic Press.
21. Hedges LV, Vevea JL 1998. Fixed- and random-effects models in meta-analysis. Psychological Methods 3: 486–504.
22. Henmi M, Copas JB 2010. Confidence intervals for random effects meta-analysis and robustness to publication bias. Statistics in Medicine 29: 2969–2983.
23. Higgins JPT, Thompson SG 2002. Quantifying heterogeneity in meta-analysis. Statistics in Medicine 21: 1539–1558.
24. Higgins JPT, Thompson SG 2004. Controlling the risk of spurious findings from meta-regression. Statistics in Medicine 23: 1663–1682.
25. Hoaglin DC 2015. Misunderstandings of Q and ‘Cochrane Q-test’ in meta-analysis. Statistics in Medicine (wileyonlinelibrary.com). DOI:10.1002/sim.6632.
26. Hopewell S, Loudon K, Clarke MJ, Oxman AD, Dickersin K 2009. Publication bias in clinical trials due to statistical significance or direction of trial result. Cochrane Review. Available at http://www.thecochranelibrary.com.
27. Ioannidis JPA, Stanley TD, Doucouliagos C 2016. The power of bias in economics research. The Economic Journal, forthcoming. Available as SWP, Economics Series 2016/1. Deakin University: Melbourne, Australia. http://www.deakin.edu.au/__data/assets/pdf_file/0007/477763/2016_1.pdf [Accessed February 1, 2016].
28. Jacquez JA, Mather F, Crawford C 1968. Linear regression with non-constant, unknown error variances: sampling experiments with least squares, weighted least squares and maximum likelihood estimators. Biometrics 24: 607–26.
29. Johnson BT, Huedo-Medina TB 2012. Depicting estimates using the intercept in meta-regression models: the moving constant technique. Research Synthesis Methods 2: 204–20.
30. Judge GG, Hill RC, Griffiths W, Lutkepohl H, Lee TC 1982. Introduction to the Theory and Practice of Econometrics. New York: John Wiley and Sons.
31. Kmenta J 1971. Elements of Econometrics. New York: Macmillan.
32. Knapp G, Hartung J 2003. Improved tests for a random effects meta-regression with a single covariate. Statistics in Medicine 22: 2693–2710.
33. Koetse MJ, Florax RJGM, de Groot HLF 2010. Consequences of effect size heterogeneity on meta-analysis: a Monte Carlo experiment. Statistical Methods and Applications 19: 217–36.
34. Konstantopoulos S, Hedges LV 2004. Meta-analysis. In Kaplan D (ed.). Quantitative Methodology for the Social Sciences(pp. 281–295). Thousand Oaks: Sage Publications.
35. Krassoi Peach E, Stanley TD 2009. Efficiency wages, productivity and simultaneity: a meta-regression analysis. Journal of Labor Research 30: 262–8.
36. Lipsey MW, Wilson DB 2001. Practical Meta-analysis. Thousand Oaks: Sage Publications.
37. Moreno SG, Sutton AJ, Ades AE, Stanley TD, Abrams KR, Peters JL, Cooper NJ 2009. Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study. BMC Medical Research Methodology 9: 2. http://www.biomedcentral.com/1471-2288/9/2.
38. Poole C, Greenland S 1999. Random-effects meta-analyses are not always conservative. American Journal of Epidemiology 150: 469–475.
39. Raudenbush SW 1994. Random effects models. In Cooper H, Hedges LV (eds.). The Handbook of Research Synthesis(pp. 301–321). New York: Russell Sage.
40. Sharp S 1998. sbe23: meta-analysis regression. Stata Technical Bulletin 42: 16–22. Reprinted in Stata Technical Bulletin Reprints, vol. 7, pp. 148-155. College Station, TX: Stata Press.
41. Sidik K, Jonkman JN 2007. A comparison of heterogeneity variance estimators in combining results of studies. Statistics in Medicine 26: 1964–81.
42. Stanley TD 2008. Meta-regression methods for detecting and estimating empirical effect in the presence of publication selection. Oxford Bulletin of Economics and Statistics 70: 103–27.
43. Stanley TD, Doucouliagos H(C) 2012. Meta-regression Analysis in Economics and Business. Oxford: Routledge.
44. Stanley TD, Doucouliagos H(C) 2014. Meta-regression approximations to reduce publication selection bias. Research Synthesis Methods 5: 60–78.
45. Stanley TD, Doucouliagos H(C) 2015. Neither fixed nor random: weighted least squares meta-regression analysis. Statistics in Medicine 34: 2116–27.
46. Stanley TD, Doucouliagos H(C), Giles M, et al. 2013. Meta-analysis of economics research reporting guidelines. Journal of Economic Surveys 27: 390–94.
47. Stanley TD, Jarrell SB 1989. Meta-regression analysis: a quantitative method of literature surveys. Journal of Economic Surveys 3: 161–70.
48. Stanley TD, Jarrell SB, Doucouliagos H(C) 2010. Could it be better to discard 90% of the data? A statistical paradox. American Statistician 64: 70–77.
49. Steel P, Kammeyer-Mueller J 2002. Comparing meta-analytic moderator search techniques under realistic conditions. Journal of Applied Psychology 87: 96–111.
50. Sterling TD, Rosenbaum WL, Weinkam JJ 1995. Publication decisions revisited: the effect of the outcome of statistical tests on the decision to publish and vice versa. American Statistician 49: 108–12.
51. Sterne JAC 2009. Meta-Analysis in Stata: An Updated Collection from the Stata Journal. College Station, TX: Stata Press.
52. Stigler SM 1986. The History of Statistics. Cambridge, MA: Belknap Press.
53. Thompson SG, Sharp SJ 1999. Explaining heterogeneity in meta-analysis: a comparison of methods. Statistics in Medicine 18: 2693–2708.
54. Turner RM, Davy J, Clarke MJ, Thompson SG, Higgins JPT 2012. Predicting the extent of heterogeneity in meta-analysis, using empirical data from the Cochrane Database of Systematic Reviews. International Journal of Epidemiology 41: 818–27.
55. U.S. Dept. of Transportation 2011. Office of the Assistant Secretary for Transportation Policy, Memorandum: Treatment of the Economic Value of Statistical Life in Departmental Analyses—2011 Interim Adjustment. http://www.dot.gov/policy/transportation-policy/treatment-economic-value-statistical-life (accessed 1.05.15).
56. United States Environmental Protection Agency. 2010. Valuing Mortality Risk Reductions for Environmental Policy: A White Paper. Science Advisory Board—Environmental Economics, Review Draft.
57. United States Environmental Protection Agency (EPA). 1997. The Benefits and Costs of the Clean Air Act, 1970 to 1990, EPA 410-R-97-002.
58. Viscusi WK 2011. Policy challenges of the heterogeneity of the value of statistical life. Foundations and Trends in Microeconomics 6: 99–172.
59. Viscusi WK, Aldy JE 2003. The value of a statistical life: a critical review of market estimates throughout the world. Journal of Risk and Uncertainty 27: 5–76.
60. White IR 2011. Multivariate random-effects meta-regression: updates to mvmeta. Stata Journal 11: 255–270.
61. Wooldridge JM 2002. Econometric Analysis of Cross Section and Panel Data. Cambridge: MIT Press.