Could it be better to discard 90% of the data? A statistical paradox

American Statistician

Volumn 64, Issue 1, 2010, Pages 70-77

  Stanley, T D ^a   Jarrell, Stephen B ^b   Doucouliagos, Hristos ^c  

^a HENDRIX COLLEGE   (United States)

^b WESTERN CAROLINA UNIVERSITY   (United States)

^c DEAKIN UNIVERSITY   (Australia)

Author keywords

Meta regression analysis; Precision; Publication selection bias

Indexed keywords

EID: 76649139154     PISSN: 00031305     EISSN: None     Source Type: Journal    
DOI: 10.1198/tast.2009.08205     Document Type: Article

References (27)

1. Begg, C. B., and Berlin, J. A. (1988), "Publication Bias: A Problem in Interpreting Medical Data," Journal of the Royal Statistical Society, Ser. A, 151, 419-445. [70]
2. Carver, R. P. (1978), "The Case Against Statistical Testing," Harvard Educational Review, 48, 378-399. [70]
3. Cohen, J. (1994), "The Earth Is Round (p <.05)," American Psychologist, 49, 997-1003. [70]
4. Copas, J. (1999), "What Works? Selectivity Models and Meta-Analysis," Journal of the Royal Statistical Society, Ser. A, 161, 95-105. [70]
5. Doucouliagos, C. (H.), and Laroche, P. (2003), "What Do Unions Do to Productivity: A Meta-Analysis," Industrial Relations, 42, 650-691. [71]
6. Doucouliagos, C. (H.), and Stanley, T. D. (2008), "Theory Competition and Selectivity,"Working Paper, Economics Series 2008-06, Deakin University. [70,71]
7. - (2009), "Publication Selection Bias in Minimum-Wage Research? A Meta-Regression Analysis," British Journal of Industrial Relations, 47, 406-429. [70-72,75]
8. Egger, M., Smith, G. D., Scheider, M., and Minder, C. (1997), "Bias in Meta-Analysis Detected by a Simple, Graphical Test," British Medical Journal, 316, 629-634. [71,72]
9. Harlow, L. L., Mulaik, S. A., and Steiger, J. H. (eds.) (1997), What if There Were No Significance Tests? Mahwah, NJ: Erlbaum. [70]
10. Hedges, L. V. (1992), "Modeling Publication Selection Effects in Meta-Analysis," Statistical Science, 7, 246-255. [71]
11. Hedges, L. V., and Olkin, I. (1985), Statistical Methods for Meta-Analysis, Orlando: Academic Press. [70]
12. Higgins, J. P. T., and Thompson, S. G. (2002), "Quantifying Heterogeneity in Meta-Analysis," Statistics in Medicine, 21, 1539-1558. [73]
13. Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., and Dickersin, K. (2009), "Publication Bias in Clinical Trials due to Statistical Significance or Direction of Trial Result," Cochrane Review, Issue 1. Available at http: //www.thecochranelibrary.com. [70]
14. Krakovsky, M. (2004), "Register or Perish," Scientific American, 291, 18-20. [70]
15. Mandel, M., and Rinott, Y. (2009), "A Selection Bias Conflict and Frequentist versus Bayesian Viewpoints," The American Statistician, 63, 211-217. [70]
16. Moore, D. S. (1997), "Bayes for Beginners? Some Reasons to Hesitate," The American Statistician, 51, 254-261. [73]
17. Moreno, S. G., Sutton, A. J., Ades, A., Stanley, T. D., Abrams, K. R., Peters, J. L., and Cooper, N. J. (2009), "Assessment of Regression-Based Methods to Adjust for Publication Bias Through a Comprehensive Simulation Study," BMC Medical Research Methodology, 9:2. Available at http://www.biomedcentral.com/1471-2288/9/2. [71,73-75]
18. Rose, A. K., and Stanley, T. D. (2005), "A Meta-Analysis of the Effect of Common Currencies on International Trade," Journal of Economic Surveys, 19, 347-365. [72]
19. Rosenthal, R. (1979), "The 'File Drawer Problem' and Tolerance for Null Results," Psychological Bulletin, 86, 638-641. [70]
20. Senn, S. (2008), "A Note Concerning a Selection 'Paradox' of Dawid's," The American Statistician, 62, 206-210. [70]
21. Stanley, T. D. (2005), "Beyond Publication Selection," Journal of Economic Surveys, 19, 309-345. [71]
22. - (2008), "Meta-Regression Methods for Detecting and Estimating Empirical Effect in the Presence of Publication Bias," Oxford Bulletin of Economics and Statistics, 70, 103-127. [71-74]
23. Stanley, T. D., and Doucouliagos, C. (2007), "Identifying and Correcting Publication Selection Bias in the Efficiency-Wage Literature: Heckman Meta-Regression," School Working Paper, Economics Series 2007-2011, Deakin University. [75]
24. Stead, L. F., Perera, R., Bullen, C., Mant, D., and Lancaster, T. (2008), "Nicotine Replacement Therapy for Smoking Cessation," The Cochrane Library, Issue 2. Available at http://www.thecochranelibrary.com. [71]
25. Sterling, T. D. (1959), "Publication Decisions and Their Possible Effects on Inferences Drawn From Tests of Significance," Journal of the American Statistical Association, 54, 30-34. [70]
26. Sterling, T. D., Rosenbaum, W. L., and Weinkam, J. J. (1995), "Publication Decisions Revisited: The Effect of the Outcome of Statistical Tests on the Decision to Publish and vice versa," The American Statistician, 439, 108-112. [70]
27. Sutton, A. J., Abrams, K. R., Jones, D. R., Sheldon, T. A., and Song, F. (2000), Methods for Meta-Analysis in Medical Research, Chichester: Wiley. [71]