Persuasion Bias in Science: Can Economics Help?

Economic Journal

Volumn 127, Issue 605, 2017, Pages F266-F304

  Di Tillio, Alfredo ^a   Ottaviani, Marco ^a   Sørensen, Peter Norman ^b  

^a BOCCONI UNIVERSITY   (Italy)

^b UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

GAME THEORY; SAMPLING; WELFARE ECONOMICS;

EID: 85032354093     PISSN: 00130133     EISSN: 14680297     Source Type: Journal    
DOI: 10.1111/ecoj.12515     Document Type: Article

References (60)

1. Allcott, H. (2015). ‘Site selection bias in program evaluation’, Quarterly Journal of Economics, vol. 130(3), pp. 1117–65.
2. Angrist, J.D. and Pischke, J.-S. (2009). Mostly Harmless Econometrics: An Empiricist's Companion, Princeton, NJ: Princeton University Press.
3. Benjamini, Y. and Hochberg, Y. (1995). ‘Controlling the false discovery rate: a practical and powerful approach to multiple testing’, Journal of the Royal Statistical Society Series B, vol. 57(1), pp. 289–300.
4. Berger, V.W. (2005). Selection Bias and Covariate Imbalances in Randomized Clinical Trials. Chichester: Wiley.
5. Berry, S.M. and Kadane, J.B. (1997). ‘Optimal Bayesian randomization’, Journal of the Royal Statistical Society, Series B, vol. 59(4), pp. 813–9.
6. Blackwell, D. and Hodges, J.L. (1957). ‘Design for the control of selection bias’, Annals of Mathematical Statistics, vol. 28(2), pp. 449–60.
7. British Medical Journal (1948). ‘The controlled therapeutic trial’, British Medical Journal, vol. 2(4582), pp.791–2.
8. Brocas, I. and Carrillo, J.D. (2007). ‘Influence through ignorance’, RAND Journal of Economics, vol. 38(4), pp. 931–47.
9. Chalmers, I. (1999), ‘Why transition from alternation to randomisation in clinical trials was made’, British Medical Journal, vol. 319(7221), p. 1372.
10. Chalmers, I. (2001), ‘Comparing like with like: some historical milestones in the evolution of methods to create unbiased comparison groups in therapeutic experiments’, International Journal of Epidemiology, vol. 30(5), pp. 1156–64.
11. Chalmers, I., and Clarke, M. (2004). ‘The 1944 patulin trial: the first properly controlled multicentre trial conducted under the aegis of the British Medical Research Council’, International Journal of Epidemiology, vol. 32, pp. 253–60.
12. Chalmers, T.C., Celano, P., Sacks, H.S. and Smith, H. (1983). ‘Bias in treatment assignment in controlled clinical trials’, New England Journal of Medicine, vol. 309(22), pp. 1358–61.
13. Coffman, L.C. and Niederle, M. (2015). ‘Pre-analysis plans have limited upside’, Journal of Economic Perspectives, vol. 29(3), pp. 81–98.
14. D’Arcy Hart, P. (1999). ‘A change in scientific approach: from alternation to randomised allocation in clinical trials in the 1940s’, British Medical Journal, vol. 319(7209), pp. 572–3.
15. Dahm, M., González, P. and Porteiro, N. (2009). ‘Trials, tricks and transparency: how disclosure rules affect clinical knowledge’, Journal of Health Economics, vol. 28(6), pp. 1141–53.
16. Denton, F.T. (1985). ‘Data mining as an industry’, Review of Economics and Statistics, vol. 67(1), pp. 124–7.
17. Di Tillio, A., Ottaviani, M. and Sørensen, P.N. (2017). ‘Strategic sample selection’, Working Paper.
18. Dufwenberg, M. and Martinsson, P. (2014). ‘Keeping researchers honest: the case for sealed-envelope-submissions’, IGIER (Innocenzo Gasparini Institute for Economic Research), Working Paper 533.
19. Efron, B. (1971). ‘Forcing a sequential experiment to be balanced,' Biometrika, vol. 58(3), pp. 403–17.
20. Felgenhauer, M. and Schulte, E. (2014). ‘Strategic private experimentation’, American Economic Journal: Microeconomics, vol. 6(4), pp. 74–105.
21. Fisher, R.A. (1925). Statistical Methods for Research Workers, Edinburgh: Oliver and Boyd.
22. Fisher, R.A. (1926). ‘The arrangement of field experiments’, Journal of the Ministry of Agriculture of Great Britain, vol. 33(6), pp. 503–13.
23. Fisher, R.A. (1935). The Design of Experiments, Edinburgh: Oliver and Boyd.
24. Fisher, R.A. (1936). ‘Has Mendel's work been rediscovered?’, Annals of Science, vol. 1(2), pp. 115–37.
25. Fishman, M.J. and Hagerty, K.M. (1990). ‘The optimal amount of discretion to allow in disclosure’, Quarterly Journal of Economics, vol. 105(2), pp. 427–44.
26. Glaeser, E.L. (2008). ‘Researcher incentives and empirical methods,' in (A. Caplin and A. Schotter, eds.), The Foundations of Positive and Normative Economics: A Hand Book, pp. 300–19. New York: Oxford University Press.
27. Glazer, J. and Rubinstein, A. (2004). ‘On optimal rules of persuasion’, Econometrica, vol. 72(6), pp. 1715–36.
28. Head, M.L., Holman, L., Lanfear, R., Kahn, A.T. and Jennions, M.D. (2015). ‘The extent and consequences of p-hacking in science’, PLoS Biology, vol. 13(3), pp. 1–15.
29. Henry, E. (2009). ‘Strategic disclosure of research results: the cost of proving your honesty’, Economic Journal, vol. 119(539), pp. 1036–64.
30. Henry, E. and Ottaviani, M. (2014). ‘Research and the approval process: the organization of persuasion’, Working Paper, Sciences Po and Bocconi.
31. Hill, A.B. (1990). ‘Memories of the British streptomycin trial in tuberculosis: The first randomized clinical trial’, Controlled Critical Trials, vol. 11(2), pp. 77–9.
32. Hoffmann, F., Inderst, R. and Ottaviani, M. (2014). ‘Persuasion through selective disclosure: implications for marketing, campaigning, and privacy regulation’, Working Paper, available at: http://pareto.uab.es/research/sempdf/micro/2014/Ottaviani.pdf (last accessed 14 June 2017).
33. Imbens, G. and Rubin, D. (2015). Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction, New York, NY: Cambridge University Press.
34. Ioannidis, J.P.A. (2005). ‘Why most published research findings are false’, Chance, vol. 18(4), pp. 40–7.
35. Ioannidis, J.P.A., Stanley, T.D. and Doucouliagos, H. (2017). ‘The power of bias in economics research’, Economic Journal, vol. 127(605), pp. F236–65.
36. Jadad, A.R. and Enkin, M.W. (2007). Randomized Controlled Trials: Questions, Answers, and Musings, Oxford: BMJ Books, Blackwell.
37. Kamenica, E. and Gentzkow, M. (2011). ‘Bayesian persuasion’, American Economic Review, vol. 101(6), pp. 2590–615.
38. Kaptchuk, T.J. (1998). ‘Intentional ignorance: a history of blind assessment and placebo controls in medicine’, Bulletin of the History of Medicine, vol. 72(3), pp. 389–433.
39. Kolotilin, A., Li, M., Mylovanov, T. and Zapechelnyuk, A. (2015). ‘Persuasion of a privately informed receiver’, Working Paper, available at: http://economics.princeton.edu/wp-content/uploads/2016/08/draft_14FT-mylovanov.pdf (last accessed 14 June 2017).
40. Lacetera, N. and Zirulia, L. (2011). ‘The economics of scientific misconduct’, Journal of Law, Economics, and Organization, vol. 27(3), pp. 568–603.
41. Maniadis, Z., Tufano, F. and List, J.A. (2014). ‘One swallow doesn’t make a summer: new evidence on anchoring effects’, American Economic Review, vol. 104(1), pp. 277–90.
42. Maniadis, Z., Tufano, F. and List, J.A. (2017). ‘To replicate or not to replicate? Exploring reproducibility in economics through the lens of a model and a pilot study’, Economic Journal, vol. 127(605), pp. F209–35.
43. Manski, C. (2013). Public Policy in an Uncertain World: Analysis and Decisions, Cambridge, MA: Harvard University Press.
44. Medical Research Council (1944). ‘Clinical trial of patulin in the common cold’, Lancet, vol. 244(6316), pp. 373–5.
45. Medical Research Council (1948). ‘Streptomycin treatment of pulmonary tuberculosis: a Medical Research Council investigation’, British Medical Journal, vol. 2(4582), pp. 769–82.
46. Neyman, J.S. (1923). ‘On the application of probability theory to agricultural experiments. Essay on principles. Section 9.' Translated in Statistical Science, (1990), vol. 5(4), pp. 465–80.
47. Olken, B.A. (2015). ‘Promises and perils of pre-analysis plans’, Journal of Economic Perspectives, vol. 29(3), pp. 61–80.
48. Rayo, L. and Segal, I. (2010). ‘Optimal information disclosure’, Journal of Political Economy, vol. 118(5), pp. 949–87.
49. Rosenberger, W.F. and Lachin, J.M. (2002). Randomization in Clinical Trials: Theory and Practice, New York, NY: Wiley.
50. Rosenthal, R. (1979). ‘The file drawer problem and tolerance for null results’, Psychological Bulletin, vol. 86(3), pp. 638–41.
51. Rothwell, P.M. (2005), ‘External validity of randomised controlled trials: “To whom do the results of this trial apply?”’, Lancet, vol. 365(9453), pp. 82–93.
52. Rubin, D. (1974). ‘Estimating causal effects of treatments in randomized and nonrandomized studies’, Journal of Educational Psychology, vol. 66(5), pp. 688–701.
53. Rubin, D. (1978). ‘Bayesian inference for causal effects: the role of randomization’, Annals of Statistics, vol. 6(1), pp. 33–58.
54. Rubin, D. (2005). ‘Bayesian inference for causal effects’, in (D. Dey and C.R. Rao, eds.), Handbook of Statistics, Bayesian Thinking Modeling and Computation, vol. 25, pp. 1–16, Amsterdam: Elsevier.
55. Schulz, K.F. (1995). ‘Subverting randomization in controlled trials’, Journal of American Medical Association, vol. 274(18), pp. 1456–8.
56. Schulz, K.F., Chalmers, I., Hayes, R.J. and Altman, D.G. (1995). ‘Empirical evidence of bias: dimensions of methodological quality associated with estimates of treatment effects in controlled trials’, Journal of the American Medical Association, vol. 273(5), pp. 408–12.
57. Simonsohn, U., Nelson, L.D. and Simmons, J.P. (2014). ‘P-curve: a key to the file drawer’, Journal of Experimental Psychology: General, vol. 143(2), pp. 534–47.
58. Tetenov, A. (2015). ‘An economic theory of statistical testing’, Working Paper, available at: https://tetenov.com/Tetenov_hypothesis_testing.pdf (last accessed 14 June 2017).
59. Torgerson, D.J. and Torgerson, C.J. (2008). Designing Randomised Trials in Health, Education and the Social Sciences: An Introduction, New York, NY: Palgrave MacMillan.
60. Weisberg, H.I. (2010). Bias and Causation: Models and Judgement for Valid Comparisons, Hoboken, NJ: Wiley.