The place of experimental design and statistics in the 3Rs

ILAR Journal

Volumn 55, Issue 3, 2014, Pages 477-485

  Parker, Richard M A ^a   Browne, William J ^a  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

3Rs; Animal welfare; Experimental design; Laboratory animals; Reduction; Refinement; Replacement; Statistics

Indexed keywords

ANIMALIA;

ANIMAL; ANIMAL EXPERIMENT; ANIMAL WELFARE; METHODOLOGY;

ANIMAL EXPERIMENTATION; ANIMAL WELFARE; ANIMALS; RESEARCH DESIGN;

EID: 84928188596     PISSN: 10842020     EISSN: 19306180     Source Type: Journal    
DOI: 10.1093/ilar/ilu044     Document Type: Article

References (72)

1. Anon. 2013. Should scientists tell stories? Nat Methods 10:1037-1037.
2. Bacchetti P, Wolf LE, Segal MR, McCulloch CE. 2005. Ethics and sample size. Am J Epidemiol 161:105-110.
3. Balls M. 2007. Alternatives to animal experiments: Time to focus on replacement. AATEX 12:145-154.
4. Bate ST, Clark RA. 2014. The Design and Statistical Analysis of Animal Experiments. Cambridge, UK: Cambridge University Press
5. Bennett CM, Baird AA, Miller MB, Wolford GL. 2009. Neural correlates of interspecies perspective taking in the post-mortem Atlantic Salmon: An argument for multiple comparisons correction. Poster Presented at the 15th Annual Meeting of the Organization for Human Brain Mapping, San Francisco, USA
6. Browne WJ, Golalizadeh Lahi M, Parker RMA. 2009. A Guide to Sample Size Calculations for Random Effect Models via Simulation and the MLPowSim Software Package. Bristol, UK: Centre for Multilevel Modelling, University of Bristol
7. Buchanan-Smith HM, Rennie AE, Vitale A, Pollo S, Prescott MJ, Morton DB. 2005. Harmonising the definition of refinement. Anim Welfare 14:379-384.
8. Burman OHP, Ilyat A, Jones G, Mendl M. 2007. Ultrasonic vocalizations as indicators of welfare for laboratory rats (Rattus norvegicus). Appl Anim Behav Sci 104:116-129.
9. Button KS, Ioannidis JPA, Mokrysz C, Nosek BA, Flint J, Robinson ESJ, Munafo MR. 2013. Power failure: Why small sample size undermines the reliability of neuroscience. Nature Rev Neurosci 14:365-376.
10. Chambers CD. 2013. Registered Reports: A new publishing initiative at Cortex. Cortex 49:609-610.
11. Clark RA, Shoaib M, Hewitt KN, Stanford SC, Bate ST. 2012. A comparison of InVivoStat with other statistical software packages for analysis of data generated from animal experiments. J Psychopharmacol 26:1136-1142.
12. Cohen J. 1988. Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Erlbaum
13. Cohen J. 1992. A power primer. Psychol Bull 112:155-159.
14. Dawkins MS. 1990. From an animal's point of view - motivation, fitness, and animal welfare. Behav Brain Sci 13:1-9.
15. Diggle PJ, Zeger SL. 2010. Editorial. Biostatistics 11:375-375.
16. Dupont WD, Plummer WD. 1990. Power and sample size calculations: A review and computer program. Control Clin Trials 11:116-128.
17. Dwan K, Gamble C, Williamson PR, Kirkham JJ; Reporting Bias Group. 2013. Systematic review of the empirical evidence of study publication bias and outcome reporting bias - an updated review. Plos One 8:e66844.
18. Ellis PD. 2010. The Essential Guide to Effect Sizes: Statistical Power, Meta-Analyses and the Interpretation of Research Results. Cambridge, UK: Cambridge University Press
19. European Commission. 2013. Report from the Commissin to the Council and the European Parliament: Seventh Report on the Statistics on the Number of Animals used for Experimental and other Scientific Purposes in the Member States of the European Union. Brussels: European Commission
20. Faul F, Erdfelder E, Buchner A, Lang A-G. 2009. Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behav Res Meth 41:1149-1160.
21. Faul F, Erdfelder E, Lang A-G, Buchner A. 2007. G*Power 3: A flexible statistical power analysis program for the social, behavioural, and biomedical sciences. Behav Res Meth 39:175-191.
22. Fenwick N, Griffin G, Gauthier C. 2009. The welfare of animals used in science: How the "Three Rs" ethic guides improvements. Can Vet J Rev 50:523-529.
23. Festing MFW, Altman DG. 2002. Guidelines for the design and statistical analysis of experiments using laboratory animals. ILAR J 43:244-258.
24. Festing MFW, Overend P, Gaines Das R, Cortina Borja M, Berdoy M. 2002. The Design of Animal Experiments: Reducing the Use of Animals in Research Through Better Experimental Design. London: Royal Society of Medicine Press
25. Gallup. 2014. Gallup News Service - Gallup Poll Social Series: Values and Beliefs - Final Topline. Washington, DC: Gallup
26. Gelman A, Loken E. 2013. The garden of forking paths: why multiple comparisons can be a problem, even when there is no "fishing expedition" or "p-hacking" and the research hyptothesis was posited ahead of time. [Internet]. Available from: http://www.stat.columbia.edu/~gelman/research/unpublished/p_hacking.pdf
27. Gouveia K, Hurst JL. 2013. Reducing mouse anxiety during handling: Effect of experience with handling tunnels. Plos One 8:e66401.
28. Greenwood VJ, Smith EL, Goldsmith AR, Cuthill IC, Crisp LH, Walter-Swan MB, Bennett ATD. 2004. Does the flicker frequency of fluorescent lighting affect the welfare of captive European starlings? Appl Anim Behav Sci 86:145-159.
29. Groves T, Godlee F. 2012. Open science and reproducible research. Br Med J 344:e4383.
30. Hackam DG, Redelmeier DA. 2006. Translation of research evidence from animals to humans. JAMA 296:1731-1732.
31. Hoenig JM, Heisey DM. 2001. The abuse of power: The pervasive fallacy of power calculations for data analysis. Am Stat 55:19-24.
32. Home Office. 2013. Annual Statistics of Scientific Procedures on Living Animals, Great Britain 2012. London: The Stationery Office
33. Howell DC. 2013. Statistical Methods for Psychology. Canada: Wadsworth Cengage Learning
34. Hurst JL, West RS. 2010. Taming anxiety in laboratory mice. Nat Methods 7:825-U1516.
35. Ioannidis JPA. 2005. Why most published research findings are false. Plos Med 2:696-701.
36. Ipsos MORI. 2012. Views On the Use of Animals in Scientific Research. London: Ipsos MORI
37. Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG. 2010. Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research. Plos Biol 8:e1000412.
38. Kilkenny C, Parsons N, Kadyszewski E, Festing MFW, Cuthill IC, Fry D, Hutton J, Altman DG. 2009. Survey of the quality of experimental design, statistical analysis and reporting of research using animals. Plos One 4:e7824.
39. Kraemer HC, Mintz J, Noda A, Tinklenberg J, Yesavage JA. 2006. Caution regarding the use of pilot studies to guide power calculations for study proposals. Arch Gen Psychiatry 63:484-489.
40. Krzywinski M, Altman N. 2013a. Importance of being uncertain. Nat Methods 10:809-810.
41. Krzywinski M, Altman N. 2013b. Power and sample size. Nat Methods 10:1139-1140.
42. Langley G, Evans T, Holgate ST, Jones A. 2007. Replacing animal experiments: choices, chances and challenges. BioEssays 29:918-926.
43. Lenth RV. 2001. Some practical guidelines for effective sample size determination. Am Stat 55:187-193.
44. Lenth RV. 2006-9. Java Applets for Power and Sample Size [Internet]. Available from: http://www.stat.uiowa.edu/~rlenth/
45. Power Littin K, Acevedo A, Browne W, Edgar J, Mendl M, Owen D, Sherwin C, Wurbel H, Nicol C. 2008. Towards humane end points: behavioural changes precede clinical signs of disease in a Huntington's disease model. Proc R Soc Lond [Biol] 275:1865-1874.
46. Masicampo EJ, Lalande DR. 2012. A peculiar prevalence of p values just below .05. Q J Exp Psychol 65:2271-2279.
47. Munafo M, Noble S, Browne WJ, Brunner D, Button K, Ferreira J, Holmans P, Langbehn D, Lewis G, Lindquist M, Tilling K, Wagenmakers E-J, Blumenstein R. 2014. Scientific rigor and the art of motorcycle maintenance. Nat Biotech 32:871-873.
48. Munafo MR, Strain E. 2014. Registered Reports: A new submission format at drug and alcohol dependence. Drug and Alcohol Depend 137:1-2.
49. Nagel T. 1974. What is it like to be a bat. Philosoph Rev 83:435-450.
50. Nakagawa S, Cuthill IC. 2007. Effect size, confidence interval and statistical significance: a practical guide for biologists. Biol Rev 82:591-605.
51. Nakagawa S, Foster TM. 2004. The case against retrospective statistical power analyses with an introduction to power analysis. Acta Ethologica 7:103-108.
52. NC3Rs. 2014. The 3Rs [Internet]. Available from: http://www.nc3rs.org.uk/the-3rs
53. OECD. 2005. Guidance Document no. 34 on the Validation and International Acceptance of New or Updated Test Methods for Hazard Assessment. Paris: OECD
54. Perel P, Roberts I, Sena E, Wheble P, Briscoe C, Sandercock P, Macleod M, Mignini LE, Jayaram P, Khan KS. 2007. Comparison of treatment effects between animal experiments and clinical trials: systematic review. Br Med J 334:197-200.
55. Perlman JE, Bloomsmith MA, Whittaker MA, McMillan JL, Minier DE, McCowan B. 2012. Implementing positive reinforcement animal training programs at primate laboratories. Appl Anim Behav Sci 137:114-126.
56. Richmond J. 2010. The Three Rs. In: Hubrecht R, Kirkwood J, editors. The UFAWHandbook on the Care and Management of Laboratory and Other Research Animals. 8th ed. p. 5-22.
57. Rosenthal R. 1979. The file drawer problem and tolerance for null results. Psychol Bull 86:638-641.
58. Russell WMS, Burch RL. 1959. The Principles of Humane Experimental Technique. London: Methuen & Co. Ltd
59. Sena ES, van der Worp HB, Bath PMW, Howells DW, Macleod MR. 2010. Publication bias in reports of animal stroke studies leads to major overstatement of efficacy. Plos Biol 8:e1000344.
60. Sharpe D. 2013. Why the resistance to statistical innovations? bridging the communication gap. Psychol Meth 18:572-582.
61. Shaw R, Festing MFW, Peers I, Furlong L. 2002. Use of factorial designs to optimize animals experiments and reduce animal use. ILAR J 43:223-232.
62. Sherwin CM. 2001. Can invertebrates suffer? Or, how robust is argument-by-analogy? Anim Welfare 10:S103-S118.
63. Simmons JP, Nelson LD, Simonsohn U. 2011. False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol Sci 22:1359-1366.
64. Sorge RE, Martin LJ, Isbester KA, Sotocinal SG, Rosen S, Tuttle AH, Wieskopf JS, Acland EL, Dokova A, Kadoura B, Leger P, Mapplebeck JC, McPhail M, Delaney A, Wigerblad G, Schumann AP, Quinn T, Frasnelli J, Svensson CI, Sternberg WF, Mogil JS. 2014. Olfactory exposure to males, including men, causes stress and related analgesia in rodents. Nat Methods 11:629-632.
65. Statistical Solutions. 2014. nQuery Advisor + nTerim. Cork, Ireland: Statistical Solutions.
66. Taylor K, Gordon N, Langley G, Higgins W. 2008. Estimates for worldwide laboratory animal use in 2005. Altern Lab Anim: ATLA 36:327-342.
67. ter Riet G, Korevaar DA, Leenaars M, Sterk PJ, Van Noorden CJF, Bouter LM, Lutter R, Elferink RPO, Hooft L. 2012. Publication bias in laboratory animal research: A survey on magnitude, drivers, consequences and potential solutions. Plos One 7:e43404.
68. Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, Robson R, Thabane M, Giangregorio L, Goldsmith CH. 2010. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol 10:1.
69. van derWorp HB, Howells DW, Sena ES, Porritt MJ, Rewell S, O'Collins V, Macleod MR. 2010. Can animal models of disease reliably inform human studies? Plos Med 7:e1000245.
70. Wagenmakers EJ, Wetzels R, Borsboom D, van der Maas HLJ. 2011. Why psychologists must change the way they analyze their data: the case of psi: comment on Bem (2011). J Pers Soc Psychol 100:426-432.
71. Wolfensohn S, Hawkins P, Lilley E, Anthony D, Chambers C, Lane S, Lawton M, Robinson S, Voipio H-M, Woodhall G. 2013. Reducing suffering in animal models and procedures involving seizures, convulsions and epilepsy. J Pharmacol Toxicol Meth 67:9-15.
72. Workman P, Aboagye EO, Balkwill F, Balmain A, Bruder G, Chaplin DJ, Double JA, Everitt J, Farningham DAH, Glennie MJ, Kelland LR, Robinson V, Stratford IJ, Tozer GM, Watson S, Wedge SR, Eccles SA, Navaratnam V, Ryder S. 2010. Guidelines for the welfare and use of animals in cancer research. Br J Cancer 102:1555-1577.