Systematic reviews: Separating fact from fiction

Environment International

Volumn 92-93, Issue , 2016, Pages 578-584

  Haddaway, Neal R ^a   Bilotta, Gary S ^b  

^a ROYAL SWEDISH ACADEMY OF SCIENCES   (Sweden)

^b UNIVERSITY OF BRIGHTON   (United Kingdom)

Author keywords

Evidence reviews; Evidence synthesis; Evidence based medicine; Evidence based practice; Systematic review

Indexed keywords

DECISION MAKING; ENVIRONMENTAL MANAGEMENT; HEALTH RISKS;

CHEMICAL RISK ASSESSMENT; DECISION MAKERS; ENVIRONMENTAL HEALTH; EVIDENCE-BASED MEDICINE; EVIDENCE-BASED PRACTICES; INTERNATIONAL DEVELOPMENT; SCIENTIFIC LITERATURE; SYSTEMATIC REVIEW;

RISK ASSESSMENT;

ENVIRONMENTAL MANAGEMENT; MEDICINE; METHODOLOGY; RISK ASSESSMENT;

ARTICLE; CHEMICAL ACCIDENT; COST EFFECTIVENESS ANALYSIS; DECISION MAKING; ENVIRONMENTAL HEALTH; ENVIRONMENTAL MONITORING; ENVIRONMENTAL PARAMETERS; ENVIRONMENTAL PLANNING; ENVIRONMENTAL PROTECTION; ENVIRONMENTAL SUSTAINABILITY; EVIDENCE BASED MEDICINE; MEDICAL RESEARCH; METHODOLOGY; PREVALENCE; PRIORITY JOURNAL; PUBLICATION; QUANTITATIVE ANALYSIS; RISK ASSESSMENT; SYSTEMATIC REVIEW (TOPIC); HUMAN; LITERATURE; POLLUTANT; PROCEDURES; TOXICITY;

DECISION MAKING; ENVIRONMENTAL HEALTH; ENVIRONMENTAL POLLUTANTS; HUMANS; REVIEW LITERATURE AS TOPIC; RISK ASSESSMENT;

EID: 84941687407     PISSN: 01604120     EISSN: 18736750     Source Type: Journal    
DOI: 10.1016/j.envint.2015.07.011     Document Type: Article

References (57)

1. Adams, J.A., Galloway, T.S., Mondal, D., Esteves, S.C., Mathews, F., Effect of mobile telephones on sperm quality: a systematic review and meta-analysis. Environ. Int. 70 (2014), 106–112.
2. Alderman, K., Turner, L.R., Tong, S., Floods and human health: a systematic review. Environ. Int. 47 (2012), 37–47.
3. Bastian, H., Glasziou, P., Chalmers, I., Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?. PLoS Med., 2010, 7.e1000326, 10.1371/journal.pmed.1000326.
4. Bates, S., Coren, E., SCIE Systematic map report 1: The extent and impact of parental mental health problems on families and the acceptability, accessibility and effectiveness of interventions. Accessed 10th February 2015 http://www.scie.org.uk/publications/map/map01.asp, 2006.
5. Bernes, Claes, Carpenter, Stephen R., Gårdmark, Anna, Larsson, Per, Persson, Lennart, Skov, Christian, Speed, James DM, Van Donk, Ellen, What is the influence of a reduction of planktivorous and benthivorous fish on water quality in temperate eutrophic lakes? A systematic review. Environmental Evidence, 4(1), 2015, 7.
6. Bilotta, G.S., Milner, A.M., Boyd, I., On the use of systematic reviews to inform environmental policies. Environ. Sci. Pol. 42 (2014), 67–77.
7. Bilotta, G.S., Milner, A.M., Boyd, I., Quality assessment tools for evidence from environmental science. Environ. Evid., 3, 2014, 14, 10.1186/2047-2382-3-14.
8. Bilotta, G.S., Boyd, I.L., Milner, A.M., How to increase the potential policy impact of environmental science research. Environ. Sci. Eur., 27, 2015, 9, 10.1186/s12302-015-0041-x.
9. Collaboration for Environmental Evidence, Guidelines for Systematic Review and Evidence Synthesis in Environmental Management. Version 4.2. Collaboration for Environmental Evidence:, 2013 www.environmentalevidence.org/Documents/Guidelines/Guidelines4.2.pdf.
10. Collins, A., Miller, J., Coughlin, D., Kirk, S., The Production of Quick Scoping Reviews and Rapid Evidence Assessments: A How to Guide. Beta Version 2. 2014, UK Defra, Joint Water Evidence Group.
11. Chalmers, T.C., Effects of ascorbic acid on the common cold. An evaluation of the evidence. Am. J. Med. 58 (1975), 532–536.
12. Chalmers, I., Dickersin, K., Chalmers, T.C., Getting to grips with Archie Cochrane's agenda. BMJ 305 (1992), 786–788.
13. Cochran, W.G., Diaconis, P., Donner, A.P., Hoaglin, D.C., O'Connor, N.E., Peterson, O.L., Rosenoer, V.M., Experiments in surgical treatments of duodenal ulcer. Bunker, J.P., Barnes, B.A., Mosteller, F., (eds.) Costs, Risks and Benefits of Surgery, 1977, Oxford University Press, Oxford, 176–197.
14. Cochrane, A.L., 1931–1971: a critical review, with particular reference to the medical profession. Cochrane, A.L., Teeling-Smith, G., Wells, N.E., (eds.) Medicines for the Year 2000, 1979, Office of Health Economics, London, 1–11.
15. Dafforn, K.A., Glasby, T.M., Airoldi, L., Rivero, N.K., Mayer-Pinot, M., Johnston, E.L., Marine urbanization: an ecological framework for designing multifunctional artificial structures. Front. Ecol. Environ. 13 (2015), 82–90, 10.1890/140050.
16. Davies, P., Boruch, R., The Campbell Collaboration: does for public policy what Cochrane does for health. Br. Med. J. 323 (2001), 294–295.
17. Deeks, J.J., Higgins, J.P.T., Altman, D.G., Analysing Data and Undertaking Meta-Analyses. In: Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (Updated March 2011). 2011, The Cochrane Collaboration, London Chapter 9.
18. Doerr, E.D., Dorrough, J., Davies, M.J., Doerr, V.A.J., McIntyre, S., Maximizing the value of systematic reviews in ecology when data or resources are limited. Austral Ecol. 40 (2014), 1–11.
19. Evans, C., Burden, A., Morrison, R., Baird, A., Callaghan, N., Chapman, P., Cumming, A., Dixon, S., Evans, J., Gauci, V., Haddaway, N.R., Heppell, K., Healey, J., Holden, J., Hughes, S., Kaduk, J., Jones, D., Matthews, R., Menichino, N., Misselbrook, T., Page, S., Peacock, M., Pullin, A., Rayment, M., Ridley, L., Robinson, I., Stanley, K., Ward, H., Archer, E., Worrall, F., Interim Report on Project SP1210: lowland peatland systems in England and Wales — evaluating greenhouse gas fluxes and carbon balances. First Annual Data Report, March, 2014.
20. Evans, D., Popova, E., What really works to improve learning in developing countries? An analysis of divergent findings in systematic reviews. World Bank Policy Research Working Paper 7203, 2015.
21. Fergusson, D., Glass, K., Hutton, B., Shapiro, S., Randomized controlled trials of aprotinin in cardiac surgery: could clinical equipoise have stopped the bleeding?. Clin. Trials 2 (2005), 218–232.
22. Fong, C.J., Murphy, K.M., Westbrook, J.D., Markle, M.M., Behavioral, Psychological, Educational, and Vocational Interventions to Facilitate Employment Outcomes for Cancer Survivors: A Systematic Review. Campbell Systematic Reviews, 11, 2015, 5, 10.4073/csr.2015.5.
23. Freeman, S.R., Williams, H.C., Dellavalle, R.P., The increasing importance of systematic reviews in clinical dermatology research and publication. J. Investig. Dermatol. 126 (2006), 2357–2360.
24. Gilbert, R., Salanti, G., Harden, M., See, S., Infant sleeping position and the sudden infant death syndrome: systematic review of observational studies and historical review of recommendations from 1940 to 2002. Int. J. Epidemiol. 34 (2005), 874–887.
25. Glenton, C., Colvin, C.J., Carlsen, B., Swartz, A., Lewin, S., Noyes, J., Rashidian, A., Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database Syst. Rev., 10, 2013, CD010414, 10.1002/14651858.CD010414.pub2.
26. Goldacre, B., What the Tamiflu saga tells us about drug trials and big pharma. The Guardian 10th April, 2014 http://www.theguardian.com/business/2014/apr/10/tamiflu-saga-drug-trials-big-pharma.
27. Gülmezoglu, A.M., Chandler, J., Shepperd, S., Pantoja, T., Reviews of qualitative evidence: a new milestone for Cochrane. Cochrane Database Syst. Rev., 2013, ED000073, 10.1002/14651858.ED000073.
28. Haddaway, N., A call for better reporting of conservation research data for use in meta-analyses. Conserv. Biol., 2015, 10.1111/cobi.12449.
29. Haddaway, N.R., Bayliss, H.R., Clarification on the applicability of systematic reviews. Front. Ecol. Environ., 13, 2015, 129, 10.1890/15.WB.003.
30. Haddaway, N.R., Burden, A., Evans, C.D., Healey, J.R., Jones, D.L., Dalrymple, S.E., Pullin, A.S., Evaluating effects of land management on greenhouse gas fluxes and carbon balances in boreo-temperate lowland peatland systems. Environmental Evidence, 3(1), 2014, 5.
31. Haynes, L., Goldacre, B., Torgerson, D., Test, Learn, Adapt: Developing Public Policy with Randomised Controlled Trials. 2012, Cabinet Office: Behavioural Insights Team.
32. Jefferson, T., Jones, M.A., Doshi, P., Del Mar, C.B., Hama, R., Thompson, M.J., Spencer, E.A., Onakpoya, I.J., Mahtani, K.R., Nunan, D., Howick, J., Heneghan, C.J., Neuraminidase inhibitors for preventing and treating influenza in adults and children. Cochrane Database Syst. Rev., 2014, CD008965, 10.1002/14651858.CD008965.pub4.
33. Johnson, P.I., Sutton, P., Atchley, D.S., Koustas, E., Lam, J., Sen, S., Robinson, K.A., Axelrad, D.A., Woodruff, T.J., The navigation guide—evidence-based medicine meets environmental health: systematic review of human evidence for PFOA effects on fetal growth. Environ. Health Perspect. 122 (2014), 1028–1039, 10.1289/ehp.1307893.
34. Kalra, N., Newman, M., A Systematic map of the Research on the Relationship Between Obesity and Sedentary Behaviour in Young People. Technical report, 2009, EPPI-Centre, Institute of Education, London.
35. Koustas, E., Lam, J., Sutton, P., Johnson, P.I., Atchley, D.S., Sen, S., Robinson, K.A., Axelrad, D.A., Woodruff, T.J., The navigation guide—evidence-based medicine meets environmental health: systematic review of nonhuman evidence for PFOA effects on fetal growth. Environ. Health Perspect. 122 (2014), 1015–1027.
36. Lam, J., Koustas, E., Sutton, P., Johnson, P.I., Atchley, D.S., Sen, S., Robinson, K.A., Axelrad, D.A., Woodruff, T.J., The navigation guide—evidence-based medicine meets environmental health: integration of animal and human evidence for PFOA effects on fetal growth. Environ. Health Perspect. 122 (2014), 1040–1051.
37. Langer, L., Haddaway, N., Land, M., Losing sight in the jungle of reviews: a comment on the system behind ‘systematic reviews’. Africa Evidence Network. http://www.africaevidencenetwork.org/loosing-sight-in-the-jungle-of-reviews-a-comment-on-the-system-behind-systematic-reviews/, 2015 (Accessed 27/06/2015).
38. Lind, J., A treatise of the scurvy in three parts. Containing an inquiry into the nature, causes and cure of that disease, together with a critical and chronological view of what has been published on the subject. 1753, Miller, London.
39. Liu, J.C., Pereira, G., Uhl, S.A., Bravo, M.A., Bell, M.L., A systematic review of the physical health impacts from non-occupational exposure to wildfire smoke. Environ. Res. 136 (2015), 120–132.
40. McDonagh, M.S., Whiting, P.F., Wilson, P.M., Sutton, A.J., Chestnutt, I., Cooper, J., Misso, K., Bradley, M., Treasure, E., Kleijnen, J., Systematic review of water fluoridation. BMJ 321 (2000), 855–859.
41. Miller, J., Rees, G., Warnaars, T., Young, G., Collins, D., Shrestha, A., What is the evidence for glacial shrinkage across the Himalayas?. CEE Library, 2013 CEE review10-008. www.environmentalevidence.org/SR10008.html.
42. Petrokofsky, G., Kanamaru, H., Achard, F., Goetz, S.J., Joosten, H., Holmgren, P., Lehtonen, A., MCS, M., ASP, P., Wattenbach, M., Comparison of methods for measuring and assessing carbon stocks and carbon stock changes in terrestrial carbon pools. How do the accuracy and precision of current methods compare? A systematic review protocol. Environ. Evid., 1, 2012, 6.
43. Petticrew, M., Systematic reviews from astronomy to zoology: myths and misconceptions. BMJ 322 (2001), 98–101.
44. Petticrew, M., Roberts, H., Systematic Reviews in the Social Sciences: A Practical Guide. 2008, John Wiley & Sons, Oxford.
45. Pullin, A.S., Knight, T.M., Assessing conservation management's evidence base: a survey of management-plan compilers in the United Kingdom and Australia. Conserv. Biol. 19 (2005), 1986–1989.
46. Pullin, A.S., Knight, T.M., Time to build capacity for evidence synthesis in environmental management. Environ. Evid. 2 (2013), 21–22.
47. Pullin, A.S., Bangpan, M., Dalrymple, S.E., Dickson, K., Haddaway, N.R., Healey, J.R., Hauari, H., Hockley, N., Jones, J.P.G., Knight, T., Vigurs, C., Oliver, S., Human well-being impacts of terrestrial protected areas. Environ. Evid., 2, 2013, 19.
48. Roe, D., Fancourt, M., Sandbrook, C., Sibanda, M., Giuliani, A., Gordon-Maclean, A., Which components or attributes of biodiversity influence which dimensions of poverty?. Environ. Evid., 3, 2014, 3.
49. Samii, C., Lisiecki, M., Kulkarni, P., Paler, L., Chavis, L., Effects of Decentralized Forest Management (DFM) on deforestation and poverty in low and middle income countries: a systematic review. Campbell Syst. Rev., 10, 2014, 10.4073/csr.2014.10.
50. Samii, C., Lisiecki, M., Kulkarni, P., Paler, L., Chavis, L., Effects of Payment for Environmental Services (PES) on deforestation and poverty in low and middle income countries: a systematic review. CEE Library, 2014 CEE 13-015b.
51. Schinasi, L., Leon, M.E., Non-Hodgkin lymphoma and occupational exposure to agricultural pesticide chemical groups and active ingredients: a systematic review and meta-analysis. Int. J. Environ. Res. Public Health 11 (2014), 4449–4527.
52. Scott, I., Greenberg, P., Poole, P., Campbell, D., Cautionary tales in the interpretation of systematic reviews of therapy trials. Intern. Med. J. 36 (2006), 587–599.
53. Shah, P.S., Balkhair, T., Air pollution and birth outcomes: a systematic review. Environ. Int. 37 (2011), 498–516.
54. Shemilt, I., Mugford, M., Byford, S., Drummond, M., Eisenstein, E., Knapp, M., Mallender, J., McDaid, D., Vale, L., Walker, D., Chapter 15: incorporating economics evidence. JPT, H., Green, S., (eds.) Cochrane Handbook for Systematic Reviews of Interventions, 2008 Version 5.0.1 [updated September 2008].
55. Smith, M.L., Glass, G.V., Meta-analysis of psychotherapy outcome studies. Am. Psychoanal. 32 (1977), 752–760.
56. Stjernswärd, J., Decreased survival related to irradiation postoperatively in early breast cancer. Lancet 304 (1974), 1285–1286.
57. Weller, S.C., Davis-Beaty, K., Condom effectiveness in reducing heterosexual HIV transmission. Cochrane Database Syst. Rev., 1, 2002, CD003255, 10.1002/14651858.CD003255.