Research Synthesis Methods in an Age of Globalized Risks: Lessons from the Global Burden of Foodborne Disease Expert Elicitation

Risk Analysis

Volumn 36, Issue 2, 2016, Pages 191-202

  Hoffmann, Sandra ^a,q   Hald, Tine ^b   Angulo, Fred ^c   Hamzah, Wan Mansor Bin ^d   Bellinger, David ^e   Black, Robert ^f   de Silva, Nilanthi ^g   Döpfer, Dörte ^h   Havelaar, Arie ⁱ   Gibb, Herman ^j   Kasuga, Fumiko ^k   Lake, Rob ^l   Rokni, Muhammad B ^m   Speybroeck, Niko ⁿ   Aspinall, Willy ^o   Cooke, Roger ^p   Devleesschauwer, Brecht ⁱ   Pires, Sara M ^b  

^a ECONOMIC RESEARCH SERVICE   (United States)

^b TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

^c CENTERS FOR DISEASE CONTROL AND PREVENTION   (United States)

^d MINISTRY OF HEALTH   (Malaysia)

^e HARVARD SCHOOL OF PUBLIC HEALTH   (United States)

^f JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

^g UNIVERSITY OF KELANIYA   (Sri Lanka)

^h UNIVERSITY OF WISCONSIN MADISON   (United States)

ⁱ UNIVERSITY OF FLORIDA   (United States)

^j Gibb Epidemiology Consulting LLC   (United States)

^k NATIONAL INSTITUTE OF HEALTH SCIENCES   (Japan)

^l INSTITUTE OF ENVIRONMENTAL SCIENCE AND RESEARCH   (New Zealand)

^m TEHRAN UNIVERSITY OF MEDICAL SCIENCES   (Iran)

ⁿ UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^o ASPINALL AND ASSOCIATES   (United Kingdom)

^p RESOURCES FOR THE FUTURE   (United States)

^q U S DEPARTMENT OF AGRICULTURE   (United States)

more..

Author keywords

Disease burden; Expert elicitation; Expert judgment; Exposure estimates; Foodborne illness; Research synthesis; Source attribution; Systematic review; Uncertainty quantification

Indexed keywords

RISK ASSESSMENT; UNCERTAINTY ANALYSIS;

DISEASE BURDENS; EXPERT ELICITATION; EXPERT JUDGMENT; EXPOSURE ESTIMATES; FOOD-BORNE ILLNESS; RESEARCH SYNTHESIS; SOURCE ATTRIBUTION; SYSTEMATIC REVIEW; UNCERTAINTY QUANTIFICATIONS;

RISK ANALYSIS;

DISEASE INCIDENCE; EPIDEMIOLOGY; EXPERT SYSTEM; FOOD POISONING; GLOBAL PERSPECTIVE; PUBLIC HEALTH; RESEARCH WORK; RISK ASSESSMENT; UNCERTAINTY ANALYSIS; WORLD HEALTH ORGANIZATION;

CALIBRATION; FOOD CONTROL; FOOD SAFETY; FOODBORNE DISEASES; GEOGRAPHY; HUMAN; INFORMATION PROCESSING; INTERNATIONAL COOPERATION; PROCEDURES; PROGRAM DEVELOPMENT; PUBLIC HEALTH; RISK ASSESSMENT; WORLD HEALTH ORGANIZATION;

CALIBRATION; DATA COLLECTION; FOOD MICROBIOLOGY; FOOD SAFETY; FOODBORNE DISEASES; GEOGRAPHY; HUMANS; INTERNATIONALITY; PROGRAM DEVELOPMENT; PUBLIC HEALTH; RISK ASSESSMENT; WORLD HEALTH ORGANIZATION;

EID: 84959130476     PISSN: 02724332     EISSN: 15396924     Source Type: Journal    
DOI: 10.1111/risa.12385     Document Type: Article

References (50)

1. Robinson L, Hammitt J. Introduction to the special series on research synthesis: A cross-disciplinary approach. Risk Analysis, 2015; 35(6):963-970.
2. World Health Organization. WHO initiative to estimate the global burden of foodborne diseases: First formal meeting of the foodborne disease burden epidemiology reference group. Geneva (Switzerland) Nov 26-28, 2007, 2008.
3. Havelaar A, Cawthorne A, Angulo F, Bellinger D, Corrigan T, Cravioto A, Gibb H, Hald T, Ehiri J, Kirk M, Lake R, Praet N, Speybroeck N, de Silva N, Stein C, Torgerson P, Kuchenmüller T. WHO initiative to estimate the global burden of foodborne diseases. Lancet, 2013; 381:S59.
4. Kuchenmüller T, Hird S, Stein C, Cramarz P, Nada A, Havelaar A. Estimating the global burden of foodborne diseases-A collaborative effort. Eurosurveillance, 2009; 14(18):1-4.
5. Scallan, E, Hoekstra R, Angulo F, Tauxe R, Widdowson M, Roy S, Jones J, Griffin P. Foodborne illness acquired in the United States-Major pathogens. Emerging Infectious Disease, 2011; 17(1):7-15.
6. Scallan E, Griffin P, Angulo F, Tauxe R, Hoekstra R. Foodborne illness acquired in the United States-Unspecified agents. Emerging Infectious Disease, 2011; 17(1):16-22.
7. Hoffmann S, Batz M, Morris JG Jr. Annual cost of illness and quality-adjusted life year losses in the United States due to 14 foodborne pathogens. Journal of Food Protection, 2012; 75(7):1291-1302.
8. Stein C, Kuchenmüller T, Hendrickx S, Prüss-Ustün A, Wolfson W, Engels D, Schlundt J. The global burden of disease assessments-WHO is responsible? PLoS Neglected Tropical Diseases, 2007; 1(3):e161.
9. World Health Organization. WHO initiative to estimate the global burden of foodborne diseases: A summary document, 2008.
10. U.N. Food and Agricultural Organization and World Health Organization (FAO/WHO). The role of food safety in health and development. Geneva, Switzerland: WHO, 1984. WHO Technical Report Series 705. Available at: http://apps.who.int/iris/bitstream/10665/38709/1/WHO_TRS_705.pdf?ua=1, Accessed July 25, 2014.
11. Hoffmann S, Harder W. Food safety and risk governance in globalized markets. Health Matrix: Journal of Law-Medicine, 2010; 20:5-54.
12. Devleesschauwer B, Havelaar A, Maertens de Noordhout C, Haagsma J, Praet N, Dorny P, Duchateau L, Torgerson P, Van Oyen H, Speybroeck N. Calculating disability-adjusted life years to quantify burden of disease. International Journal of Public Health, 2014; 59:565-569.
13. Murray C. Quantifying the burden of disease: The technical basis for disability-adjusted life years. Bulletin World Health Organization, 1994; 72(3):429-445.
14. Salomon J, Vos T, Hogan D, et al. Common values in assessing health outcomes from disease and injury: Disability weights measurement study for the global burden of disease study 2010. Lancet, 2012; 380(9859):2129-2143.
15. Carabin H, Ndimubanzi P, Budke C, Nguyen H, Qian Y, et al. Clinical manifestations associated with neurocysticercosis: A systematic review. PLoS Neglected Tropical Diseases, 2011; 5(5):e1152.
16. Fischer Walker C, Sack D, Black R. Etiology of diarrhea in older children, adolescents and adults: A systematic review. PLoS Neglected Tropical Diseases, 2010; 4(8):e768.
17. Fürst, T, Keiser J, Utzinger J. Global burden of human food-borne trematodiasis: A systematic review and meta-analysis. Lancet Infectious Disease, 2012; 12(3):210-221.
18. Ndimubanzi P, Carabin H, Budke C, Nguyen H, Qian Y-J, et al. A systematic review of the frequency of neurocyticercosis with a focus on people with epilepsy. PLoS Neglected Tropical Diseases, 2010; 4(11):e870.
19. World Health Organization. FERG strategic planning meeting and kick-off event of the pilot country studies in Durres, Albania, Nov 7-10, 2011, 2011. Available at: http://www.who.int/foodsafety/foodborne_disease/ferg_albania/en/, Accessed July 25, 2014.
20. European Food Safety Agency. Overview of the procedures currently used at EFSA for the assessment of dietary exposure to different chemical substances. EFSA Journal, 2011; 9(12):2490-2523.
21. Pires S. Assessing the applicability of currently available methods for attributing foodborne disease to sources, including food and food commodities. Foodborne Pathogens and Disease, 2013; 10(3):206-213.
22. U.S. Centers for Disease Control and Prevention (CDC). Interagency Food Safety Analytics Collaboration (IFSAC), 2014. Available at: http://www.cdc.gov/foodsafety/ifsac/index.html, Accessed July 25, 2014.
23. Aspinall W. A route to more tractable expert advice. Nature, 2010; 463:294-295.
24. Van der Fels-Klerx H, Cooke R, Nauta M, Goossens L, Havelaar A. A structured expert judgment study for a model of Campylobacter transmission during broiler-chicken processing. Risk Analysis, 2005; 25(1):109-124.
25. Havelaar A, Vargas Galindo A, Kurowicka D, Cooke R. Attribution of foodborne pathogens using structured expert elicitation. Foodborne Pathogens and Disease, 2008; 5(5):649-659.
26. Flandoli F, Giorgi E, Aspinall W, Neri A. Comparison of a new expert elicitation model with the classical model, equal weights and single experts, using a cross-validation technique. Reliability Engineering & System Safety, 2011; 96(10):1291-1310.
27. Cooke R. Experts in Uncertainty: Opinion and Subjective Probability in Science. New York: Oxford University Press, 1991.
28. Cooke R, Goossen L. TU Delft expert judgment data base. Reliability Engineering and System Safety, 2007; 93:657-674.
29. Goodman L. Snowball sampling. Annals of Mathematical Statistics, 1961; 31(1):148-170.
30. Ezzati M, Lopez A, Rodgers A, Vander Hoorn S, Murray C, and the Comparative Risk Assessment Collaborating Group. Selected major risk factors and global and regional burden of disease. Lancet, 2002; 360:1347-1360.
31. Atkinson R, Flint J. Encyclopedia of Social Science Research Methods. Thousand Oaks, CA: SAGE Publications, Inc., 2004.
32. Bamber J, Aspinall W. An expert judgement assessment of future sea level rise from the ice sheets. Nature Climate Change, 2013; 3:424-427.
33. Baxte P, Aspinall W, Neri A, Zuccaro G, Spence R, Cioni R, Woo G. Emergency planning and mitigation at Vesuvius: A new evidence-based approach. Volcanology and Geothermal Research, 2008; 178(3):454-473.
34. Tyshenko M, ElSaadany S, Oraby T, Darshan S, Catford A, Aspinall W, Cooke R, Krewski D. Expert judgement and re-elicitation for prion disease risk uncertainties. International Journal of Risk Assessment and Management, 2012; 16(1):1466-8297.
35. U.N. Food and Agricultural Organization (FAO). Food balance sheets. Available at http://faostat.fao.org/site/354/default.aspx, Accessed July 25, 2014.
36. World Health Observatory Data Repository. Under-five mortality due to diarrhea. Available at http://apps.who.int/gho/data/node.main, Accessed 24 June 14, 2014.
37. WHO/UNICEF Joint Monitoring Programme for Water Supply and Sanitation. Progress on drinking water and sanitation: Joint Monitoring Programme 2012 update. New York: WHO/UNICEF, March 2012. Available at http://www.who.int/water_sanitation_health/publications/2012/jmp_report/en/, Accessed October 29, 2014.
38. Eggstaff J, Mazzuchi T, Sarkani S. 2014. The effect of the number of seed variables on the performance of Cooketicle/pii/S0951832013002251" ort/en/" d at http://apps.who.int/gh 2014; 121:72-82.
39. Christopher W, Karvetski C, Olson K, Mandel D, Twardy C. Probabilistic coherence weighting for optimizing expert forecasts. Decision Analysis, 2013; 10(4):305-326.
40. Jose V, Grushka-Cockayne Y, Lichtendahl K Jr. Trimmed opinion pools and the crowd's calibration problem. Management Science, 2013; 60(2):463-475.
41. Albert I, Donnet S, Guihenneuc-Jouyaux C, Low-Choy S, Mengersen K, Rousseau J. Combining expert opinions in prior elicitation. Bayesian Analysis, 2012; 7(3):503-532.
42. Clemen R, Winkler R. Aggregating probability distributions. Pp. 154-176 in Edwards W, Miles R Jr., von Winterfeldt D, (eds). Advances in Decision Analysis: From Foundations to Applications. New York: Cambridge University Press, 2007.
43. Lin S, Bier V. A study of expert overconfidence. Reliability Engineering and System Safety, 2008; 93(5):711-721.
44. Lin S, Huang S. Effects of overconfidence and dependence on aggregated probability judgments. Journal of Modelling in Management, 2012; 7(1):6-22.
45. Lin S-W, Cheng C-H. Can Cooke's Model Sift Out Better Experts and Produce Well-Calibrated Aggregated Probabilities? Department of Business Administration, Yuan Ze University, Chung-Li, Taiwan Proceedings of the 2008 IEEE IEEM, 2008.
46. Cooke R. Pitfalls of ROAT cross validation comment on effects of overconfidence and dependence on aggregated probability judgments. Journal of Modelling in Management 2012; 7(1):20-22.
47. Clemen R. Comment on Cooke's classical method. Reliability Engineering & System Safety, 2008; 93(5):760-765.
48. Cooke R. Response to comments, special issue on expert judgment. Reliability Engineering & System Safety, 2008a; 93(5):775-777.
49. Cooke R, lson A. Cross Validation for Structured Expert Judgment with the Classical Model with Supplementary Online Material, 2015. Discussion Paper Available at: http://rogermcooke.net.
50. Baker E, Bosetti V, Jenni K, Ricci E. Facing the Experts: Survey Mode And Expert Elicitation, Milan, Italy; Fondazione Eni Enrico Mattei Note di Lavoro, Jan 2014. Available at: http://www.feem.it/getpage.aspx?id=6046&sez=Publications&padre=73 October 27, 2014.