The relationship between return on investment and quality of study methodology in workplace health promotion programs

American Journal of Health Promotion

Volumn 28, Issue 6, 2014, Pages 347-363

  Baxter, Siyan ^a   Sanderson, Kristy ^a   Venn, Alison J ^a   Blizzard, C Leigh ^a   Palmer, Andrew J ^a  

^a UNIVERSITY OF TASMANIA   (Australia)

Author keywords

Cost Benefit Analysis; Economic Evaluation; Health Promotion; Meta analysis Review; Occupational Health; Quality Appraisal; Return on Investment; Workplace

Indexed keywords

COST BENEFIT ANALYSIS; HEALTH PROMOTION; HUMAN; METHODOLOGY; OCCUPATIONAL HEALTH; WORKPLACE;

COST-BENEFIT ANALYSIS; HEALTH PROMOTION; HUMANS; OCCUPATIONAL HEALTH; RESEARCH DESIGN; WORKPLACE;

EID: 84903983360     PISSN: 08901171     EISSN: None     Source Type: Journal    
DOI: 10.4278/ajhp.130731-LIT-395     Document Type: Article

References (124)

1. Lerner D, Rodday AM, Cohen JT, Rogers WH. A systematic review of the evidence concerning the economic impact of employee-focused health promotion and wellness programs. J Occup Environ Med. 2013;55:209-222.
2. Warner KE, Wickizer TM, Wolfe RA, et al. Economic implications of workplace health promotion programs: review of the literature. J Occup Med. 1988;30:106-112.
3. van Dongen JM, Proper KI, van Wier MF, et al. Systematic review on the financial return of worksite health promotion programmes aimed at improving nutrition and/or increasing physical activity. Obes Rev. 2011;12:1031-1049.
4. Baicker K, Cutler D, Song Z. Workplace wellness programs can generate savings. Health Aff (Millwood). 2010;29:304-311.
5. Chapman LS. Meta-evaluation of worksite health promotion economic return studies: 2012 update. Am J Health Promot. 2012;26:TAHP1-TAHP12.
6. Goetzel RZ, Juday TR, Ozminkowski RJ. What's the ROI. A systematic review of return on investment (ROI) studies of corporate health and productivity management initiatives. AWHP's Worksite Health. 1999:12-21.
7. Aldana SG. Financial impact of health promotion programs: a comprehensive review of the literature. Am J Health Promot. 2001;15:296-320.
8. Chapman LS. Meta-evaluation of worksite health promotion economic return studies: 2005 update. Am J Health Promot. 2005;19:1-11.
9. Pelletier KR. A review and analysis of the clinical and cost-effectiveness studies of comprehensive health promotion and disease management programs at the worksite: update VIII 2008 to 2010. J Occup Environ Med. 2011;53:1310-1331.
10. Chiou CF, Hay JW, Wallace JF, et al. Development and validation of a grading system for the quality of cost-effectiveness studies. Med Care. 2003;41:32-44.
11. Oxman A, Group GW. Grading quality of evidence and strength of recommendations. BMJ. 2004;328:1490-1494.
12. Evers S, Goossens M, de Vet H, et al. Criteria list for assessment of methodological quality of economic evaluations: consensus on health economic criteria. Int J Technol Assess Health Care. 2005;21:240-245.
13. Centre for Reviews and Dissemination. Systematic Reviews: CRD's Guidance for Undertaking Reviews in Health Care. 3rd ed. York, UK: Centre for Reviews and Dissemination; 2009. Available at: http://www.york.ac.uk/inst/crd/index- guidance.htm. Accessed August 4, 2011.
14. University of York. Database of abstracts of reviews of effects. Available at: http://www.crd.york.ac.uk/crdweb/. Accessed October 2011.
15. Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C, eds. Evidence-Based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice. 2nd ed. Hoboken, NJ: Wiley-Blackwell/BMJ Books; 2010.
16. Campbell and Cochrane Economnics Methods Group. How to add health economics to Cochrane protocols. Available at: http://www.c-cemg.org/. Accessed October 10, 2011.
17. National Institute for Health and Clinical Excellence. Incorporating health economics in guidelines and assessing resource impact. Chapter 8. In: The Guidelines Manual. London, UK: NICE; 2007. Available at: http://www.nice.org. uk/niceMedia/pdf/GuidelinesManualChapter8.pdf.
18. National Institute for Health and Clinical Excellence. Methodology checklist- economic evaluations. In: The Guidelines Manual. London, UK: NICE; 2009: app H. Available at: http://www.nice.org.uk/media/633/71/The-guidelines- manual-2009-Appendix-H-Methodology-checklist-economic-evaluations.pdf.
19. Philips Z, Bojke L, Sculpher M, et al. Good practice guidelines for decisionanalytic modelling in health technology assessment: a review and consolidation of quality assessment. Pharmacoeconomics. 2006;24:355-371.
20. Husereau D, Drummond M, Petrou S, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. BMC Med. 2013;11: 80.
21. Drummond MF, Sculpher MJ, Torrance GW. Methods for the Economic Evaluation of Health Care Programmes. 3rd ed. New York, NY: Oxford University Press; 2005.
22. Drummond MF, Jefferson TO. Guidelines for authors and peer reviewers of economic submissions to the BMJ. The BMJ Economic Evaluation Working Party. BMJ. 1996;313:275-283.
23. Stone PW. Return-on-investment models. Appl Nurs Res. 2005;18:186-189.
24. Finkelstein EA, Linnan LA, Tate DF, Leese PJ. A longitudinal study on the relationship between weight loss, medical expenditures, and absenteeism among overweight employees in the WAY to Health study. J Occup Environ Med. 2009; 51:1367-1373.
25. Deitz D, Cook R, Hersch R. Workplace health promotion and utilization of health services: follow-up data findings. J Behav Health Serv Res. 2005;32:306-319.
26. Millot JL, Aymard M, Bardol A. Reduced efficiency of influenza vaccine in prevention of influenza-like illness in working adults: a 7 month prospective survey in EDF Gaz de France employees, in Rhô ne-Alpes, 1996-1997. Occup Medi. 2002;52:281-292.
27. Serxner S, Gold D, Anderson D, Williams D. The impact of a worksite health promotion program on short-term disability usage. J Occup Environ Med. 2001;43:25-29.
28. Chung M, Melnyk P, Blue D, et al. Worksite health promotion: the value of the Tune Up Your Heart Program. Popul Health Manag. 2009;12:297-304.
29. Chenoweth DH, Garrett J. Costeffectiveness analysis of a worksite clinic: is it worth the costí AAOHN J. 2006;54: 84-89; quiz 90-91.
30. Ide R, Mizoue T, Tsukiyama Y, et al. Evaluation of oral health promotion in the workplace: the effects on dental care costs and frequency of dental visits. Community Dent Oral Epidemiol. 2001;29: 213-219.
31. Nelson DJ, Sennett L, Lefebvre RC. A campaign strategy for weight loss at worksites. Health Educ Res. 1987;2:27-31.
32. Renaud L, Kishchuk N, Juneau M, et al. Implementation and outcomes of a comprehensive worksite health promotion program. Can J Pub Health. 2008;99:73-77.
33. Schwartz SM, Day B, Wildenhaus K, et al. The impact of an online disease management program on medical costs among health plan members. Am J Health Promot. 2010;25:126-133.
34. Nyman JA, Abraham JM, Jeffery MM, Barleen NA. The effectiveness of a health promotion program after 3 years: evidence from the University of Minnesota. Med Care. 2012;50:772-778.
35. Shi L. Health promotion, medical care use, and costs in a sample of worksite employees. Eval Rev. 1993;17:475-487.
36. Ozminkowski RJ, Dunn RL, Goetzel RZ, et al. A return on investment evaluation of the Citibank, N.A., health management program. Am J Health Promot. 1999;14:31-43.
37. Henke RM, Goetzel RZ, McHugh J, Isaac F. Recent experience in health promotion at Johnson & Johnson: lower health spending, strong return on investment. Health Aff. 2011;30:490-499.
38. Baker KM, Goetzel RZ, Pei X, et al. Using a return-on-investment estimation model to evaluate outcomes from an obesity management worksite health promotion program. J Occup Environ Med. 2008;50: 981-990.
39. McEachan RR, Lawton RJ, Jackson C, et al. Testing a workplace physical activity intervention: a cluster randomized controlled trial. Int J Behav Nutr Phys Act. 2011;8:29.
40. Australian Government, Dept of Innovation Industry Science and Research. Key Statistics: Australian Small Businesses. Canberra ACT, Australia: Australian Government; 2011.
41. Cohen P, Darling C, Hampson A, et al. Influenza vaccination in an occupational setting: effectiveness and cost-benefit study (abstract). J Occup Health and Saf (Australia and New Zealand). 2003;2:167-182 Available at: http://www.mrw.interscience.wiley.com/cochrane/cleed/articles/ NHSEED-22003009406/frame.html.
42. At'kov O, Azarov A, Zhukov D, et al. Influenza vaccination in healthy working adults in Russia: observational study of effectiveness and return on investment for the employer. Appl Health Econ Health Policy. 2011;9:89-99.
43. Gibbs JO, Mulvaney D, Henes C, Reed RW. Work-site health promotion. Fiveyear trend in employee health care costs. J Occup Med. 1985;27:826-830.
44. Wood EA, Olmstead GW, Craig JL. An evaluation of lifestyle risk factors and absenteeism after two years in a worksite health promotion program. Am J Health Promot. 1989;4:128-133.
45. Milani RV, Lavie CJ. Impact of worksite wellness intervention on cardiac risk factors and one-year health care costs. Am J Cardiol. 2009;104:1389-1392.
46. Tao X, Chenoweth D, Alfriend AS, et al. Monitoring worksite clinic performance using a cost-benefit tool. J Occup Environ Med. 2009;51:1151-1157.
47. Aldana SG, Merrill RM, Price K, et al. Financial impact of a comprehensive multisite workplace health promotion program. Prev Med. 2005;40:131-137.
48. Ichihashi T, Muto T, Shibuya K. Costbenefit analysis of a worksite oral-health promotion program. Ind Health. 2007;45: 32-36.
49. Bertera RL. The effects of workplace health promotion on absenteeism and employment costs in a large industrial population. Am J Public Health. 1990;80: 1101-1105.
50. Campbell DS, Rumley MH. Costeffectiveness of the influenza vaccine in a healthy, working-age population. J Occup Environ Med. 1997;39:408-414.
51. Bridges CB, Thompson WW, Meltzer MI, et al. Effectiveness and cost-benefit of influenza vaccination of healthy working adults. JAMA. 2000;284:1655-1663.
52. Colombo GL, Ferro A, Vinci M, Zordan M, Serra G. Cost-benefit analysis of influenza vaccination in a public healthcare unit. Ther Clin Risk Manag. 2006;2:219-226.
53. Dille JH. A worksite influenza immunization program: impact on lost work days, health care utilization, and health care spending. AAOHN J. 1999;47: 301-309.
54. Samad AH, Usul MH, Zakaria D, et al. Workplace vaccination against influenza in Malaysia: does the employer benefití J Occup Health. 2006;48:1-10.
55. Morales A, Martinez MM, Tasset-Tisseau A, et al. Costs and benefits of influenza vaccination and work productivity in a Colombian company from the employer's perspective. Value in Health. 2004;7:433-441.
56. Kumpulainen V, Makela M. Influenza vaccination among healthy employees: a cost-benefit analysis. Scand J Infect Dis. 1997;29:181-185. Available at: http://www.mrw.interscience.wiley.com/cochrane/cleed/articles/ NHSEED-21997000750/frame.html.
57. Schneider M, Hä ck HJ. Screening for colorectal cancer: a cost benefit analysis on a health prevention programme at the Boehringer Ingelheim Company [in German]. Dtsch Med Wochenschr. 2011;136: 1047-1052.
58. Schrammel P, Griffiths RI, Griffiths CB. A workplace breast cancer screening program: costs and components. AAOHN J. 1998;46:523-529.
59. Shore G, Prasad P, Zrobak M. Metrofit: a cost-effective fitness program. Fitness in Business. 1989;4:147-153.
60. Shephard RJ. Twelve years experience of a fitness program for the salaried employees of a Toronto life assurance company. Am J Health Promot. 1992;6:292-301.
61. Mills PR, Kessler RC, Cooper J, Sullivan S. Impact of a health promotion program on employee health risks and work productivity. Am J Health Promot. 2007;22: 45-53.
62. American Heart Association Division of Planning. Heart at Work: Technical Report, Extended Field Studies. Dallas, Tex: American Heart Association; 1987.
63. Goetzel RZ, Ozminkowski RJ, Baase CM, Billotti GM. Estimating the return-oninvestment from changes in employee health risks on the Dow Chemical Company's health care costs. J Occup Environ Med. 2005;47:759-768.
64. Golaszewski T, Snow D, Lynch W, et al. A benefit-to-cost analysis of a work-site health promotion program. J Occup Med. 1992;34:1164-1172.
65. Greene BL, Miller JD, Brown TM, et al. Economic impact of the BP DownShift Program on blood pressure control among commercial driver license employees. J Occup Environ Med. 2009;51: 542-553.
66. Groeneveld IF, van Wier MF, Proper KI, et al. Cost-effectiveness and cost-benefit of a lifestyle intervention for workers in the construction industry at risk for cardiovascular disease. J Occup Environ Med. 2011;53:610-617.
67. Meenan RT, Vogt TM, Williams AE, et al. Economic evaluation of a worksite obesity prevention and intervention trial among hotel workers in Hawaii. J Occup Environ Med. 2010;52(suppl 1):S8-S13.
68. Proper KI, de Bruyne MC, Hildebrandt VH, et al. Costs, benefits and effectiveness of worksite physical activity counseling from the employer's perspective. Scand J Work Environ Health. 2004;30:36-46.
69. Taimela S, Justén S, Aronen P, et al. An occupational health intervention programme for workers at high risk for sickness absence. Cost effectiveness analysis based on a randomised controlled trial. J Occup Environ Med. 2008;65:242-248.
70. Bowne DW, Russell ML, Morgan JL, et al. Reduced disability and health care costs in an industrial fitness program. J Occup Med. 1984;26:809-816.
71. Davis L, Loyo K, Glowka A, et al. A comprehensive worksite wellness program in Austin, Texas: partnership between Steps to a Healthier Austin and Capital Metropolitan Transportation Authority. Prev Chronic Dis. 2009;6:A60.
72. Leutzinger J, Hawes C, Hunnicutt D, Richling D. Predicting the ratio of benefit to cost in a cardiovascular diseaseprevention program. Managing Employee Health Benefits. 1995;3:1-10.
73. Schultz AB, Lu C, Barnett TE, et al. Influence of participation in a worksite health-promotion program on disability days. J Occup Environ Med. 2002;44:776-780.
74. Windsor RA, Lowe JB. Behavioral impact and cost analysis of a worksite self-help smoking cessation program. Prog Clin Biol Res. 1989;293:231-242.
75. Yen L, Schultz AB, Schaefer C, et al. Long-term return on investment of an employee health enhancement program at a Midwest utility company from 1999 to 2007. Int J Workplace Health Manag. 2010;3:79-96.
76. Aldana SG, Jacobson BH, Harris CJ, et al. Influence of a mobile worksite health promotion program on health care costs. Am J Prev Med. 1993;9:378-383.
77. Gettman L. Cost/benefit analysis of a corporate fitness program. Fitness in Business. 1986;1:11-17.
78. Naydeck BL, Pearson JA, Ozminkowski RJ, et al. The impact of the highmark employee wellness programs on 4-year healthcare costs. J Occup Environ Med. 2008;50:146-156.
79. Harris JS. Northern Telecom: a million dollar medically based program in a rapidly changing high tech environment. Am J Health Promot. 1986;1:50-84.
80. Merrill RM, Hyatt B, Aldana SG, Kinnersley D. Lowering employee health care costs through the Healthy Lifestyle incentive program. J Public Health Manag Pract. 2011;17:225-232.
81. Bertera RL, Oehl LK, Telepchak JM. Selfhelp versus group approaches to smoking cessation in the workplace: eighteen-month follow-up and cost analysis. Am J Health Promot. 1990;4:187-192.
82. Serxner S, Adams VG, Hundahl LS, et al. A smoking cessation pilot program. Hawaii Med J. 1993;52:266-272.
83. Harvey MR, Whitmer RW, Hilyer JC, Brown KC. The impact of a comprehensive medical benefit cost management program for the city of Birmingham: results at five years. Am J Health Promot. 1993;7:296-303.
84. Foote A, Erfurt JC. The benefit to cost ratio of work-site blood pressure control programs. JAMA. 1991;265:1283-1286.
85. Altman DG, Bland JM. Measurement in medicine: the analysis of method comparison studies. The Statistician. 1983; 32:307-317.
86. Pelletier KR. A review and analysis of the clinical and cost-effectiveness studies of comprehensive health promotion and disease management programs at the worksite: update VI 2000-2004. J Occup Environ Med. 2005;47:1051-1058.
87. Pelletier KR. A review and analysis of the clinical and cost-effectiveness studies of comprehensive health promotion and disease management programs at the worksite: 1995-1998 update (IV). Am J Health Promot. 1999;13:333-345, iii.
88. Hamberg-van Reenen HH, Proper KI, van den Berg M. Worksite mental health interventions: a systematic review of economic evaluations. J Occup Environ Med. 2012;69:837-845.
89. Tsai SP, Bernacki EJ, Baun WB. Injury prevalence and associated costs among participants of an employee fitness program. Prev Med. 1988;17:475-482.
90. Stein AD, Karel T, Zuidema R. Carrots and sticks: impact of an incentive/disincentive employee flexible credit benefit plan on health status and medical costs. Am J Health Promot. 1999;13:260-267.
91. Shimizu T, Nagashima S, Mizoue T, et al. A psychosocial-approached health promotion program at a Japanese worksite. J UOEH. 2003;25:23-34.
92. Shi L. Worksite health promotion and changes in medical care use and sick days. J Health Behav Ed Promot. 1993;17:9-17.
93. Maes S, Verhoeven C, Kittel F, Scholten H. Effects of a Dutch work-site wellnesshealth program: the Brabantia Project. Am J Public Health. 1998;88:1037-1041.
94. Lynch WD, Golaszewski TJ, Clearie AF, et al. Impact of a facility-based corporate fitness program on the number of absences from work due to illness. J Occup Med. 1990;32:9-12.
95. Knight KK, Goetzel RZ, Fielding JE, et al. An evaluation of Duke University's LIVE FOR LIFE health promotion program on changes in worker absenteeism. J Occup Med. 1994;36:533-536.
96. Jeffery RW, Forster JL, Dunn BV, et al. Effects of work-site health promotion on illness-related absenteeism. J Occup Med. 1993;35:1142-1146.
97. Hodges LC, Harper TS, Hall-Barrow J, Tatom ID. Reducing overall health care costs for a city municipality: a real life community based learning model. AAOHN J. 2004;52:247-253.
98. Hall-Barrow J, Hodges L, Brown P. A collaborative model for employee health and nursing education. Successful program. AAOHN J. 2001;49:429-436.
99. Goetzel RZ, Dunn RL, Ozminkowski RJ, et al. Differences between descriptive and multivariate estimates of the impact of Chevron Corporation's Health Quest Program on medical expenditures. J Occup Environ Med. 1998;40:538-545.
100. Dalton BA, Harris JS. A comprehensive approach to corporate health management. J Occup Med. 1991;33:338-347.
101. Edington DW, Yen LT, Witting P. The financial impact of changes in personal health practices. J Occup Environ Med. 1997;39:1037-1046.
102. Conrad KM, Riedel JE, Gibbs JO. Effect of worksite health promotion programs on employee absenteeism. A comparative analysis. AAOHN J. 1990;38:573-580.
103. Cady LD Jr, Thomas PC, Karwasky RJ. Program for increasing health and physical fitness of fire fighters. J Occup Med. 1985;27:110-114.
104. Bertera RL. Behavioral risk factor and illness day changes with workplace health promotion: two-year results. Am J Health Promot. 1993;7:365-373.
105. Baun WB, Bernacki E, Tsai SP. A preliminary investigation: effect of a corporate fitness program on absenteeism and health care cost. J Occup Med. 1986;28:18-22.
106. Anderzén I, Arnetz BB. The impact of a prospective survey-based workplace intervention program on employee health, biologic stress markers, and organizational productivity. J Occup Environ Med. 2005;47:671-682.
107. Trudeau JV, Deitz DK, Cook RF. Utilization and cost of behavioral health services: employee characteristics and workplace health promotion. J Behav Health Serv Res. 2002;29:61-74.
108. Bly JL, Jones RC, Richardson JE. Impact of worksite health promotion on health care costs and utilization. Evaluation of Johnson & Johnson Live for Life program. JAMA. 1986;256:3235-3240.
109. Blair SN, Smith M, Collingwood TR. Health promotion for educators: impact on absenteeism. Prev Med. 1986;15:166-175.
110. Goetzel RZ, Jacobson BH, Aldana SG, et al. Health care costs of worksite health promotion participants and nonparticipants. J Occup Environ Med. 1998; 40:341-346.
111. Henritze J, Brammell HL, McGloin J. LIFECHECK: a successful, low touch, low tech, in-plant, cardiovascular disease risk identification and modification program. Am J Health Promot. 1992;7:129-136.
112. Jones RC, Bly JL, Richardson JE. A study of a work site health promotion program and absenteeism. J Occup Med. 1990;32: 95-99.
113. Sciacca J, Seehafer R, Reed R, Mulvancy D. The impact of participation in health promotion on medical costs: a reconsideration of the Blue Cross and Blue Shield of Indiana study. Am J Health Promot. 1993;7:374-383, 395.
114. Serxner SA, Gold DB, Grossmeier JJ, Anderson DR. The relationship between health promotion program participation and medical costs: a dose response. J Occup Environ Med. 2003;45:1196-1200.
115. Stave GM, Muchmore L, Gardner H. Quantifiable impact of the contract for health and wellness: health behaviors, health care costs, disability, and workers' compensation [abstract]. J Occup Environ Med. 2003;51:109-117. Available at: http://www.mrw.interscience.wiley.com/cochrane/cleed/articles/ NHSEED-22003000418/frame.html.
116. Bunting BA, Cranor CW. The Asheville Project: long-term clinical, humanistic, and economic outcomes of a communitybased medication therapy management program for asthma (abstract). J Am Pharm Assoc. 2006;2:133-147. Available at: http://www.mrw.interscience.wiley.com/cochrane/cleed/articles/ NHSEED-22007000163/frame.html.
117. Page MJ, Paramore LC, Doshi D, Rupnow MFT. Evaluation of resource utilization and cost burden before and after an employer-based migraine education program. J Occup Environ Med. 2009;51: 213-220.
118. Hughes MC, Girolami TM, Cheadle AD, Harris JR, Patrick DL. A lifestyle-based weight management program delivered to employees: examination of health and economic outcomes [abstract]. J Occup Environ Med. 2007;11:1212-1217. Available at: http://www.mrw. interscience.wiley.com/ cochrane/cleed/articles/NHSEED-22007006751/frame. html.
119. Bureau of Labor Statistics. Employer Costs for Employee Compensation Summary. Washington, DC: Bureau of Labor Statistics; 2009.
120. Nixon J, Stoykova B, Glanville J, et al. The U.K. NHS economic evaluation database. Economic issues in evaluations of health technology. Int J Technol Assess Health Care. 2000;16:731-742.
121. Zarnke KB, Levine MA, O'Brien BJ. Costbenefit analyses in the health-care literature: don't judge a study by its label. J Clin Epidemiol. 1997;50:813-822.
122. Dept of Business Innovation and Skills. Small and Medium-sized Enterprise (SME) Statistics for the UK and Regions 2009. London, UK: Government of the United Kingdom; 2010.
123. Australian Bureau of Statistics. Counts of Australian Businesses, Including Entries and Exits, June 2007 Until June 2011. (Cat. No. 8165.0). Canberra ACT, Australia: Australian Bureau of Statistics; 2012.
124. Divine R. Determinants of small business interest in offering a wellness program to their employees. Health Mark Q. 2005;22: 43-58.