Evaluating the Health Impact of Large-Scale Public Policy Changes: Classical and Novel Approaches

Annual Review of Public Health

Volumn 38, Issue , 2017, Pages 351-370

  Basu, Sanjay ^a,b,c   Meghani, Ankita ^b   Siddiqi, Arjumand ^d,e  

^a STANFORD UNIVERSITY   (United States)

^b STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c HARVARD MEDICAL SCHOOL   (United States)

^d UNIVERSITY OF TORONTO   (Canada)

^e IL   (United States)

Author keywords

Difference in differences; Instrumental variables; Near far matching; Propensity score; Regression discontinuity; Synthetic controls

Indexed keywords

COST EFFECTIVENESS ANALYSIS; HEALTH IMPACT ASSESSMENT; HUMAN; INSTRUMENTAL VARIABLE ANALYSIS; MEDLINE; MORTALITY RATE; PRIORITY JOURNAL; PROGRAM EVALUATION; PROPENSITY SCORE; PUBLIC POLICY; REVIEW; UNEMPLOYMENT; HEALTH CARE POLICY; PUBLIC HEALTH;

HEALTH POLICY; HUMANS; PUBLIC HEALTH; PUBLIC POLICY;

EID: 85017127864     PISSN: 01637525     EISSN: 15452093     Source Type: Book Series    
DOI: 10.1146/annurev-publhealth-031816-044208     Document Type: Review

References (80)

1. Abadie A, Diamond A, Hainmueller J. 2010. Synthetic control methods for comparative case studies: estimating the effect of California's tobacco control program. J. Am. Stat. Assoc. 105:493-505
2. Angell SY, Silver LD, Goldstein GP, Johnson CM, Deitcher DR, et al. 2009. Cholesterol control beyond the clinic: New York City's trans fat restriction. Ann. Intern. Med. 151(2):129-34
3. Angrist JD, Pischke J-S. 2008. Mostly Harmless Econometrics: An Empiricist's Companion. Princeton, NJ: Princeton Univ. Press
4. Austin PC. 2009. The relative ability of different propensity score methods to balance measured covariates between treated and untreated subjects in observational studies. Med. Decis. Making 29:661-77
5. Austin PC. 2009. Type I error rates, coverage of confidence intervals, and variance estimation in propensity-score matched analyses. Int. J. Biostat. 5(1):13
6. Austin PC. 2011. An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivar. Behav. Res. 46(3):399-424
7. Austin PC, Grootendorst P, Anderson GM. 2007. A comparison of the ability of different propensity score models to balance measured variables between treated and untreated subjects: a Monte Carlo study. Stat. Med. 26(4):734-53
8. Austin PC, Mamdani MM. 2006. A comparison of propensity score methods: a case-study estimating the effectiveness of post-AMI statin use. Stat. Med. 25(12):2084-106
9. BaiocchiM, Small DS, Lorch S, Rosenbaum PR. 2010. Building a stronger instrument in an observational study of perinatal care for premature infants. J. Am. Stat. Assoc. 105(492):1285-96
10. Baiocchi M, Small DS, Yang L, Polsky D, Groeneveld PW. 2012. Near/far matching: a study design approach to instrumental variables. Health Serv. Outcomes Res. Methodol. 12(4):237-53
11. Barry CL, Busch SH. 2007. Do state parity laws reduce the financial burden on families of children with mental health care needs? Health Serv. Res. 42(3 Pt. 1):1061-84
12. Basu S, Seligman HK, Gardner C, Bhattacharya J. 2014. Ending SNAP subsidies for sugar-sweetened beverages could reduce obesity and type 2 diabetes. Health Aff. 33(6):1032-39
13. Baum CF, SchafferME, Stillman S. 2007. Enhanced routines for instrumental variables/GMM estimation and testing. Stata J. 7(4):465-506
14. Baum CL II. 2010. The effects of Food Stamps on obesity. Work. Pap., Dep. Econ. Financ., Middle Tenn. State Univ., Murfreesboro
15. Bertrand M, Duflo E, Mullainathan S. 2004. How much should we trust differences-in-differences estimates? Q. J. Econ. 119(1):249-75
16. Biswas R, Ray SK, Dobe M, Dasgupta S, Mandal A. 2001. An overview of multicentric training workshops for public health professionals on reproductive and child health programme in India. Indian J. Public Health 46(3):78-85
17. Brown TT, Martinez-Gutierrez MS, Navab B. 2014. The impact of changes in county public health expenditures on general health in the population. Health Econ. Policy Law 9(3):251-69
18. Conley D, McCabe BJ. 2012. Bribery or just desserts? Evidence on the influence of Congressional reproductive policy voting patterns on PAC contributions from exogenous variation in the sex mix of legislator offspring. Soc. Sci. Res. 41(1):120-29
19. De Jaeger S. 2009. Residual household waste: from pay-per-bag to pay-per-kilogram. An evaluation study for flanders. Waste Manag. Res. 28:330-39
20. Neve J-W, Fink G, Subramanian SV, Moyo S, Bor J. 2015. Length of secondary schooling and risk of HIV infection in Botswana: evidence from a natural experiment. Lancet Glob. Health 3(8):e470-77
21. De Vogli R, Kouvonen A, Gimeno D, De Vogli R, Kouvonen A, Gimeno D. 2014. The influence of market deregulation on fast food consumption and body mass index: a cross-national time series analysis. Bull. World Health Organ. 92(2):99-107A
22. DeVoe JE, Marino M, Gold R, Hoopes MJ, Cowburn S, et al. 2015. Community health center use after Oregon's randomized Medicaid experiment. Ann. Fam. Med. 13(4):312-20
23. Dimick JB, Ryan AM. 2014. Methods for evaluating changes in health care policy: the difference-indifferences approach. JAMA 312(22):2401-2
24. EvansWN, GarthwaiteCL. 2014. Giving mom a break: the impact of higher EITC payments onmaternal health. Am. Econ. J. Econ. Policy 6(2):258-90
25. Fell JC, Scherer M, Thomas S, Voas RB. 2014. Effectiveness of social host and fake identification laws on reducing underage drinking driver fatal crashes. Traffic Inj. Prev. 15(Suppl. 1):S64-73
26. Fertig AR, Reingold DA. 2007. Public housing, health, and health behaviors: Is there a connection? J. Policy Anal. Manag. 26(4):831-60
27. Friel S, MarmotMG. 2011. Action on the social determinants of health and health inequities goes global. Annu. Rev. Public Health 32:225-36
28. Gantner LA, Olson CM. 2012. Evaluation of public health professionals' capacity to implement environmental changes supportive of healthy weight. Eval. Progr. Plan. 35(3):407-16
29. Glantz SA. 1993. Changes in cigarette consumption, prices, and tobacco industry revenues associated with California's proposition. Tob. Control 2(4):311-14
30. Gormley WTJr., Gayer T, Phillips D, Dawson B. 2005. The effects of universal pre-K on cognitive development. Dev. Psychol. 41(6):872-84
31. Gyorkos TW, Maheu-Giroux M, Blouin B, Creed-Kanashiro H, Casapía M, et al. 2012. A hospital policy change toward delayed cord clamping is effective in improving hemoglobin levels and anemia status of 8-month-old Peruvian infants. J. Trop. Pediatr. 58(6):435-40
32. Halpern SD, French B, Small DS, Saulsgiver K, Harhay MO, et al. 2015. Randomized trial of four financial-incentive programs for smoking cessation. N. Engl. J. Med. 372(22):2108-17
33. Hanandita W, Tampubolon G. 2014. Does poverty reduce mental health? An instrumental variable analysis. Soc. Sci. Med. 113:59-67
34. Hoynes H, Miller D, Simon D. 2015. Income, the Earned Income Tax Credit, and infant health. Am. Econ. J. Econ. Policy 7(1):172-211
35. Ikenwilo D. 2013. A difference-in-differences analysis of the effect of free dental check-ups in Scotland. Soc. Sci. Med. 83:10-18
36. Imbens GW, Wooldridge J. 2007. Difference-in-differences estimation. Natl. Bur. Econ. Res. Work. Pap. http://www.nber.org/WNE/lect-10-diffindiffs.pdf
37. Jayawardhana J, Welton JM, Lindrooth RC. 2014. Is there a business case for magnet hospitals? Estimates of the cost and revenue implications of becoming a magnet. Med. Care 52(5):400-6
38. Johar M. 2009. The impact of the Indonesian health card program: a matching estimator approach. J. Health Econ. 28(1):35-53
39. Johnston DW, Lordan G, Shields MA, Suziedelyte A. 2015. Education and health knowledge: evidence from UK compulsory schooling reform. Soc. Sci. Med. 127:92-100
40. Kadiyala S, Strumpf EC. 2011. Are United States and Canadian cancer screening rates consistent with guideline information regarding the age of screening initiation? Int. J. Qual. Health Care 23(6):611-20
41. Kagohashi K, Tsurumi T, Managi S. 2015. The effects of international trade on water use. PLOS ONE 10(7):e0132133
42. Karaca-Mandic P, Choi-Yoo SJ, Lee J, Scal P. 2014. Family out-of-pocket health care burden and children's unmet needs or delayed health care. Acad. Pediatr. 14(1):101-8
43. King G, Tanner MA, Rosen O. 2004. Ecological Inference: New Methodological Strategies. New York: Cambridge Univ. Press
44. Konetzka RT, Yi D, Norton EC, Kilpatrick KE. 2004. Effects of Medicare payment changes on nursing home staffing and deficiencies. Health Serv. Res. 39(3):463-88
45. Kozhimannil KB, Attanasio LB, McGovern PM, Gjerdingen DK, Johnson PJ. 2013. Reevaluating the relationship between prenatal employment and birth outcomes: a policy-relevant application of propensity score matching. Womens Health Issues 23(2):e77-85
46. Lambon-Quayefio MP, Owoo NS. 2014. Examining the influence of antenatal care visits and skilled delivery on neonatal deaths in Ghana. Appl. Health Econ. Health Policy 12(5):511-22
47. Lee DS, Lemieux T. 2009. Regression discontinuity designs in economics. J. Econ. Lit. 48:281-355
48. Leung CW, Ding EL, Catalano PJ, Villamor E, Rimm EB, Willett WC. 2012. Dietary intake and dietary quality of low-income adults in the Supplemental Nutrition Assistance Program. Am. J. Clin. Nutr. 96(5):977-88
49. Lillico HG, Hanning R, Findlay S, Hammond D. 2015. The effects of calorie labels on those at high-risk of eating pathologies: a pre-post intervention study in a university cafeteria. Public Health 129(6):732-39
50. Liu H, Han X, Xiao Q, Li S, Feldman MW. 2015. Family structure and quality of life of elders in rural china: the role of the new rural social pension. J. Aging Soc. Policy 27(2):123-38
51. Lorch SA, Baiocchi M, Ahlberg CE, Small DS. 2012. The differential impact of delivery hospital on the outcomes of premature infants. Pediatrics 130(2):270-78
52. McCormick D, Hanchate AD, Lasser KE, Manze MG, Lin M, et al. 2015. Effect of Massachusetts healthcare reform on racial and ethnic disparities in admissions to hospital for ambulatory care sensitive conditions: retrospective analysis of hospital episode statistics. BMJ 350:h1480
53. McCrary J. 2008. Manipulation of the running variable in the regression discontinuity design: a density test. J. Econom. 142(2):698-714
54. Meara E, Kotagal UR, Atherton HD, Lieu TA. 2004. Impact of early newborn discharge legislation and early follow-up visits on infant outcomes in a state Medicaid population. Pediatrics 113(6):1619-27
55. Meret-Hanke LA. 2011. Effects of the Program of All-inclusive Care for the Elderly on hospital use. Gerontologist 51(6):774-85
56. Mukamel DB, Kang T, Collier E, Harrington C. 2012. The relationship of California's Medicaid reimbursement system to nurse staffing levels. Med. Care 50(10):836-42
57. Mulvale G, Hurley J. 2008. Insurance coverage and the treatment of mental illness: effect on medication and provider use. J. Ment. Health Policy Econ. 11(4):177-99
58. Nanda P. 1999. Women's participation in rural credit programmes in Bangladesh and their demand for formal health care: Is there a positive impact? Health Econ. 8(5):415-28
59. Neuman MD, Rosenbaum PR, Ludwig JM, Zubizarreta JR, Silber JH. 2014. Anesthesia technique, mortality, and length of stay after hip fracture surgery. JAMA 311(24):2508-17
60. Nishi A, McWilliams JM, Noguchi H, Hashimoto H, Tamiya N, Kawachi I. 2012. Health benefits of reduced patient cost sharing in Japan. Bull. World Health Organ. 90(6):426-35a
61. Norwood P, Eberth B, Farrar S, Anable J, Ludbrook A. 2014. Active travel intervention and physical activity behaviour: an evaluation. Soc. Sci. Med. 113:50-58
62. Olsho LE, Klerman JA, Ritchie L, Wakimoto P, Webb KL, Bartlett S. 2015. Increasing child fruit and vegetable intake: findings from the US Department of Agriculture fresh fruit and vegetable program. J. Acad. Nutr. Diet. 115:1283-90
63. PatelMS, Volpp KG, Small DS, Hill AS, Even-Shoshan O, et al. 2014. Association of the 2011 ACGME resident duty hour reforms withmortality and readmissions among hospitalizedmedicare patients. JAMA 312(22):2364-73
64. Pomeranz JL. 2015. Implications of the Supplemental Nutrition Assistance Program tax exemption on sugar-sweetened beverage taxes. Am. J. Public Health 105(11):2191-93
65. Porter D. 1994. The History of Public Health and the Modern State. Atlanta: Rodopi
66. Potylycki MJ, Kimmel SR, Ritter M, Capuano T, Gross L, et al. 2006. Nonpunitive medication error reporting: 3-year findings from one hospital's primum non nocere initiative. J. Nurs. Adm. 36(7-8):370-76
67. Rajaram R, Chung JW, Jones AT, Cohen ME, Dahlke AR, et al. 2014. Association of the 2011 ACGME resident duty hour reform with general surgery patient outcomes and with resident examination performance. JAMA 312(22):2374-84
68. Remler DK, Van Ryzin GG. 2010. Natural and quasi experiments. In Research Methods in Practice: Strategies for Description and Causation, pp. 427-64. Thousand Oaks, CA: SAGE Publ
69. Rosenbaum PR. 1987. The role of a second control group in an observational study. Stat. Sci. 2(3):292-306
70. Salas M, Hotman A, Stricker BH. 1999. Confounding by indication: an example of variation in the use of epidemiologic terminology. Am. J. Epidemiol. 149(11):981-83
71. Salehi-Isfahani D, Abbasi-Shavazi MJ, Hosseini-Chavoshi M. 2010. Family planning and fertility decline in rural Iran: the impact of rural health clinics. Health Econ. 19(Suppl):159-80
72. Sassi F, Belloni A, Capobianco C, Alemanno A. 2014. Taxation and economic incentives on health-related commodities: alcohol, tobacco and food. In Regulating Lifestyle-Europe, Alcohol, Tobacco and Unhealthy Diets, ed. A Alemanno, A Garde. Cambridge, UK: Cambridge Univ. Press
73. Shen Y-C, Wu VY. 2013. Reductions inMedicare payments and patient outcomes: an analysis of 5 leading Medicare conditions. Med. Care 51(11):970-77
74. Slawson DL, Southerland J, Lowe EF, Dalton WT, Pfortmiller DT, Schetzina K. 2013. Go Slow Whoa meal patterns: cafeteria staff and teacher perceptions of effectiveness in winning with wellness schools. J. Sch. Health 83(7):485-92
75. Sommers BD, Baicker K, EpsteinAM. 2012. Mortality and access to care among adults after state Medicaid expansions. N. Engl. J. Med. 367(11):1025-34
76. Stock JH, Yogo M. 2005. Testing forweak instruments in linear IVregression. In Identification and Inference for Econometric Models, ed. DWK Andrews, pp. 80-108. New York: Cambridge Univ. Press
77. Subramanian SV, Jones K, Kaddour A, Krieger N. 2009. Revisiting Robinson: the perils of individualistic and ecologic fallacy. Int. J. Epidemiol. 38(2):342-60
78. Tsai AC, Venkataramani AS. 2015. The causal effect of education on HIV stigma in Uganda: evidence from a natural experiment. Soc. Sci. Med. 142:37-46
79. WHO (World Health Organ) Comm. Soc. Determ. Health. 2008. Closing a Gap in a Generation: Health Equity Through Action on the Social Determinants ofHealth-Final Report.Geneva:WHO. http://apps.who. int/iris/bitstream/10665/43943/1/9789241563703-eng.pdf
80. Wooldridge J. 2008. Introductory Econometrics: AModern Approach.Mason, OH: South-Western, Cengage Learn