Large-scale evaluation of quality of care in 6 countries of Eastern Europe and central Asia using clinical performance and value vignettes

Global Health Science and Practice

Volumn 5, Issue 3, 2017, Pages 412-429

  Peabody, John W ^a,b,c   DeMaria, Lisa ^a   Smith, Owen ^d   Hoth, Angela ^a   Dragoti, Edmond ^e,f   Luck, Jeff ^g  

^a QURE Healthcare   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d WORLD BANK GROUP   (United States)

^e Institute of Public Opinion Studies   (Albania)

^f UNIVERSITY OF TIRANA   (Albania)

^g OREGON STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALBANIA; ARMENIA; EPIDEMIOLOGY; GEORGIA (REPUBLIC); HEALTH CARE QUALITY; HUMAN; KAZAKHSTAN; ORGANIZATION AND MANAGEMENT; PROCEDURES; RUSSIAN FEDERATION; STANDARDS; TAJIKISTAN;

ALBANIA; ARMENIA; GEORGIA (REPUBLIC); HUMANS; KAZAKHSTAN; QUALITY ASSURANCE, HEALTH CARE; QUALITY INDICATORS, HEALTH CARE; QUALITY OF HEALTH CARE; RUSSIA; SAMPLING STUDIES; TAJIKISTAN;

EID: 85034591630     PISSN: None     EISSN: 2169575X     Source Type: Journal    
DOI: 10.9745/GHSP-D-17-00044     Document Type: Article

References (74)

1. Smith O, Nguyen SN. Getting Better: Improving Health System Outcomes in Europe and Central Asia. Washington, DC: World Bank. 2013. http://documents.worldbank.org/curated/en/953751468250295078/pdf/ 781850WP0P11980onsolidated0complete.pdf. Accessed September 12, 2017.
2. Rechel B, McKee M. Health reform in Central and Eastern Europe and the former Soviet Union. Lancet. 2009;374(9696):1186–1195. CrossRef. Medline
3. Suhrcke M, Rocco L, McKee M. Health: A Vital Investment for Economic Development in Eastern Europe and Central Asia. Trowbridge: The Cromwell Press; 2007. http://www.euro.who.int/en/publications/abstracts/health-a-vital-investment-for-economic-development-in-eastern-europe-and-central-asians-for-risk-communication-from-the-bsecjd-saga. Accessed September 12, 2017.
4. Balabanova D, Roberts B, Richardson E, Haerpfer C, McKee M. Health care reform in the former Soviet Union: beyond the transition. Health Serv Res. 2012;47(2):840–864. CrossRef. Medline
5. Luck J, Peabody JW, DeMaria LM, Alvarado CS, Menon R. Patient and provider perspectives on quality and health system effectiveness in a transition economy: evidence from Ukraine. Soc Sci Med. 2014;114:57–65. CrossRef. Medline
6. Peabody JW, Shimkhada R, Quimbo S, Solon O, Javier X, McCulloch C. The impact of performance incentives on child health outcomes: results from a cluster randomized controlled trial in the Philippines. Health Policy Plan. 2014;29(5):615–621. CrossRef. Medline
7. Peabody J, Luck J, DeMaria L. Ukraine health system survey. Washington, DC: World Bank; 2011.
8. Peabody JW, Liu A. A cross-national comparison of the quality of clinical care using vignettes. Health Policy Plan. 2007;22(5):294–302. CrossRef. Medline
9. Asaria P, Chisholm D, Mathers C, Ezzati M, Beaglehole R. Chronic disease prevention: health effects and financial costs of strategies to reduce salt intake and control tobacco use. Lancet. 2007;370 (9604):2044–2053. CrossRef. Medline
10. Bhutta ZA, Das JK, Bahl R, et al; Lancet Newborn Interventions Review Group; Lancet Every Newborn Study Group. Can available interventions end preventable deaths in mothers, newborn babies, and stillbirths, and at what cost? Lancet. 2014;384(9940):347–370. CrossRef. Medline
11. Campbell OMR, Graham WJ; Lancet Maternal Survival Series steering group. Strategies for reducing maternal mortality: getting on with what works. Lancet. 2006;368(9543):1284–1299. CrossRef. Medline
12. Lee ACC, Cousens S, Darmstadt GL, et al. Care during labor and birth for the prevention of intrapartum-related neonatal deaths: a systematic review and Delphi estimation of mortality effect. BMC Public Health. 2011;11(suppl 3):S10. CrossRef. Medline
13. Jamison DT. Investing in health. In: Jamison DT, Breman JG, Measham AR, et al, editors. Disease Control Priorities in Developing Countries. 2nd ed. Washington, DC: World Bank; 2006. https://www.ncbi.nlm.nih.gov/books/NBK11728/. Accessed September 12, 2017.
14. Suhrcke M, McKee M, Sauto Arce R, Tsolova S, Mortensen J. The Contribution of Health to the Economy in the European Union. Brussels: European Commission; 2005. https://ec.europa.eu/health/archive/ph_overview/documents/health_economy_en.pdf. Accessed September 12, 2017.
15. Abegunde DO, Mathers CD, Adam T, Ortegon M, Strong K. The burden and costs of chronic diseases in low-income and middle-income countries. Lancet. 2007;370(9603):1929–1938. CrossRef. Medline
16. Das J, Gertler PJ. Variations in practice quality in five low-income countries: a conceptual overview. Health Aff. 2007;26(3):w296–w309. CrossRef. Medline
17. Das J, Holla A, Das V, Mohanan M, Tabak D, Chan B. In urban and rural India, a standardized patient study showed low levels of provider training and huge quality gaps. Health Aff. 2012;31 (12):2774–2784. CrossRef. Medline
18. Balabanova D, Mills A, Conteh L, et al. Good Health at Low Cost 25 years on: lessons for the future of health systems strengthening. Lancet. 2013;381(9883):2118–2133. CrossRef. Medline
19. Peabody JW, Taguiwalo MM, Robalino DA, Frenk J. Improving the quality of care in developing countries. In: Jamison DT, Breman JG, Measham AR, et al, editors. Disease Control Priorities in Developing Countries. 2nd ed. Washington, DC: World Bank; 2006. https://www.ncbi.nlm.nih.gov/books/NBK11728/. Accessed September 12, 2017.
20. Peabody JW, Luck J, DeMaria L, Menon R. Quality of care and health status in Ukraine. BMC Health Serv Res. 2014;14(1):446. CrossRef. Medline
21. Diamond-Smith N, Sudhinaraset M, Montagu D. Clinical and perceived quality of care for maternal, neonatal and antenatal care in Kenya and Namibia: the service provision assessment. Reprod Health. 2016;13(1):92. CrossRef. Medline
22. Stanton C, Armbruster D, Knight R, et al. Use of active management of the third stage of labour in seven developing countries. Bull World Health Organ. 2009;87(3):207–215. CrossRef. Medline
23. Columbia University, Averting Maternal Death and Disability (AMDD). Needs assessment of emergency obstetric and newborn care: obstetric facility assessment tool. New York: Columbia University; 2010.
24. SPA overview. The DHS Program website. https://dhsprogram.com/What-We-Do/Survey-Types/SPA.cfm. Accessed September 12, 2017.
25. Leonard KL, Masatu MC. The use of direct clinician observation and vignettes for health services quality evaluation in developing countries. Soc Sci Med. 2005;61(9):1944–1951. CrossRef. Medline
26. Brunner E, Probst M, Meichtry A, Luomajoki H, Dankaerts W. Comparison of clinical vignettes and standardized patients as measures of physiotherapists activity and work recommendations in patients with non-specific low back pain. Clin Rehabil. 2016;30 (1):85–94. CrossRef. Medline
27. Peabody JW, Luck J, Glassman P, et al. Measuring the quality of physician practice by using clinical vignettes: a prospective validation study. Ann Intern Med. 2004;141(10):771–780. CrossRef. Medline
28. Luck J, Peabody JW, Dresselhaus TR, Lee M, Glassman P. How well does chart abstraction measure quality? A prospective comparison of standardized patients with the medical record. Am J Med. 2000;108 (8):642–649. CrossRef. Medline
29. Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M. Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA. 2000;283(13):1715–1722. CrossRef. Medline
30. Peabody JP, Liu A, Alisse L, et al. Comparing quality in disparate settings using vignettes to control for case-mix variation. Working Paper No. 43. Disease Control Priorities Project; 2005.
31. Ministry of Health and Social Welfare (MoHSW) [Tanzania]; Ministry of Health (MoH) [Zanzibar]; National Bureau of Statistics (NBS); Office of the Chief Government Statistician (OCGS); ICF International. Tanzania Service Provision Assessment Survey (TSPA) 2014-15. Dar es Salaam, Tanzania, and Rockville, Maryland: MoHSW, MoH, NBS, OCGS, and ICF International; 2015. https://dhsprogram.com/pubs/pdf/SPA22/SPA22.pdf. Accessed September 12, 2017.
32. Pirkle CM, Dumont A, Zunzunegui MV. Medical recordkeeping, essential but overlooked aspect of quality of care in resource-limited settings. Int J Qual Health Care. 2012;24(6):564–567. CrossRef. Medline
33. Leonard K, Masatu MC. Outpatient process quality evaluation and the Hawthorne Effect. Soc Sci Med. 2006;63(9):2330–2340. CrossRef. Medline
34. Peabody JW, Quimbo S, Florentino J, et al. Comparative effectiveness of two disparate policies on child health: experimental evidence from the Philippines. Health Policy Plan. 2017;32(4):563–571. Medline
35. Full list of country HiTs. European Observatory on Health Systems and Policies website. http://www.euro.who.int/en/about-us/partners/observatory/publications/health-system-reviews-hits/fulllist-of-country-hits. Accessed September 12, 2017.
36. Kubal T, Peabody JW, Friedman E, Levine R, Pursell S, Letson DG. Using vignettes to measure and encourage adherence to clinical pathways in a quality-based oncology network: an early report on the Moffitt Oncology Network Initiative. Manag Care. 2015;24 (10):56–64. Medline
37. Murray CJL, Lopez AD. Measuring the global burden of disease. N Engl J Med. 2013;369(5):448–457. CrossRef. Medline
38. Moran AE, Roth GA, Narula J, Mensah GA. 1990-2010 global cardiovascular disease atlas. Global Heart. 2014;9(1):3–16. CrossRef. Medline
39. Gaffney B, Glasunov IS, Grabauskas V, Puska P, Shatchkute A, Stachenko S. A Strategy to Prevent Chronic Disease in Europe: A Focus on Public Health Action. The CINDI Vision. Copenhagen, Denmark: World Health Organization, Regional Office for Europe; 2004. http://www.euro.who.int/en/health-topics/noncommunicable-diseases/cancer/publications/pre-2009/astrategy-to-prevent-chronic-disease-in-europe.-a-focus-on-public-health-action.-the-cindi-vision. Accessed September 12, 2017.
40. Busse R, Blumel M, Scheller-Kreinsen D, Zentner A. Tackling Chronic Disease in Europe: Strategies, Interventions and Challenges. Copenhagen, Denmark: WHO Regional Office Europe; 2010. http://www.euro.who.int/en/health-topics/Life-stages/healthyageing/publications/2010/tackling-chronic-disease-in-europestrategies,-interventions-and-challenges-2010. Accessed September 12, 2017.
41. Partnership for Maternal, Newborn and Child Health (PMNCH); World Health Organization (WHO); World Bank; Alliance for Health Policy and Systems Research (AHPSR). Success Factors for Women’s and Children’s Health: Policy and Programme Highlights From 10 Fast-Track Countries. Geneva: WHO; 2014. http://www. who.int/pmnch/knowledge/publications/success_factors_ highlights.pdf. Accessed September 12, 2017.
42. Uxa F, Bacci A, Mangiaterra V, Chiaffoni GP. Essential newborn care training activities: 8 years of experience in Eastern European, Caucasian and Central Asian countries. Semin Fetal Neonatal Med. 2006;11(1):58–64. CrossRef. Medline
43. Newborn death and illness. The Partnership for Maternal, Newborn and Child Health (PMNCH) website. http://www.who.int/pmnch/media/press_materials/fs/fs_newborndealth_illness/en/. Updated September 2011. Accessed November 16, 2015.
44. Miteniece E, Pavlova M, Rechel B, Groot W. Barriers to accessing adequate maternal care in Central and Eastern European countries: a systematic literature review. Soc Sci Med. 2017;177:1–8. CrossRef. Medline
45. Donabedian A. The Definition of Quality and Approaches to Its Assessment. Ann Arbor, MI: Health Administration Press; 1980.
46. Lilford RJ, Brown CA, Nicholl J. Use of process measures to monitor the quality of clinical practice. BMJ. 2007;335(7621):648–650. CrossRef. Medline
47. World Health Organization (WHO). Guidelines on Basic Newborn Resuscitation. Geneva: WHO; 2012. http://www.who.int/maternal_child_adolescent/documents/basic_newborn_ resuscitation/en/. Accessed September 12, 2017.
48. World Health Organization (WHO). Recommendations on maternal and perinatal health. Geneva: WHO; 2013. http://www.who.int/maternal_child_adolescent/documents/guidelines-recommendations-maternal-health.pdf?ua=1. Accessed September 12, 2017.
49. Steg PG, James SK, Atar D, et al; Task Force on the management of ST-segment elevation acute myocardial infarction of the European Society of Cardiology (ESC). ESC Guidelines for the management of acute myocardial infarction in patients presenting with ST-segment elevation. Eur Heart J. 2012;33(20):2569–2619. CrossRef. Medline
50. Peabody JW, Strand V, Shimkhada R, Lee R, Chernoff D. Impact of rheumatoid arthritis disease activity test on clinical practice. PLoS One. 2013;8(5):e63215. CrossRef. Medline
51. Drexel H, Vonbank A, Fraunberger P, Riesen WF, Saely CH. Toward a more professional and practical medical education: a novel Central European approach. Adv Med Educ Pract. 2015;6:459–467. Medline
52. Peabody JW, Nordyke RJ, Tozija F, et al. Quality of care and its impact on population health: a cross-sectional study from Macedonia. Soc Sci Med. 2006;62(9):2216–2224. CrossRef. Medline
53. Leonard KL, Masatu MC. Changing health care provider performance through measurement. Soc Sci Med. 2017;181:54–65. CrossRef. Medline
54. Peabody JW, Rahman O, Fox K, Gertler P. Quality of care in public and private primary health care facilities: structural comparisons in Jamaica. Bull Pan Am Health Organ. 1994;28(2):122–141. Medline
55. National Academies of Sciences, Engineering, and Medicine. Improving Diagnosis in Health Care. Washington, DC: The National Academies Press.
56. Balanced Scorecard Basics. Balanced Scorecard Institute website. http://www.balancedscorecard.org/BSC-Basics/About-theBalanced-Scorecard. Accessed September 12, 2017.
57. International Society for Quality in Health Care, World Health Organization (WHO). Quality and Accreditation in Health Care Services: A Global Review. Geneva: WHO; 2003. http://www.who.int/hrh/documents/en/quality_accreditation.pdf. Accessed September 12, 2017.
58. Shimkhada R, Peabody JW, Quimbo SA, Solon O. The Quality Improvement Demonstration Study: an example of evidence-based policy-making in practice. Health Res Policy Syst. 2008;6(1):5. CrossRef. Medline
59. Marmot M, Friel S, Bell R, Houweling TAJ, Taylor S; Commission on Social Determinants of Health. Closing the gap in a generation: health equity through action on the social determinants of health. Lancet. 2008;372(9650):1661–1669. CrossRef. Medline
60. Gaziano TA, Pagidipati N. Scaling up chronic disease prevention interventions in lower- and middle-income countries. Annu Rev Public Health. 2013;34(1):317–335. CrossRef. Medline
61. Mohanan M, Vera-Hernández M, Das V, et al. The know-do gap in quality of health care for childhood diarrhea and pneumonia in rural India. JAMA Pediatr. 2015;169(4):349–357. CrossRef. Medline
62. Converse L, Barrett K, Rich E, Reschovsky J. Methods of observing variations in physicians’ decisions: the opportunities of clinical vignettes. J Gen Intern Med. 2015;30(suppl 3):586–594. CrossRef. Medline
63. Quimbo S, Wagner N, Florentino J, Solon O, Peabody J. Do health reforms to improve quality have long-term effects? Results of a followup on a randomized policy experiment in the Philippines. Health Econ. 2016;25(2):165–177. CrossRef. Medline
64. Gidengil CA, Linder JA, Beach S, Setodji CM, Hunter G, Mehrotra A. Using clinical vignettes to assess quality of care for acute respiratory infections. Inquiry. 2016;53. CrossRef. Medline
65. Evans SC, Roberts MC, Keeley JW, et al. Vignette methodologies for studying clinicians decision-making: Validity, utility, and application in ICD-11 field studies. Int J Clin Health Psychol. 2015;15(2):160–170. CrossRef
66. Weiner SJ, Schwartz A. Directly observed care: can unannounced standardized patients address a gap in performance measurement? J Gen Intern Med. 2014;29(8):1183–1187. CrossRef. Medline
67. Shah R, Edgar D, Evans BJW. Measuring clinical practice. Ophthalmic Physiol Opt. 2007;27(2):113–125. CrossRef. Medline
68. Barnett ML, Olenski AR, Jena AB. Patient mortality during unannounced accreditation surveys at US hospitals. JAMA Intern Med. 2017;177(5):693–700. CrossRef. Medline
69. Ersdal HL, Vossius C, Bayo E, et al. A one-day Helping Babies Breathe course improves simulated performance but not clinical management of neonates. Resuscitation. 2013;84(10):1422–1427. CrossRef. Medline
70. Peabody JW, Paculdo DR, Tamondong-Lachica D, et al. Improving clinical practice using a novel engagement approach: measurement, benchmarking and feedback, a longitudinal study. J Clin Med Res. 2016;8(9):633–640. CrossRef. Medline
71. Doyle C, Lennox L, Bell D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open. 2013;3(1):e001570. CrossRef. Medline
72. Peabody JW, Florentino J, Shimkhada R, Solon O, Quimbo S. Quality variation and its impact on costs and satisfaction: evidence from the QIDS study. Med Care. 2010;48(1):25–30. CrossRef. Medline
73. Peabody J, Shimkhada R, Adeyi O, Wang H, Broughton E, Kruk ME. Quality of care. In: Jamison D, Nugent R, Gelband H, et al, editors. Disease Control Priorities: Improving Health and Reducing Poverty. Washington, DC: The World Bank; 2017.
74. Institute of Medicine Committee on Preventing the Global Epidemic of Cardiovascular Disease. Promoting Cardiovascular Health in the Developing World: A Critical Challenge to Achieve Global Health. Washington, DC: The National Academies Press; 2010. https://www.ncbi.nlm.nih.gov/books/NBK45693/. Accessed September 12, 2017.