The public reporting of organizational performance in mental health: Coming soon to a mental health service near you

Australian and New Zealand Journal of Psychiatry

Volumn 45, Issue 6, 2011, Pages 432-443

  Trauer, Tom ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

HEALTH CARE ORGANIZATION; HEALTH CARE PERSONNEL; HUMAN; MANAGER; MENTAL HEALTH; MENTAL HEALTH ORGANIZATION; MENTAL HEALTH SERVICE; MENTAL PERFORMANCE; PUBLIC HEALTH SERVICE; REVIEW; RISK ASSESSMENT;

HUMANS; MENTAL DISORDERS; MENTAL HEALTH; MENTAL HEALTH SERVICES; QUALITY ASSURANCE, HEALTH CARE;

EID: 79955978323     PISSN: 00048674     EISSN: 14401614     Source Type: Journal    
DOI: 10.3109/00048674.2011.566546     Document Type: Review

References (86)

1. Commonwealth of Australia. Fourth National Mental Health Plan: an agenda for collaborative government action in mental health 2009-2014. Canberra: Commonwealth of Australia, 2009.
2. Berwick DM, James B, Coye MJ. Connections between quality measurement and improvement. Med Care 2003; 41:130-138.
3. Bird SM, Cox D, Farewell VT, Goldstein H, Holt T, Smith PC. Royal Statistical Society Working Party on Performance Monitoring in the Public Services. Performance indicators: good, bad, and ugly. London: Royal Statistical Society, 2003.
4. Marshall M, Shekelle P, Brook R, Leatherman S. Dying to know: public release of information about quality of health care. London: Nuffi eld Trust, 2000.
5. Propper C, Wilson D. The use and usefulness of performance measures in the public sector. Oxf Rev Econ Policy 2003; 19:250-267. (Pubitemid 37024536)
6. Pidd M. Perversity in public service performance measurement. Int J Product Perf Manag 2005; 54:482-493. (Pubitemid 41111934)
7. Neil DA, Clarke S, Oakley JG. Public reporting of individual surgeon performance information: United Kingdom developments and Australian issues. Med J Aust 2004; 181:266-268. (Pubitemid 39247887)
8. Merle V, Moret L, Pidhorz L et al. Does comparison of performance lead to better care? A pilot observational study in patients admitted for hip fracture in three French public hospitals. Int J Qual Health Care 2009; 21:321-329.
9. Williams SC, Schmaltz SP, Morton DJ, Koss RG, Loeb JM. Quality of care in US hospitals as refl ected by standardized measures, 2002-2004. N Engl J Med 2005; 353:255-264. (Pubitemid 41058325)
10. Guru V, Fremes SE, Naylor D et al. Public versus private institutional performance reporting: what is mandatory for quality improvement? Am Heart J 2006; 152:573-578. (Pubitemid 44233410)
11. Davies HTO. Public release of performance data and quality improvement: internal responses to external data by US health care providers. Qual Health Care 2001; 10:104-110.
12. Barr JK, Giannotti TE, Sofaer S, Duquette CE, Waters WJ, Petrillo MK. Using public reports of patient satisfaction for hospital quality improvement. Health Serv Res 2006; 41:663-682. (Pubitemid 43725343)
13. Goldman LE, Henderson S, Dohan DP, Talavera JA, Dudley RA. Public reporting and pay-for-performance: safety-net hospital executives'concerns and policy suggestions. Inquiry: Excellus Health Plan 2007; 44:137-145. (Pubitemid 47326679)
14. Fung CH, Lim Y-W, Mattke S, Damberg C, Shekelle PG. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med 2008; 148:111-123. (Pubitemid 351651554)
15. Shekelle PG, Lim Y-W, Mattke S, Damberg C. Does public release of performance results improve quality of care? A systematic review. London: The Health Foundation, 2008.
16. Shekelle PG. Public performance reporting on quality information, In: Smith PC, Mossialos E, and Papanicolas I, eds. Performance measurement for health system improvement: experiences, challenges and prospects. Cambridge: Cambridge University Press, 2010.
17. Heckman J, Heinrich C, Smith J. The performance of performance standards. J Hum Resour 2002; 37:778-811. (Pubitemid 36006325)
18. Ringel SP, Grading neurologists: is it wise? Neurology Today 2005; 5:7-8.
19. Casalino LP, Alexander GC, Jin L, Konetzka RT. General internists' views on pay-for-performance and public reporting of quality scores: a national survey. Health Aff (Millwood) 2007; 26:492-499.
20. Neuman HB, Michelassi F, Turner JW, Bass BL. Surrounded by quality metrics: what do surgeons think of ACS-NSQIP? Surgery 2009; 145:27-33.
21. Jacobs R, McDaid D. Performance measurement in mental health services. In: Smith PC, Mossialos E, and Papanicolas I, eds. Performance measurement for health system improvement: experiences, challenges and prospects. Cambridge: Cambridge University Press, 2010.
22. Rothberg MB, Benjamin EM, Lindenauer PK. Public reporting of hospital quality: recommendations to benefit patients and hospitals. J Hosp Med 2009; 4:541-545.
23. Utzon J, Kaergaard J. Publication of healthcare quality data to citizens: status and perspectives. Ugeskr Laeger 2009; 171: 1670-1674.
24. Schneider EC, Lieberman T. Publicly disclosed information about the quality of health care: response of the US public. Qual Health Care 2001; 10:96-103.
25. Canto JG. Selecting the ideal cardiovascular surgeon: is it possible with public dissemination of clinical outcomes? Editorial. Med Care 2007; 45:585-586.
26. Hibbard JH. What can we say about the impact of public reporting? Inconsistent execution yields variable results. Ann Intern Med 2008; 148:160-161. (Pubitemid 351651558)
27. Smith PC. On the unintended consequences of publishing performance data in the public sector. Int J Public Admin 1995; 18: 277-310.
28. Werner RM, Konetzka TR, Kruse GB. Impact of public reporting on unreported quality of care. Health Serv Res 2009; 44:379-398.
29. Werner RM, Konetzka TR, Stuart EA, Norton EC, Polsky D, Park J. Impact of public reporting on quality of postacute care. Health Serv Res 2009; 44:1169-1187.
30. Ganz DA, Wenger NS, Roth CP et al. The effect of a quality improvement initiative on the quality of other aspects of health care: the law of unintended consequences? Med Care 2007; 45:8-18.
31. Goodhart CAE. Monetary relationships: a view from Threadneedle Street. Papers in Monetary Economics. Canberra: Reserve Bank of Australia, 1975.
32. Danielsson, J. The Emperor Has No Clothes: Limits to Risk Modelling. Journal of Banking and Finance 2002; 26:1273-1296.
33. Lester H, Roland M. Performance measurement in primary care. In: Smith PC, Mossialos E, Papanicolas I, and Leatherman S, eds. Performance measurement for health system improvement. Cambridge: Cambridge University Press, 2010.
34. Checkland K, Marshall M, Harrison S. Re-thinking accountability: trust versus confi dence in medical practice. Qual Saf Health Care 2004; 13:130-135. (Pubitemid 38496865)
35. O'Neill O. Trust with accountability? J Health Serv Res Policy 2003; 8:3-4. (Pubitemid 36083143)
36. Thomas JW. Risk adjustment for measuring health care outcomes, 3rd edition. Book review. Int J Qual Health Care 2004; 16:181-182.
37. Dow MG, Boaz TL, Thornton D. Risk adjustment of Florida mental health outcomes data: concepts, methods, and results. J Behav Health Serv Res 2001; 28:258-272. (Pubitemid 32743537)
38. Hendryx MS, Teague GB. Comparing alternative risk-adjustment models. J Behav Health Serv Res 2001; 28:247.
39. Li Y, Cai X, Glance LG, Spector WD, Mukamel DB. national release of the nursing home quality report cards: implications of statistical methodology for risk adjustment. Health Serv Res 2009; 44:79-102.
40. Shahian DM, Edwards FH. Statistical risk modeling and outcomes analysis. Ann Thorac Surg 2008; 86:1717-1720.
41. Shahian DM, Normand S-LT. Comparison of 'risk-adjusted' hospital outcomes. Circulation 2008; 117:1955-1963.
42. Shahian DM, Hutter MM, Torchiana DF, Iezzoni LI. Transparency: a mandatory requirement for risk models. J Am Coll Surg 2008; 206:1240-1242. (Pubitemid 351697718)
43. Romano PS. Peer group benchmarks are not appropriate for health care quality report cards. Am Heart J 2004; 148:921-923. (Pubitemid 39646961)
44. Austin PC, Alter DA, Anderson GM, Tu JV. The impact of the choice of benchmark on the conclusions of hospital report cards. Am Heart J 2004; 148:1041-1046. (Pubitemid 39646981)
45. McLoughlin V, Leatherman S, Fletcher M, Owen JW. Improving performance using indicators. Recent experiences in the United States, the United Kingdom, and Australia. Int J Qual Health Care 2001; 13:455-462. (Pubitemid 33133919)
46. Scott IA, Ward M. Public reporting of hospital outcomes based on administrative data: risks and opportunities. Med J Aust 2006; 184:571-575. (Pubitemid 43950028)
47. Mor V, Angelelli J, Jones R, Roy J, Moore T, Morris J. Inter-rater reliability of nursing home quality indicators in the US. BMC Health Serv Res 2003; 3:20.
48. Roy J, Mor V. The effect of provider-level ascertainment bias on profiling nursing homes. Stat Med 2005; 24:3609-3629. (Pubitemid 41700846)
49. Sangl J, Saliba D, Gifford DR, Hittle DF. Challenges in measuring nursing home and home health quality: lessons from the first national healthcare quality report. Med Care 2005; 43: 124-132.
50. Goldstein H, Speigelhalter DJ. League tables and their limitations: statistical issues in comparisons of institutional performance. J R Stat Soc A 1996; 159:385-443. (Pubitemid 126333152)
51. Shahian DM, Torchiana DF, Shemin RJ, Rawn JD, Normand S-LT. Massachusetts cardiac surgery report card: implications of statistical methodology. Ann Thorac Surg 2005; 80:2106-2113. (Pubitemid 41718036)
52. Mor V. Improving the quality of long-term care with better information. Milbank Q 2005; 83:333-364. (Pubitemid 41551752)
53. Staiger DO, Dimick JB, Baser O, Fan Z, Birkmeyer JD. Empirically derived composite measures of surgical performance. Med Care 2009; 47:226-233.
54. Willis CD, Stoelwinder JU, Lecky FE et al. Applying composite performance measures to trauma care. J Trauma Injury Infect Crit Care 2010; 69:256-262.
55. Smith PC, Mossialos E, Papanicolas I. Performance measurement for health system improvement: experiences, challenges and prospects. Cambridge: Cambridge University Press, 2010.
56. Fong J, Marsh GM, Stokan LA, Sang W, Vinson C, Ruhl LP. Hospital quality performance report: an application of composite scoring. Am J Med Qual 2008; 23:287-295.
57. O'Brien SM, Shahian DM, DeLong ER et al. Quality measurement in adult cardiac surgery: part 2. Statistical considerations in composite measure scoring and provider rating. Ann Thorac Surg 2007; 83:S13-26. (Pubitemid 46440798)
58. O'Brien SM, DeLong ER, Dokholyan RS, Edwards FH, Peterson ED. Exploring the behavior of hospital composite performance measures: an example from coronary artery bypass surgery. Circulation 2007; 116:2969-2975. (Pubitemid 350291204)
59. Jacobs R, Goddard M, Smith PC. Are composite measures a robust Reflection of performance in the public sector? Centre for Health Economics Research Paper 16. York: CHE, 2006.
60. Leckie G, Goldstein H. The limitations of using school league tables to inform school choice. J R Stat Soc A 2009; 172:835-851.
61. Rothberg MB, Morsi E, Benjamin EM, Pekow PS, Lindenauer PK. Choosing the best hospital: the limitations of public quality reporting. Health Aff (Millwood) 2008; 27:1680-1687.
62. Australian Curriculum, Assessment and Reporting Authority (ACARA). MySchool. Frequently Asked Questions about MySchool [accessed 17 March 2011] Available from URL: http://www.acara.edu.au/verve/-resources/FAQs.pdf.
63. Edgeman-Levitan S, Cleary PD. What information do consumers want and need? Health Aff (Millwood) 1996; 15:42-56. (Pubitemid 126434352)
64. Leatherman S, McCarthy D. Public disclosure of health care performance reports: experience, evidence and issues for policy. Int J Qual Health Care 1999; 11:93-101.
65. Hibbard JH, Jewitt JJ. Will quality report cards help consumers? Health Aff (Millwood) 1997; 16:218-228. (Pubitemid 127463732)
66. Oldham JM, Golden WE, Rosof BM. Quality improvement in psychiatry: why measures matter. J Psychiatr Practice 2007; 14:S8- 17.
67. Hibbard JH, Peters E. supporting informed consumer health care decisions: data presentation approaches that facilitate the use of information in choice. Annu Rev Public Health 2003; 24:413-433. (Pubitemid 37056038)
68. Peters E, Dieckmann N, Dixon A, Hibbard JH, Mertz CK. Less is more in presenting quality information to consumers. Med Care Res Rev 2007; 64:169-190. (Pubitemid 46570715)
69. Hibbard JH, Greene J, Daniel D. What is quality anyway? Performance reports that clearly communicate to consumers the meaning of quality of care. Med Care Res Rev 2010.
70. Mattke S, Reilly K, Martinez-Vidal E, McLean B, Gifford D. Reporting quality of nursing home care to consumers: the Maryland experience. Int J Qual Health Care 2003; 15:169-177. (Pubitemid 36432381)
71. Vaiana ME, McGlynn EA. What cognitive science tells us about the design of reports for consumers. Med Care Res Rev 2002; 59:3-35. (Pubitemid 34163755)
72. Donnelley RR. Mental Health Project Final Report: National Benchmarking Project Report 2. Edinburgh: The Scottish Government, 2008.
73. Bremer RW, Scholle SH, Keyser D, Houtsinger JV, Pincus HA. Pay for performance in behavioral health. Psychiatr Serv 2008; 59: 1419-1429.
74. Bauer MS. Areview of quantitative studies of adherence to mental health clinical practice guidelines. Harv Rev Psychiatry 2002; 10:138-153. (Pubitemid 34553138)
75. McGlynn EA, Asch SM, Adams J et al. The quality of health care delivered to adults in the United States. N Engl J Med 2003; 348:2635-2645. (Pubitemid 36741592)
76. Institute of Medicine. I mproving the quality of health care for mental and substance-use conditions. Washington, DC, 2005. [cited 17 March 2011]. Available from URL: www.nap.edu/catalog.php?record-id-11470#toc or www.iom.edu/?id-30858.
77. Stein BD, Kogan JN, Essock S, Fudurich S. Views of mental health care consumers on public reporting of information on provider performance. Psychiatr Serv 2009; 60:689-692.
78. Astagneau P, L'Heriteau F. Surveillance of surgical-site infections: impact on quality of care and reporting dilemmas. Curr Opin Infect Dis 2010; 23:306-310.
79. Fletcher M. Hand hygiene and infection in hospitals: what do the public know; what should the public know? J Hosp Infect 2009; 73:397-399.
80. Kravchuk RS, Schack RW. Designing effective performance-measurement systems under the Government Performance and Results Act of 1993 Public Adm Rev 1996; 564:348-358. (Pubitemid 126421586)
81. Guru V, Naylor CD, Fremes SE, Teoh K, Tu JV. Publicly reported provider outcomes: the concerns of cardiac surgeons in a singlepayer system. Can J Cardiol 2009; 25:33-38.
82. Duckett SJ, Collins J, Kamp M, Walker K. An improvement focus in public reporting: the Queensland approach. Med J Aust 2008; 189:616-617.
83. Ferguson TB. Reporting for provider performance: should we punish the bad, or try to make them all good? Am Heart J 2006; 152:410-413.
84. Henderson A, Henderson S. Provision of a surgeon's performance data for people considering elective surgery. Cochrane Database of Systematic Reviews 2010 ; 11:CD006327.
85. Bassilios B, Pirkis J, Fletcher J, Burgess P, Gurrin L, King K, Kohn F, Blashki G. The complementarity of two major Australian primary mental health care initiatives. Aust N Z J Psychiatry 2010; 44:997-1004.
86. Australian Mental Health Outcomes and Classification Network. Public reporting of organisational performance: Areview of the literature, 2010.