Interpreting health outcomes

Journal of Evaluation in Clinical Practice

Volumn 3, Issue 3, 1997, Pages 187-199

  Davies, Huw Talfryn Oakley ^a   Crombie, Iain Kinloch ^b  

^a UNIVERSITY OF ST ANDREWS   (United Kingdom)

^b UNIVERSITY OF DUNDEE   (United Kingdom)

Author keywords

Bias; Case mix; Confounding; Outcomes; Quality; Routine data

Indexed keywords

HEALTH SERVICES RESEARCH; HUMAN; METHODOLOGY; OUTCOME ASSESSMENT; REPRODUCIBILITY; REVIEW; STATISTICAL ANALYSIS; UNITED KINGDOM; UNITED STATES;

DATA INTERPRETATION, STATISTICAL; GREAT BRITAIN; HEALTH SERVICES RESEARCH; HUMANS; OUTCOME ASSESSMENT (HEALTH CARE); REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; UNITED STATES;

EID: 0031196523     PISSN: 13561294     EISSN: None     Source Type: Journal    
DOI: 10.1046/j.1365-2753.1997.00003.x     Document Type: Review

References (109)

1. Anderson C. (1994) Measuring What Works in Health Care. Science 263, 1080-1082.
2. Anonymous (1989) Databases for health care outcomes [editorial]. Lancet ii, 195-196.
3. Anonymous (1992) Cross design synthesis: a new strategy for studying medical outcomes? [editorial]. Lancet 340, 944-946.
4. Anonymous (1993) Dicing with death rates [editorial]. Lancet 341, 1183-1184.
5. Anonymous (1994) From research to practice [editorial]. Lancet 344, 417-418.
6. Bardsley M.J. & Coles J.M. (1992) Practical experience in auditing patient outcomes. Quality in Health Care 1, 124-130.
7. Barrie J.L. & Marsh D.R. (1992) Quality of data in the Manchester orthopaedic database. British Medical Journal 304, 159-62.
8. Berwick D.M. (1989) Continuous improvement as an ideal in health care. New England Journal of Medicine 320, 53-56.
9. Berwick D.M., Enthoven A. & Bunker J.P. (1992) Quality management in the NHS: the doctor's role - I. British Medical Journal 304, 235-239.
10. Black N. (1996) Why we need observational studies to evaluate the effectiveness of health care. British Medical Journal 312, 1215-1218.
11. Bowling A. (1991) Measuring Health. A Review of Quality of Life Measurement Scales. Open University Press, Milton Keynes.
12. Brennan T.A., Leape L.L. & Laird N.M. (1991) Incidence of adverse events and negligence in hospitalized patients. New England Journal of Medicine 324, 370-376.
13. Bunker J.P. (1990) Variations in hospital admissions and the appropriateness of care: American preoccupations? British Medical Journal 301, 531-2.
14. Calman K.C. (1994) The ethics of allocation of scarce health care resources: a view from the centre. Journal of Medical Ethics 20, 71-74.
15. Caplan R.A., Posner K.L. & Cheney F.W. (1991) Effects of outcome on physician judgements of appropriateness of care. Journal of the American Medical Association 265, 1957-1960.
16. Charlson M.E., Sax F.L., MacKenzie C.R., Braham R.L., Fields S.D. and Douglas R.G. Jr (1987) Morbidity during hospitalization: can we predict it? Journal of Chronic Diseases 40, 705-12.
17. Charlton B.G. (1994) Practice guidelines and practical judgement: the role of mega-trials, meta-analysis and consensus. British Journal of General Practice 44, 290-291.
18. Charlton B.G. (1995) Mega-trials: methodological issues and clinical implications. Journal of the Royal College of Physicians of London 29, 96-100.
19. Chassin M.R., Hannan E.L. & DeBuono B.A. (1996) Benefits and hazards of reporting medical outcomes publicly. New England Journal of Medicine 334, 394-398.
20. Cleary R. (1994) Establishing inter-hospital comparisons of outcomes. International Journal for Quality in Health Care 6, 31-36.
21. Cleary R., Beard R., Coles J., Devlin B., Hopkins A., Schumacher D. & Wickings I. (1994) Comparative hospital databases: value for management and quality. Quality in Health Care 3, 3-10.
22. Clinical Outcomes Working Group (1994) Clinical Outcome Indicators. The Scottish Office Clinical Resource and Audit Group, Edinburgh.
23. Clinical Outcomes Working Group (1995) Clinical Outcome Indicators. The Scottish Office Clinical Resource and Audit Group, Edinburgh.
24. Clinical Outcomes Working Group (1996) Clinical Outcome Indicators. The Scottish Office Clinical Resource and Audit Group, Edinburgh.
25. Clinton J.J. (1990) From the Agency for Health Care Policy and Research. Journal of the American Medical Association 263, 1612.
26. Clinton J.J. (1991) From the Agency for Health Care Policy and Research. Journal of the American Medical Association 266, 2057.
27. Copeland G.P., Sagar P., Brennan J., Roberts G., Ward J., Cornford P., Millar A. & Harris C. (1995) Risk-adjusted analysis of surgeon performance: a 1-year study. British Journal of Surgery 82, 408-411.
28. Coulter A., Brown S. & Daniels A. (1989) Computer held chronic disease registers in general practice: a validation study. Journal of Epidemiology and Community Health 43, 25-28.
29. Crombie I.K. (1996) The Pocket Guide to Critical Appraisal. BMJ Publishing, London.
30. Crombie I.K. & Davies H.T.O. (1991) Computers in audit: servants or sirens? British Medical Journal 303, 403-404.
31. Crombie I.K. & Davies H.T.O. (1993) Missing link in the audit cycle. Quality in Health Care 2, 47-48.
32. Crombie I.K. & Davies H.T.O. (1996) Research in Health Care: Design Conduct and Interpretation of Health Services Research. John Wiley & Sons, Chichester.
33. Davies H.T.O. & Crombie I.K. (1995) Assessing the quality of care: measuring well supported processes may be more enlightening than monitoring outcomes. British Medical Journal 311, 766.
34. Dawson J.H. (1987) Practice variations: a challenge for physicians [editorial]. Journal of the American Medical Association 258, 2570.
35. Delamothe T. (1994a) Preface. In Outcomes Into Clinical Practice (ed. T. Delamothe), ix-xii. BMJ Publishing Group, London.
36. Delamothe T. (1994b) Using outcomes research in clinical practice [editorial]. British Medical Journal 308, 1583-1584.
37. Department of Health (1992) The Health of the Nation: A Strategy for Health in England. HMSO, London.
38. Dickson N. (1995) League tables: use for patients. Quality in Health Care 4, 1.
39. Dilner L. (1994) Scottish Death Rates Published With Health Warning. British Medical Journal 309, 1599-1600.
40. Epstein A. (1995) Performance reports on quality - prototypes, problems and prospects. New England Journal of Medicine 333, 57-61.
41. Epstein A.M. (1990) The outcomes movement - will it get us where we want to go? New England Journal of Medicine 323, 266-269.
42. Epstein M.H. & Kurtzig B.S. (1994) Statewide health information: a tool for improving hospital accountability. The Joint Commission Journal on Quality Improvement 20, 370-371.
43. Ernst E. & Resch K.L. (1995) Concept of true and perceived placebo effects. British Medical Journal 311, 551-553.
44. Frater A. & Costain D. (1992) Any better? Outcome measures in medical audit. British Medical Journal 304, 519-520.
45. Goldman R.L. & Thomas T.L. (1994) Using mortality rates as a screening tool: the experience of the Department of Veterans Affairs. The Joint Commission Journal on Quality Improvement 20, 511-521.
46. Green J. & Wintfeld N. (1995) Report cards on cardiac surgeons: assessing New York State's approach. New England Journal of Medicine 332, 1229-1232.
47. Greenfield S. (1989) The state of outcome research: are we on target? New England Journal of Medicine 320, 1142-1143.
48. Greenfield S., Apolone G., McNeil B.J. & Cleary P.D. (1993) The importance of co-existant disease in the occurrence of postoperative complications and one-year recovery in patients undergoing total hip replacement. Medical Care 31, 141-154.
49. Grover F.L., Hammermeister K.E. & Shroyer A.L. (1995) Quality initiatives and the power of the database: what they are and how they are run. Annals of Thoracic Surgery 60, 1514-1521.
50. Gulliford M.C. (1992) Evaluating prognostic factors: implications for measurement of health care outcome. Journal of Epidemiology and Community Health 46, 323-326.
51. Hammermeister K.E., Shroyer A.L., Sethi G.K. & Grover F.L. (1995) Why it is important to demonstrate linkages between outcomes of care and processes and structures of care. Medical Care 33, OS5-16.
52. Hannan E.L., Kilburn H. Jr, Racz M., Shields E. & Chassin M.R. (1994) Improving the outcomes of coronary artery bypass surgery in New York State. Journal of the American Medical Association 271, 761-766.
53. Hartz A.J. & Kuhn E.M. (1994) Comparing hospitals that perform coronary artery bypass surgery: the effect of outcome measures and data sources. American Journal of Public Health 84, 1609-1614.
54. Hofer T.P. & Hayward R.A. (1996) Identifying poor quality hospitals: can hospital mortality rates detect quality problems for medical diagnoses? Medical Care 34, 737-753.
55. Holland W.W., Fitzgerald A.P., Hildrey S.J. & Phillips S.J. (1994) Heaven can wait. Journal of Public Health Medicine 16, 321-330.
56. Hopkins A. (1996) Clinical audit: time for a reappraisal? Journal of the Royal College of Physicians of London 30, 415-425.
57. Iezzoni L.I. (1990) Using administrative diagnostic data to assess the quality of hospital care: pitfalls and potential of ICD-9-CM. International Journal of Technology Assessment in Health Care 6, 272-281.
58. Iezzoni L.I., Shwartz M., Ash A.S., Hughes J.S., Daley J. & Mackiernan Y.D. (1995) Using severity-adjusted stroke mortality rates to judge hospitals. International Journal for Quality in Health Care 7, 81-94.
59. Iezzoni L.I., Shwartz M., Ash A.S., Hughes J.S., Daley J. and Mackiernan Y.D. (1996) Severity measurement methods and judging hospital death rates for pneumonia. Medical Care 34, 11-28.
60. Jennett B. (1988) Variations in surgical practice: welcome diversity or disturbing differences. British Journal of Surgery 75, 630-631.
61. Johnson N., Mant D., Jones L. & Randall T. (1991) Use of computerised general practice data for population surveillance: comparative study of influenza data. British Medical Journal 302, 763-765.
62. Kazandjian V.A., Wood P. & Lawthers J. (1995) Balancing science and practice in indicator devlopment: The Maryland Hospital Association Quality Indicator (QI) Project. International Journal for Quality in Health Care 7, 39-46.
63. Kee F. (1993) Referrals for coronary angiography in a high risk population. Quality in Health Care 2, 87-90.
64. Kee F., Gaffney B., Currie S. and O'Reilly D. (1993) Access to coronary catheterisation: fair shares for all? British Medical Journal 307, 1305-1307.
65. Khan I.H., Catto G.R.D., Edward N., Fleming L.W., Henderson I.S. & MacLeod A.M. (1993) Influence of coexisting disease on survival on renal-replacement therapy. Lancet 341, 415-419.
66. Krakauer H., Clifton Bailey R., Cooper H., Yu W.-K., Skellan K.J. & Kattakkuzhy G. (1995) The systematic assessment of variations in medical practices and their outcomes. Public Health Reports 110, 2-12.
67. Long A.F. & Dixon P. (1996) Monitoring outcomes in routine practice: defining appropriate measurement criteria. Journal of Evaluation in Clinical Practice 2, 71-78.
68. McDowell I. & Newell C. (1987) Measuring Health: A Guide to Rating Scales and Questionnaires. Oxford University Press, New York.
69. McKee M. & Hunter D. (1995) Mortality league tables: do they inform or mislead? Quality in Health Care 4, 5-12.
70. McLaughlin T.J., Soumerai S.B., Willison D.J., Gurwitz J.H., Borbas C., Guadagnoli E., McLaughlin B., Morris N., Cheng S.C., Hauptman P.J., Antman E., Casey L., Asinger R. & Gobel F. (1996) Adherence to national guidelines for drug treatment of suspected acute myocardial infarction: evidence for undertreatment in women and the elderly. Archives of Internal Medicine 156, 799-805.
71. McPherson K., Wennberg J.E., Hovind O.B. & Clifford P. (1982) Small-area variations in the use of common surgical procedures: an international comparison of New England, England, and Norway. New England Journal of Medicine 307, 1310-1314.
72. Mant J. & Hicks N. (1995) Detecting differences in quality of care: how sensitive are process and outcome measures in the treatment of acute myocardial infarction? British Medical Journal 311, 793-796.
73. Marwick C. (1993) Federal agency focuses on outcomes research. Journal of the American Medical Association 270, 164-165.
74. Miller R. & Lazar J. (1995) Public reporting of performance measures in home care. The Joint Commission Journal on Quality Improvement 21, 105-115.
75. Moller J.H., Powell C.B., Joransen J.A. & Borbas C. (1994) The Pediatric Cardiac Care Consortium - revisited. The Joint Commission Journal on Quality Improvement 20, 661-662.
76. Morton-Jones T. & Pringle M. (1993) Explaining variations in prescribing costs across England. British Medical Journal 306, 1731-1734.
77. Murley R.S. (1956) Carcinoma of the breast: the assessment of results. Canadian Medical Association Journal 74, 427-432.
78. Murley R.S. (1991) Axillary dissection in breast cancer. Lancet 337, 1221.
79. Nash D.B. (1992) Is the Quality Cart Before the Horse? Journal of the American Medical Association 268, 917-918.
80. Naylor C.D. & Guyatt G.H. (1996) Users' guides to the medical literature - how to use an article reporting variations in the outcomes of health services. Journal of the American Medical Association 275, 554-558.
81. Nobrega F.T., Morrow G.W. Jr, Smoldt R.K. & Offord K.P. (1977) Quality assessment in hypertension: analysis of process and outcome methods. New England Journal of Medicine 296, 145-148.
82. Noseworthy J.H., Ebers G.C., Vandervoort M.K., Farquhar R.E., Yetisir E. & Roberts R. (1994) The impact of blinding on the results of a randomized, placebo-controlled multiple sclerosis clinical trial. Neurology 44, 16-20.
83. O'Connor G.T., Plume S.K., Olmstead E.M., Morton J.R., Maloney C.T., Nugent W.C., Hernandez F. Jr, Clough R., Leavitt B.J., Coffin L.H., Marrin C.A.S., Wennberg D., Birkmeyer J.D., Charlesworth D.C., Malenka D.J., Quinton H.B. & Kasper J.F. (1996) A regional intervention to improve the hospital mortality associated with coronory artery bypass graft surgery. Journal of the American Medical Association 275, 841-846.
84. O'Leary D.S. (1995) Future opportunities and obstacles - measurement and accountability: taking careful aim. The Joint Commission Journal on Quality Improvement 21, 354-357.
85. Orchard C. (1994) Comparing healthcare outcomes. British Medical Journal 308, 1493-1496.
86. Organisation for Economic Co-operation and Development (1994) The Reform of Health Care Systems: a Review of 17 OECD Countries. OECD, Paris.
87. Pears J., Alexander V., Alexander G.F. & Waugh N.R. (1992) Audit of the quality of hospital discharge data. Health Bulletin (Edinburgh) 50, 356-361.
88. Peto R., Collins R. & Gray R. (1993) Large scale randomised evidence: large simple trials and overviews of trials. Annals of the New York Academy of Sciences 703, 314-340.
89. Petticrew M., McKee M. & Jones J. (1993) Coronary artery surgery: are women discriminated against? British Medical Journal 306, 1164-1166.
90. Pocock S.J. (1983) Clinical Trials: A Practical Approach. John Wiley & Sons, Chichester.
91. Pollack M.M., Alexander S.R., Clarke N., Ruttimann U.E., Tesselaar H.M. & Bachulis A.C. (1991) Improved outcomes from tertiary center pediatric intensive care: a statewide comparison of tertiary and nontertiary care facilities. Critical Care Medicine 19, 150-159.
92. Proctor T.F., Yarcheski A. & Oriscello R.G. (1996) The relationship of hospital process variables to patient outcome post-myocardial infarction. International Journal of Nursing Studies 33, 121-130.
93. Relman A.S. (1988) Assessment and accountability: the third revolution in medical care. New England Journal of Medicine 319, 1220-1222.
94. Richardson P.H. (1994) Placebo effects in pain management. Pain Reviews 1, 15-32.
95. Rockall T.A., Logan R.F.A., Devlin H.B. & Northfield T.C. (1995) Variation in outcome after acute gastrointestinal haemorrhage. Lancet 346, 346-350.
96. Roland M. & Coulter A. (eds) (1992) Hospital Referrals. Oxford General Practice Series. Oxford University Press, Oxford.
97. Rosenthal G.E. & Harper D.L. (1994) Cleveland Health Quality Choice: a model for collaborative community-based outcomes assessment. The Joint Commission Journal on Quality Improvement 20, 425-442.
98. Rowan K.M., Kerr J.H., Major E., McPherson K., Short A. & Vessey M.P. (1993) Intensive Care Society's APACHE II study in Britain and Ireland - II: Outcome comparisons of intensive care units after adjustment for case mix by the American APACHE II method. British Medical Journal 307, 977-981.
99. Royal College of Radiologists Working Party (1991) A multicentre audit of hospital referral for radiological investigation in England and Wales. British Medical Journal 303, 809-812.
100. Schroeder S.A. (1987) Outcome assessment 70 years late: are we ready? New England Journal of Medicine 316, 160-161.
101. Schroeder S.A. & Kabcenell A.I. (1991) Do bad outcomes mean substandard care? Journal of the American Medical Association 265, 1995.
102. Sheldon T.A. (1994) Please bypass the PORT - Observational studies of effectiveness run a poor second to randomised controlled trials. British Medical Journal 309, 142-143.
103. Shwartz M., Iezzoni L.I., Moskowitz M.A., Ash A.S. & Sawitz E. (1996) The importance of comorbidities in explaining differences in patient costs. Medical Care 34, 767-782.
104. Skolnick A.A. (1993) Joint Commission will collect, publicize outcomes. Journal of the American Medical Association 270, 165-171.
105. Smith P. (1995) Outcome-related performance indicators and organizational control in the public sector. In Performance Measurement and Evaluation (eds J. Holloway, J. Lewis & G. Mallory), pp. 192-216. SAGE, London.
106. Wennberg J.E., Roos N., Sola L., Schori A. & Jaffe R. (1987) Use of claims data systems to evaluate health care outcomes: mortality and reoperation following prostatectomy. Journal of the American Medical Association 257, 933-936.
107. Wilkin D. & Dornan C. (1990) General Practitioner Referrals to Hospital. A Review of Research and its Implications for Policy and Practice. Centre for Primary Care Research, Manchester.
108. Wyatt J. (1995) Acquisition and use of clinical data for audit and research. Journal of Evaluation in Clinical Practice 1, 15-27.
109. Yudkin P.L. & Redman C.W.G. (1990) Obstetric audit using routinely collected computerised data. British Medical Journal 301, 1371-1373.