EAPC White Paper on outcome measurement in palliative care: Improving practice, attaining outcomes and delivering quality services - Recommendations from the European Association for Palliative Care (EAPC) Task Force on Outcome Measurement

Palliative Medicine

Volumn 30, Issue 1, 2016, Pages 6-22

  Bausewein, Claudia ^a   Daveson, Barbara A ^b   Currow, David C ^c   Downing, Julia ^d   Deliens, Luc ^e   Radbruch, Lukas ^f   Defilippi, Kath ^g   Ferreira, Pedro Lopes ^h   Costantini, Massimo ⁱ   Harding, Richard ^b   Higginson, Irene J ^b  

^a LUDWIG MAXIMILIANS UNIVERSITY   (Germany)

^b KING'S COLLEGE LONDON   (United Kingdom)

^c FLINDERS UNIVERSITY   (Australia)

^d MAKERERE UNIVERSITY   (Uganda)

^e VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

^f UNIVERSITY HOSPITAL BONN   (Germany)

^g Hospice Palliative Care Association of South Africa   (South Africa)

^h UNIVERSITY OF COIMBRA   (Portugal)

ⁱ S MARIA NUOVA HOSPITAL   (Italy)

Author keywords

clinical practice; outcome assessment; Outcome measures; palliative care; patient outcome assessment; patient reported outcome measure; research

Indexed keywords

ADOPTION; AWARENESS; CLINICAL PRACTICE; DOCTOR PATIENT RELATION; HUMAN; HUMAN EXPERIMENT; MODEL; OUTCOME ASSESSMENT; PALLIATIVE THERAPY; QUALITY CONTROL; ADVISORY COMMITTEE; EUROPE; PROCEDURES; STANDARDS; TOTAL QUALITY MANAGEMENT;

ADVISORY COMMITTEES; EUROPE; HUMANS; OUTCOME ASSESSMENT (HEALTH CARE); PALLIATIVE CARE; QUALITY IMPROVEMENT;

EID: 84949908276     PISSN: 02692163     EISSN: 1477030X     Source Type: Journal    
DOI: 10.1177/0269216315589898     Document Type: Review

References (115)

1. Gruenewald DA, Higginson IJ, Vivat B, et al. Quality of life measures for the palliative care of people severely affected by multiple sclerosis: a systematic review. Mult Scler 2004; 10 (6): 690-704.
2. Currow DC, Allingham S, Yates P, et al. Improving national hospice/palliative care service symptom outcomes systematically through point-of-care data collection, structured feedback and benchmarking. Support Care Cancer 2015; 23 (2): 307-315.
3. Department of Health. Equity and excellence: liberating the NHS. The Stationery Office, 2010, https://www.gov.uk/government/uploads/system/uploads/attachment-data/file/213823/dh-117794.pdf
4. Harding R, Higginson IJ,. PRISMA: a pan-European co-ordinating action to advance the science in end-of-life cancer care. Eur J Cancer 2010; 46 (9): 1493-1501.
5. Bausewein C, Higginson IJ, Benalia A, et al. PRISMA WP4 scoping exercise. Resources for outcome measures in palliative care. London: PRISMA, Cicely Saunders Institute KCL, 2009.
6. Bausewein C, Simon ST, Benalia H, et al. Implementing patient reported outcome measures (PROMs) in palliative care-users' cry for help. Health Qual Life Outcomes 2011; 9: 27.
7. Harding R, Simon ST, Benalia H, et al. The PRISMA Symposium 1: outcome tool use. Disharmony in European outcomes research for palliative and advanced disease care: too many tools in practice. J Pain Symptom Manage 2011; 42 (4): 493-500.
8. Daveson BA, Simon ST, Benalia H, et al. Are we heading in the same direction? European and African doctors' and nurses' views and experiences regarding outcome measurement in palliative care. Palliat Med 2012; 26 (3): 242-249.
9. Simon ST, Higginson IJ, Harding R, et al. Enhancing patient-reported outcome measurement in research and practice of palliative and end-of-life care. Support Care Cancer 2012; 20 (7): 1573-1578.
10. Bausewein C, Daveson BA, Benalia A, et al. Outcome measurement in palliative care-the essentials. London: PRISMA, 2009.
11. Higginson IJ, Evans CJ, Grande G, et al. Evaluating complex interventions in end of life care: the MORECare statement on good practice generated by a synthesis of transparent expert consultations and systematic reviews. BMC Med 2013; 11: 111.
12. Evans CJ, Benalia H, Preston NJ, et al. The selection and use of outcome measures in palliative and end-of-life care research: the MORECare International Consensus Workshop. J Pain Symptom Manage 2013; 46 (6): 925-937.
13. Brundage M, Blazeby J, Revicki D, et al. Patient-reported outcomes in randomized clinical trials: development of ISOQOL reporting standards. Qual Life Res 2013; 22 (6): 1161-1175.
14. Cella D, Yount S, Rothrock N, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years. Med Care 2007; 45 (5 Suppl. 1): S3-S11.
15. Kaasa S, Loge JH, Fayers P, et al. Symptom assessment in palliative care: a need for international collaboration. J Clin Oncol 2008; 26 (23): 3867-3873.
16. Eagar K, Watters P, Currow DC, et al. The Australian Palliative Care Outcomes Collaboration (PCOC)-measuring the quality and outcomes of palliative care on a routine basis. Aust Health Rev 2010; 34 (2): 186-192.
17. Pastrana T, Radbruch L, Nauck F, et al. Outcome indicators in palliative care-how to assess quality and success. Focus group and nominal group technique in Germany. Support Care Cancer 2010; 18 (7): 859-868.
18. Donabedian A,. Explorations in quality assessment and monitoring. Ann Arbor, MI: Health Administration Press, 1980.
19. Porter ME,. What is value in health care? N Engl J Med 2010; 363 (26): 2477-2481.
20. Dawson J, Doll H, Fitzpatrick R, et al. The routine use of patient reported outcome measures in healthcare settings. BMJ 2010; 340: c186.
21. Ware J Jr, Sherbourne C,. The MOS 36-item short-form health survey (SF-36): I. Conceptual framework and item selection. Med Care 1992; 30 (6): 473-483.
22. EuroQol Group. EuroQol-a new facility for the measurement of health-related quality of life. Health Policy 1990; 16: 199-208.
23. Goldberg D, Hillier V,. A scaled version of the General Health Questionnaire. Psychol Med 1979; 9 (1): 139-145.
24. Bergner M, Bobbitt R, Carter W, et al. The Sickness Impact Profile: development and final revision of a health status measure. Med Care 1981; 19 (8): 787-805.
25. Higginson IJ, Harding R,. Outcome measurement. In: Addington-Hall J, Bruera E, Higginson IJ, et al. (eds) Research methods in palliative care. Oxford: Oxford University Press, 2007, pp. 99-114.
26. Hearn J, Higginson IJ,. Development and validation of a core outcome measure for palliative care: the palliative care outcome scale. Palliative Care Core Audit Project Advisory Group. Qual Health Care 1999; 8 (4): 219-227.
27. Bruera E, Kuehn N, Miller M, et al. The Edmonton Symptom Assessment System (ESAS): a simple method for the assessment of palliative care patients. J Palliat Care 1991; 7 (2): 6-9.
28. Groenvold M, Petersen MA, Aaronson NK, et al. The development of the EORTC QLQ-C15-PAL: a shortened questionnaire for cancer patients in palliative care. Eur J Cancer 2006; 42 (1): 55-64.
29. Cleeland CS, Ryan KM,. Pain assessment: global use of the Brief Pain Inventory. Ann Acad Med Singapore 1994; 23 (2): 129-138.
30. Lynn Snow A, Cook KF, Lin PS, et al. Proxies and other external raters: methodological considerations. Health Serv Res 2005; 40 (5 Pt 2): 1676-1693.
31. Laugsand EA, Sprangers MA, Bjordal K, et al. Health care providers underestimate symptom intensities of cancer patients: a multicenter European study. Health Qual Life Outcomes 2010; 8: 104.
32. Zloklikovits S, Andritsch E, Frohlich B, et al. Assessing symptoms of terminally-ill patients by different raters: a prospective study. Palliat Support Care 2005; 3 (2): 87-98.
33. McPherson CJ, Addington-Hall J,. Judging the quality of care at the end of life: can proxies provide reliable information? Soc Sci Med 2003; 56 (1): 95-109.
34. Higginson IJ, Gao W,. Caregiver assessment of patients with advanced cancer: concordance with patients, effect of burden and positivity. Health Qual Life Outcomes 2008; 6: 42.
35. Gao W, Bennett MI, Stark D, et al. Psychological distress in cancer from survivorship to end of life care: prevalence, associated factors and clinical implications. Eur J Cancer 2010; 46 (11): 2036-2044.
36. Maguire P, Pitceathly C,. Key communication skills and how to acquire them. BMJ 2002; 325 (7366): 697-700.
37. Homsi J, Walsh D, Rivera N, et al. Symptom evaluation in palliative medicine: patient report vs systematic assessment. Support Care Cancer 2006; 14 (5): 444-453.
38. Abernethy AP, Shelby-James T, Fazekas BS, et al. The Australia-modified Karnofsky Performance Status (AKPS) scale: a revised scale for contemporary palliative care clinical practice [ISRCTN81117481]. BMC Palliat Care 2005; 4: 7.
39. Collin C, Wade DT, Davies S, et al. The Barthel ADL Index: a reliability study. Int Disabil Stud 1988; 10 (2): 61-63.
40. Currow DC, Eagar K, Aoun S, et al. Is it feasible and desirable to collect voluntarily quality and outcome data nationally in palliative oncology care? J Clin Oncol 2008; 26 (23): 3853-3859.
41. Bennett M, Ryall N,. Using the modified Barthel index to estimate survival in cancer patients in hospice: observational study. BMJ 2000; 321 (7273): 1381-1382.
42. Selman L, Hardings R, Gysels M, et al. The measurement of spirituality in palliative care and the content of tools validated cross-culturally: a systematic review. J Pain Symptom Manage 2011; 41 (4): 728-753.
43. Puchalski C, Ferrell B, Virani R, et al. Improving the quality of spiritual care as a dimension of palliative care: the report of the consensus conference. J Palliat Med 2009; 12 (10): 885-904.
44. Harding R, Selman L, Agupio G, et al. Validation of a core outcome measure for palliative care in Africa: the APCA African Palliative Outcome Scale. Health Qual Life Outcomes 2010; 8: 10.
45. Powell RA, Downing J, Harding R, et al. APCA. Development of the APCA African Palliative Outcome Scale. J Pain Symptom Manage 2007; 33 (2): 229-232.
46. Nekolaichuk CL, Maguire TO, Suarez-Almazor M, et al. Assessing the reliability of patient, nurse, and family caregiver symptom ratings in hospitalized advanced cancer patients. J Clin Oncol 1999; 17 (11): 3621-3630.
47. Steinhauser KE, Clipp EC, Bosworth HB, et al. Measuring quality of life at the end of life: validation of the QUAL-E. Palliat Support Care 2004; 2 (1): 3-14.
48. Cohen S, Mount B, Strobel M, et al. The McGill Quality of Life Questionnaire: a measure of quality of life appropriate for people with advanced disease. A preliminary study of validity and acceptability. Palliat Med 1995; 9 (3): 207-219.
49. Payne S, EAPC Task Force on Family Carers. White Paper on improving support for family carers in palliative care: part 1. Recommendations from the European Association for Palliative Care (EAPC) Task Force on Family Carers. Eur J Palliat Care 2010; 17 (5): 238-245.
50. Payne S, EAPC Task Force on Family Carers. White Paper on improving support for family carers in palliative care: part 2. Recommendations from the European Association for Palliative Care (EAPC) Task Force on Family Carers. Eur J Palliat Care 2010; 17 (6): 286-290.
51. Daveson BA, Alonso JP, Calanzani N, et al. Learning from the public: citizens describe the need to improve end-of-life care access, provision and recognition across Europe. Eur J Public Health 2014; 24 (3): 521-527.
52. Hudson PL, Trauer T, Graham S, et al. A systematic review of instruments related to family caregivers of palliative care patients. Palliat Med 2010; 24 (7): 656-668.
53. Higginson IJ, Gao W, Jackson D, et al. Short-form Zarit Caregiver Burden Interviews were valid in advanced conditions. J Clin Epidemiol 2010; 63 (5): 535-542.
54. Ewing G, Todd C, Rogers M, et al. Validation of a symptom measure suitable for use among palliative care patients in the community: CAMPAS-R. J Pain Symptom Manage 2004; 27 (4): 287-299.
55. Henriksson A, Carlander I, Arestedt K,. Feelings of rewards among family caregivers during ongoing palliative care. Palliat Support Care. Epub ahead of print 16 2013. DOI: 10.1017/S1478951513000540.
56. Streiner DL, Norman GR,. Health measurement scales: a practical guide to their development and use, 4th ed. Oxford: Oxford University Press, 2008.
57. International Society for Quality of Life Research, prepared by Aaronson N, Choucair A, Elliott T, et al. User's guide to implementing patient-reported outcomes assessment in clinical practice, 11 2011, http://www.isoqol.org/UserFiles/file/UsersGuide.pdf
58. Marshall S, Haywood K, Fitzpatrick R,. Impact of patient-reported outcome measures on routine practice: a structured review. J Eval Clin Pract 2006; 12 (5): 559-568.
59. Greenhalgh J,. The applications of PROs in clinical practice: what are they, do they work, and why? Qual Life Res 2009; 18 (1): 115-123.
60. Hughes EF, Wu AW, Carducci MA, et al. What can I do? Recommendations for responding to issues identified by patient-reported outcomes assessments used in clinical practice. J Support Oncol 2012; 10 (4): 143-148.
61. Smith DJ, Huntington J,. Choosing the 'correct' assessment tool. Curr Probl Cancer 2006; 30 (6): 272-282.
62. Mularski RA, Rosenfeld K, Coons SJ, et al. Measuring outcomes in randomized prospective trials in palliative care. J Pain Symptom Manage 2007; 34 (1 Suppl): S7-S19.
63. Fielding S, Fayers PM, Loge JH, et al. Methods for handling missing data in palliative care research. Palliat Med 2006; 20 (8): 791-798.
64. INVOLVE. INVOLVE strategy 2012-2015: putting people first in research. London: National Institute for Health Research, 2012.
65. Etkind SN, Daveson BA, Kwok W, et al. Capture, transfer, and feedback of patient-centered outcomes data in palliative care populations: does it make a difference? A systematic review. J Pain Symptom Manage 2015; 49 (3): 611-624.
66. Antunes B, Harding R, Higginson IJ,. Implementing patient-reported outcome measures in palliative care clinical practice: a systematic review of facilitators and barriers. Palliat Med 2014; 28 (2): 158-175.
67. Campbell SM, Braspenning J, Hutchinson A, et al. Research methods used in developing and applying quality indicators in primary care. BMJ 2003; 326 (7393): 816-819.
68. Ostgathe C, Voltz R,. Quality indicators in end-of-life care. Curr Opin Support Palliat Care 2010; 4 (3): 170-173.
69. Shekelle PG, MacLean CH, Morton SC, et al. Assessing care of vulnerable elders: methods for developing quality indicators. Ann Intern Med 2001; 135 (8 Pt 2): 647-652.
70. Singer PA, Martin DK, Bowman K,. Quality end-of-life care: where do we go from here? J Palliat Med 2000; 3 (4): 403-405.
71. Pasman HR, Brandt HE, Deliens L, et al. Quality indicators for palliative care: a systematic review. J Pain Symptom Manage 2009; 38 (1): 145-156.
72. De Roo ML, Leemans K, Claessen SJ, et al. Quality indicators for palliative care: update of a systematic review. J Pain Symptom Manage 2013; 46 (4): 556-572.
73. Claessen SJ, Francke AL, Belarbi HE, et al. A new set of quality indicators for palliative care: process and results of the development trajectory. J Pain Symptom Manage 2011; 42 (2): 169-182.
74. Peruselli C, Paci E, Franceschi P, et al. Outcome evaluation in a home palliative care service. J Pain Symptom Manage 1997; 13 (3): 158-165.
75. Woitha K, Van Beek K, Ahmed N, et al. Development of a set of process and structure indicators for palliative care: the Europall project. BMC Health Serv Res 2012; 12: 381.
76. Selman L, Harding R,. How can we improve outcomes for patients and families under palliative care? Implementing clinical audit for quality improvement in resource limited settings. Indian J Palliat Care 2010; 16 (1): 8-15.
77. Hjermstad MJ, Lie HC, Caraceni A, et al. Computer-based symptom assessment is feasible in patients with advanced cancer: results from an international multicenter study, the EPCRC-CSA. J Pain Symptom Manage 2012; 44 (5): 639-654.
78. Abernethy AP, Herndon JE 2nd, Wheeler JL, et al. Improving health care efficiency and quality using tablet personal computers to collect research-quality, patient-reported data. Health Serv Res 2008; 43 (6): 1975-1991.
79. Abernethy AP, Ahmad A, Zafar SY, et al. Electronic patient-reported data capture as a foundation of rapid learning cancer care. Med Care 2010; 48 (6 Suppl): S32-S38.
80. Bennett AV, Jensen RE, Basch E,. Electronic patient-reported outcome systems in oncology clinical practice. CA Cancer J Clin 2012; 62 (5): 337-347.
81. Palliative Care in Wales. All Wales specialist palliative care data set, http://wales.pallcare.info/index.php?p=sections&sid=47 (2010,. accessed 18 May 2013).
82. Outcome Assessment and Complexity Collaborative (OACC). 2014, http://www.kcl.ac.uk/lsm/research/divisions/cicelysaunders/research/studies/oacc/index.aspx
83. Currow DC, Tieman JJ, Greene A, et al. Refining a checklist for reporting patient populations and service characteristics in hospice and palliative care research. J Pain Symptom Manage 2012; 43 (5): 902-910.
84. Antunes B,. The Palliative care Outcome Scale (POS)-manual for cross-cultural adaptation and psychometric validation. London: Cicely Saunders Institute, 2012.
85. Eisenchlas JH, Harding R, Daud ML, et al. Use of the palliative outcome scale in Argentina: a cross-cultural adaptation and validation study. J Pain Symptom Manage 2008; 35 (2): 188-202.
86. Radbruch L, Strasser F, Elsner F, et al. Fatigue in palliative care patients-an EAPC approach. Palliat Med 2008; 22 (1): 13-32.
87. Kamal AH, Currow DC, Ritchie C, et al. The value of data collection within a palliative care program. Curr Oncol Rep 2011; 13 (4): 308-315.
88. Stiel S, Pastrana T, Balzer C, et al. Outcome assessment instruments in palliative and hospice care-a review of the literature. Support Care Cancer 2012; 20 (11): 2879-2893.
89. Dunckley M, Aspinal F, Addington-Hall JM, et al. A research study to identify facilitators and barriers to outcome measure implementation. Int J Palliat Nurs 2005; 11 (5): 218-225.
90. Department of Health. Strengthening palliative care: policy and strategic directions 2011-2015. Melbourne, VIC, Australia: Department of Health, 2011.
91. Calvert M, Blazeby J, Altman DG, et al. Reporting of patient-reported outcomes in randomized trials: the CONSORT PRO extension. JAMA 2013; 309 (8): 814-822.
92. Higginson IJ, Costantini M,. Dying with cancer, living well with advanced cancer. Eur J Cancer 2008; 44 (10): 1414-1424.
93. Simon ST, Gomes B, Koeskeroglu P, et al. Population, mortality and place of death in Germany (1950-2050)-implications for end-of-life care in the future. Public Health 2012; 126 (11): 937-946.
94. Potter M, Gordon S, Hamer P,. The Nominal Group Technique: a useful consensus methodology in physiotherapy research. New Zeal J Physiother 2004; 32 (3): 126-130.
95. Evans CJ, Harding R, Higginson IJ,. 'Best practice' in developing and evaluating palliative and end-of-life care services: a meta-synthesis of research methods for the MORECare project. Palliat Med 2013; 27 (10): 885-898.
96. Roth A, Kornblith A, Batel-Copel L, et al. Rapid screening for psychologic distress in men with prostate carcinoma. Cancer 1998; 82 (10): 1904-1908.
97. Downing JD, Marston J, Selwyn C, et al. Developing children's palliative care in Africa through beacon centres: lessons learnt. BMC Palliat Care 2013; 12: 8.
98. Wong DL, Baker CM,. Pain in children: comparison of assessment scales. Pediatr Nurs 1988; 14 (1): 9-17.
99. Hicks CL, von Baeyer CL, Spafford PA, et al. The Faces Pain Scale-Revised: toward a common metric in pediatric pain measurement. Pain 2001; 93 (2): 173-183.
100. Stevens B,. Pain assessment and management in infants with cancer. Pediatric Blood & Cancer 2007; 49 (7 Suppl): 1097-1101.
101. Sherman SA, Eisen S, Burwinkle TM, et al. The PedsQL Present Functioning Visual Analogue Scales: preliminary reliability and validity. Health Qual Life Outcomes 2006; 4: 75.
102. Downing J, Ojing M, Powell RA, et al. A palliative care outcome measure for children in sub-Saharan Africa: early development findings. Eur J Palliat Care 2012; 19 (6): 292-295.
103. Greenhalgh J, Long AF, Brettle AJ, et al. Reviewing and selecting outcome measures for use in routine practice. J Eval Clin Pract 1998; 4 (4): 339-350.
104. Mokkink LB, Terwee CB, Knol DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol 2010; 10: 22.
105. Tavakol M, Dennick R,. Making sense of Cronbach's alpha. Int J Med Educ 2011; 2: 53-55.
106. Landis JR, Koch GG,. The measurement of observer agreement for categorical data. Biometrics 1977; 33 (1): 159-174.
107. US Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research, et al. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims. Silver Spring: US Food and Drug Administration, 2009.
108. Terwee CB, Bot SDM, de Boer MR, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 2007; 60 (1): 34-42.
109. Jaeschke R, Singer J, Guyatt GH,. Measurement of health status: ascertaining the minimal clinically important difference. Contr Clin Trials 1989; 10 (4): 407-415.
110. Sloan JA,. Assessing the minimally clinically significant difference: scientific considerations, challenges and solutions. COPD 2005; 2 (1): 57-62.
111. Pappas G, Wolf RC, Morineau G, et al. Validity of measures of pain and symptoms in HIV/AIDS infected households in resources poor settings: results from the Dominican Republic and Cambodia. BMC Palliat Care 2006; 5: 3.
112. Downing J, Atieno M, Powell RA, et al. Initial results from the development of the APCA African Children's Palliative Outcome Scale (APCA African POS). PaedPalLit Special Supplementary ed. 2010, p. 31.
113. Downing J, Simon ST, Mwangi-Powell FN, et al. Outcomes 'out of Africa': the selection and implementation of outcome measures for palliative care in Africa. BMC Palliat Care 2012; 11: 1.
114. Defilippi KM, Cameron S,. Expanding the reach of palliative care to community-based home care programs. J Pain Symptom Manage [Research Support, Non-U.S. Gov't] 2010; 40 (1): 3-5.
115. Harding R, Higginson IJ,. Palliative care in sub-Saharan Africa. Lancet 2005; 365 (9475): 1971-1977.