The clinical effectiveness and cost-effectiveness of telephone triage for managing same-day consultation requests in general practice: A cluster randomised controlled trial comparing general practitioner-led and nurse-led management systems with usual care (the ESTEEM trial)

Health Technology Assessment

Volumn 19, Issue 13, 2015, Pages 1-212

  Campbell, John L ^a   Fletcher, Emily ^a   Britten, Nicky ^a   Green, Colin ^a   Holt, Tim ^b   Lattimer, Valerie ^c   Richards, David A ^a   Richards, Suzanne H ^a   Salisbury, Chris ^d   Taylor, Rod S ^a   Calitri, Raff ^a   Bowyer, Vicky ^e   Chaplin, Katherine ^a   Kandiyali, Rebecca ^a   Murdoch, Jamie ^c   Price, Linnie ^a   Roscoe, Julia ^e   Varley, Anna ^c   Warren, Fiona C ^a  

^a UNIVERSITY OF EXETER MEDICAL SCHOOL   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

^c UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^d UNIVERSITY OF BRISTOL   (United Kingdom)

^e UNIVERSITY OF WARWICK   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ARTICLE; CHILD; CLINICAL EFFECTIVENESS; CLUSTER ANALYSIS; COMPARATIVE STUDY; CONTROLLED STUDY; COST EFFECTIVENESS ANALYSIS; DECISION SUPPORT SYSTEM; DOCTOR PATIENT RELATION; ECONOMIC EVALUATION; EMERGENCY HEALTH SERVICE; FEASIBILITY STUDY; FEMALE; GENERAL PRACTICE; GENERAL PRACTITIONER LED TELEPHONE TRIAGE; HEALTH CARE COST; HEALTH CARE DELIVERY; HEALTH CARE UTILIZATION; HEALTH STATUS; HOSPITAL ADMISSION; HUMAN; MAJOR CLINICAL STUDY; MALE; MEDICAL EDUCATION; NATIONAL HEALTH SERVICE; NURSE LED COMPUTER SUPPORTED TELEPHONE TRIAGE; OUTCOME ASSESSMENT; PARALLEL DESIGN; PATIENT CARE; PATIENT MONITORING; PATIENT REFERRAL; PATIENT SAFETY; PILOT STUDY; PRIMARY MEDICAL CARE; QUALITATIVE RESEARCH; RANDOMIZED CONTROLLED TRIAL; SCHOOL CHILD; TELECONSULTATION; TELEMEDICINE; TELEPHONE INTERVIEW; UNITED KINGDOM; WORKLOAD; ADULT; AGED; CLINICAL TRIAL; COST BENEFIT ANALYSIS; ECONOMICS; GENERAL PRACTITIONER; HEALTH PERSONNEL ATTITUDE; HOSPITAL MANAGEMENT; INFANT; MANPOWER; MIDDLE AGED; MULTICENTER STUDY; NEWBORN; NURSE; ORGANIZATION AND MANAGEMENT; PATIENT SATISFACTION; PRESCHOOL CHILD; PRIMARY HEALTH CARE; PROCEDURES; STANDARDS; STATISTICS AND NUMERICAL DATA; TELEPHONE; TIME; TREATMENT OUTCOME; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; APPOINTMENTS AND SCHEDULES; ATTITUDE OF HEALTH PERSONNEL; CHILD; CHILD, PRESCHOOL; COST-BENEFIT ANALYSIS; DECISION SUPPORT SYSTEMS, CLINICAL; FEMALE; GENERAL PRACTITIONERS; GREAT BRITAIN; HUMANS; INFANT; INFANT, NEWBORN; MALE; MIDDLE AGED; NURSES; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); PATIENT SATISFACTION; PRIMARY HEALTH CARE; REFERRAL AND CONSULTATION; STATE MEDICINE; TELEPHONE; TIME FACTORS; TRIAGE; WORKLOAD; YOUNG ADULT;

EID: 84923193471     PISSN: 13665278     EISSN: 20464924     Source Type: Journal    
DOI: 10.3310/hta19130     Document Type: Article

References (82)

1. Department of Health. Delivering Investment in General Practice: Implementing the New GMS Contract. London: Department of Health; 2004.
2. Salisbury C, Montgomery AA, Simons L, Sampson F, Edwards S, Baxter H, et al. Impact of Advanced Access on access, workload, and continuity: controlled before-and-after and simulated-patient study. Br J Gen Pract 2007;57:608-14.
3. Richards DA, Meakins J, Tawfik J, Godfrey L, Dutton E, Richardson G, et al. Nurse telephone triage for same day appointments in general practice: multiple interrupted time series trial of effect on workload and costs. BMJ 2002;325:1214-17. http://dx.doi.org/10.1136/bmj.325.7374.1214.
4. Stoddart H, Evans M, Peters TJ, Salisbury C. The provision of 'same-day' care in general practice: an observational study. Fam Pract 2003;20:41-7. http://dx.doi.org/10.1093/fampra/20.1.41.
5. Lattimer V, George S, Thompson F, Thomas E, Mullee M, Turnbull J, et al. Safety and effectiveness of nurse telephone consultation in out of hours primary care: randomised controlled trial. The South Wiltshire Out of Hours Project (SWOOP) Group. BMJ 1998;317:1054-9. http://dx.doi.org/ 10.1136/bmj.317.7165.1054.
6. Marsh GN, Horne RA, Channing DM. A study of telephone advice in managing out-of-hours calls. J R Coll Gen Pract 1987;37:301-4.
7. Marklund B, Bengtsson C. Medical advice by telephone at Swedish health centres: who calls and what are the problems? Fam Pract 1989;6:42-6. http://dx.doi.org/10.1093/fampra/6.1.42.
8. Dale J, Crouch R, Lloyd D. Primary care: nurse-led telephone triage and advice out-of-hours. Nurs Stand 1998;12:41-5. http://dx.doi.org/10.7748/ns1998.08.12.47.39.c2520.
9. Office for National Statistics. Living in Britain. London: Office for National Statistics; 2008.
10. NHS Information Centre. GP Workload Survey 2007. 2007. URL: www.ic.nhs.uk/pubs/gpworkload (accessed 12 November 2014).
11. Jiwa M, Mathers N, Campbell M. The effect of GP telephone triage on numbers seeking same-day appointments. Br J Gen Pract 2002;52:390-1.
12. Richards DA, Meakins J, Godfrey L, Tawfik J, Dutton E. Survey of the impact of nurse telephone triage on general practitioner activity. Br J Gen Pract 2004;54:207-10.
13. McKinstry B, Walker J, Campbell C, Heaney D, Wyke S. Telephone consultations to manage requests for same-day appointments: a randomised controlled trial in two practices. Br J Gen Pract 2002;52:306-10.
14. Richards DA, Godfrey L, Tawfik J, Ryan M, Meakins J, Dutton E, et al. NHS Direct versus general practice based triage for same day appointments in primary care: cluster randomised controlled trial. BMJ 2004;329:774. http://dx.doi.org/10.1136/bmj.38226.605995.55.
15. Thompson F, George S, Lattimer V, Smith H, Moore M, Turnbull J, et al. Overnight calls in primary care: randomised controlled trial of management using nurse telephone consultation. BMJ 1999;319:1408. http://dx.doi.org/10.1136/bmj.319.7222.1408.
16. Lattimer V, Sassi F, George S, Moore M, Turnbull J, Mullee M, et al. Cost analysis of nurse telephone consultation in out of hours primary care: evidence from a randomised controlled trial. BMJ 2000;320:1053-7. http://dx.doi.org/10.1136/bmj.320.7241.1053.
17. Brown A, Armstrong D. Telephone consultations in general-practice: an additional or alternative service. Br J Gen Pract 1995;45:673-5.
18. Poole SR, Schmitt BD, Carruth T, Peterson-Smith A, Slusarski M. After-hours telephone coverage: the application of an area-wide telephone triage and advice system for pediatric practices. Pediatrics 1993;92:670-9.
19. Holmstrom I. Decision aid software programs in telenursing: not used as intended? Experiences of Swedish telenurses. Nurs Health Sci 2007;9:23-8. http://dx.doi.org/10.1111/j.1442-2018. 2007.00299.x.
20. Richards DA, Meakins J, Tawfik J, Godfrey L, Dutton E, Heywood P. Quality monitoring of nurse telephone triage: pilot study. J Adv Nurs 2004;47:551-60. http://dx.doi.org/10.1111/j.1365-2648. 2004.03132.x.
21. Crouch R, Woodfield H, Dale J, Patel A. Telephone assessment and advice: a training programme. Nurs Stand 1997;11:41-4.
22. Derkx HP, Rethans JJ, Muijtjens AM, Maiburg BH, Winkens R, van Rooij HG, et al. Quality of clinical aspects of call handling at Dutch out of hours centres: cross-sectional national study. BMJ 2008;337:a1264. http://dx.doi.org/10.1136/bmj.a1264.
23. Car J, Freeman GK, Partridge MR, Sheikh A. Improving quality and safety of telephone based delivery of care: teaching telephone consultation skills. Qual Saf Health Care 2004;13:2-3. http://dx.doi.org/10.1136/qshc.2003.009241.
24. Currell R, Urquhart C, Wainwright P, Lewis R. Telemedicine versus face to face patient care: effects on professional practice and health care outcomes. Nurs Times 2001;97:35.
25. Giesen P, Ferwerda R, Tijssen R, Mokkink H, Drijver R, van den Bosch W, et al. Safety of telephone triage in general practitioner cooperatives: do triage nurses correctly estimate urgency? Qual Saf Health Care 2007;16:181-4. http://dx.doi.org/10.1136/qshc.2006.018846.
26. Plain Healthcare. Odyssey Clinical Decision Support Software. 2008. URL: www.advancedcomputer software.com/ahc/ (accessed 12 November 2014).
27. Bunn F, Byrne G, Kendall S. The effects of telephone consultation and triage on healthcare use and patient satisfaction: a systematic review. Br J Gen Pract 2005;55:956-61.
28. Venning P, Durie A, Roland M, Roberts C, Leese B. Randomised controlled trial comparing cost effectiveness of general practitioners and nurse practitioners in primary care. BMJ 2000;320:1048-53. http://dx.doi.org/10.1136/bmj.320.7241.1048.
29. Kinnersley P, Anderson E, Parry K, Clement J, Archard L, Turton P, et al. Randomised controlled trial of nurse practitioner versus general practitioner care for patients requesting 'same day' consultations in primary care. BMJ 2000;320:1043-8. http://dx.doi.org/10.1136/bmj.320. 7241.1043.
30. Shum C, Humphreys A, Wheeler D, Cochrane MA, Skoda S, Clement S. Nurse management of patients with minor illnesses in general practice: multicentre, randomised controlled trial. BMJ 2000;320:1038-43. http://dx.doi.org/10.1136/bmj.320.7241.1038.
31. NHS Institute for Innovation and Improvement. Stour Access System: A New Way to Manage GP Appointments. Better for GPs, Better for Patients, Better All-round. 2008. URL: www.stoursurgery. co.uk/website/J00700/files/StourAccessSystemBrochure.pdf (accessed 12 November 2014).
32. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ 2008;337:a1655.
33. Campbell JL, Britten N, Green C, Holt TA, Lattimer V, Richards SH, et al. The effectiveness and cost-effectiveness of telephone triage of patients requesting same day consultations in general practice: study protocol for a cluster randomised controlled trial comparing nurse-led and GP-led management systems (ESTEEM). Trials 2013;14:4. http://dx.doi.org/10.1186/1745-6215-14-4.
34. Snooks HA, Carter B, Dale J, Foster T, Humphreys I, Logan PA, et al. Support and Assessment for Fall Emergency Referrals (SAFER 1): Cluster Randomised Trial of Computerised Clinical Decision Support for Paramedics. PLOS ONE 2014;9:e106436. http://dx.doi.org/10.1371/journal.pone. 0106436.
35. Campbell MK, Snowdon C, Francis D, Elbourne D, McDonald AM, Knight R, et al. Recruitment to randomised trials: strategies for trial enrolment and participation study. The STEPS study. Health Technol Assess 2007;11(48). http://dx.doi.org/10.3310/hta11480.
36. Ukoumunne OC, Gulliford MC, Chinn S, Sterne JA, Burney PG. Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review. Health Technol Assess 1999;3(5).
37. Association of Public Health Observatories (APHO). 2013. URL: http://fingertips.phe.org.uk/profile/ general-practice (accessed 12 November 2014).
38. Curtis L. Unit Costs of Health and Social Care 2012. Canterbury: PSSRU; 2012.
39. EuroQol group. EuroQol: a new facility for the measurement of health-related quality of life. Health Policy 1990;16:199-208. http://dx.doi.org/10.1016/0168-8510(90)90421-9.
40. McHorney CAJ, Ware JE Jr, Lu JFR, Sherbourne CD. The MOS 36 item Short Form Health Survey (SF-36):III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care 1994;32:40-66. http://dx.doi.org/10.1097/00005650-199401000-00004.
41. Baker R. Development of a questionnaire to assess patients' satisfaction with consultations in general practice. Br J Gen Pract 1990;40:487-90.
42. Mercer SW, Howie JGR. CQI-2: a new measure of holistic interpersonal care in primary care consultations. Br J Gen Pract 2006;56:262-8.
43. NHS England/Ipsos MORI. GP Patient Survey. 2013. URL: www.gp-patient.co.uk/ (accessed 12 November 2014).
44. Bower P, Roland M, Campbell JL, Mead N. Setting standards based on patients' views on access and continuity: secondary analysis of data from the general practice assessment survey. BMJ 2003;326:258. http://dx.doi.org/10.1136/bmj.326.7383.258.
45. Campbell JL, Roland MO, Richards S, Dickens A, Greco M, Bower P. Users' reports and evaluations of out-of-hours healthcare and the UK national quality requirements. A cross sectional study. Br J Gen Pract 2009;59:e8-15. http://dx.doi.org/10.3399/bjgp09X394815.
46. Campbell JL. Patients' perceptions of medical urgency: does deprivation matter? Fam Pract 1999;16:28-32. http://dx.doi.org/10.1093/fampra/16.1.28.
47. Howie JGR, Heaney DJ, Maxwell M. Measuring Quality in General Practice. Occasional Paper No. 75. London: Royal College of General Practitioners; 1997.
48. Adams G, Gulliford MC, Ukoumunne OC, Eldridge S, Chinn S, Campbell MJ. Patterns of intra-cluster correlation from primary care research to inform study design and analysis. J Clin Epidemiol 2004;57:785-94. http://dx.doi.org/10.1016/j.jclinepi.2003.12.013.
49. Hippisley-Cox J, Fenty J, Heaps M. Trends in Consultation Rates in General Practice 1995 to 2007: Analysis of the QRESEARCH database. Nottingham: QRESEARCH; 2008.
50. Jacoby A. Possible factors affecting response to postal questionnaires: findings from a study of general practitioner services. J Public Health Med 1990;12:131-5.
51. Smith WC, Crombie IK, Campion PD, Knox JD. Comparison of response rates to a postal questionnaire from a general practice and a research unit. Br Med J (Clin Res Ed) 1985;291:1483-5. http://dx.doi.org/10.1136/bmj.291.6507.1483.
52. Salisbury C. Postal survey of patients' satisfaction with a general practice out of hours cooperative. BMJ 1997;314:1594-8. http://dx.doi.org/10.1136/bmj.314.7094.1594.
53. McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, et al. Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. Health Technol Assess 2001;5(31). http://dx.doi.org/10.3310/hta5310.
54. UK Government. Indices of Multiple Deprivation 2010. URL: www.gov.uk/government/publications/ english-indices-of-deprivation-2010 (accessed 12 November 2014).
55. Campbell MK, Piaggio G, Elbourne DR, Altman DG. Consort 2010 statement: extension to cluster randomised trials. BMJ 2012;345:e5661. http://dx.doi.org/10.1136/bmj.e5661.
56. Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ 2008;337:a2390. http://dx.doi.org/10.1136/bmj.a2390.
57. Bennett S, Parpia T, Hayes R, Cousens S. Methods for the analysis of incidence rates in cluster randomized trials. Int J Epidemiol 2002;31:839-46. http://dx.doi.org/10.1093/ije/31.4.839.
58. Pacheo GD, Hattendorf J, Colford JM, Mäusezahl D, Smith T. Performance of analytical methods for overdispersed counts in cluster randomized trials: Sample size, degree of clustering and imbalance. Stat Med 2009;28:2989-3011. http://dx.doi.org/10.1002/sim.3681.
59. White IM, Royston P, Wood AM. Multiple imputations using chained equations: issues and guidance for practice. Stat Med 2011;30:377-99. http://dx.doi.org/10.1002/sim.4067.
60. Lyratzopoulos G, Elliott M, Barbiere JM, Henderson A, Staetsky L, Paddison C, et al. Understanding ethnic and other socio-demographic differences in patient experience of primary care: evidence from the English General Practice Patient Survey. BMJ Qual Saf 2012;21:21-9. http://dx.doi.org/ 10.1136/bmjqs-2011-000088.
61. Craig D, Rice S. CRD Report 6: NHS Economic Evaluation Database Handbook. York: Centre for Reviews and Dissemination, University of York; 2007.
62. Green J, Thorogood N. Qualitative Methods for Health Research. London: Sage; 2004.
63. Pope C, Ziebland S, Mays N. Qualitative research in health care. Analysing qualitative data. BMJ 2000;320:114-16. http://dx.doi.org/10.1136/bmj.320.7227.114.
64. Campbell JL, Fletcher E, Britten N, Green C, Holt TA, Lattimer V, et al. Telephone triage for management of same-day consultation requests in general practice (the ESTEEM trial): a cluster-randomised controlled trial and cost-consequence analysis. Lancet 2014;384:1859-68. http://dx.doi.org/10.1016/S0140-6736(14)61058-8.
65. NHS Employers. 2014/15 General medical Services (GMS) Contract Quality and Outcomes Framework (QOF). Guidance from GMS contract 2014/15. 2014. www.nhsemployers.org/ PAYANDCONTRACTS/GENERALMEDICALSERVICESCONTRACT/QOF/Pages/ChangestoQOF201415.aspx (accessed 1 November 2014).
66. Department of Health. The NHS Plan. London: HMSO; 2000.
67. Pope C, Banks J, Salisbury C, Lattimer V. Improving access to primary care: eight case studies of introducing Advanced Access in England. J Health Serv Res Policy 2008;13:33-9. http://dx.doi.org/ 10.1258/jhsrp.2007.007039.
68. Huibers L, Smits M, Renaud V, Giesen P, Wensing M. Safety of telephone triage in out-of-hours care: a systematic review. Scand J Prim Health Care 2011;29:198-209. http://dx.doi.org/10.3109/ 02813432.2011.629150.
69. Gallagher M, Huddart T, Henderson B. Telephone triage of acute illness by a practice nurse in general practice: outcomes of care. Br J Gen Pract 1998;48:1141-5.
70. Darnell JC, Hiner SL, Neill PJ, Mamlin JJ, McDonald CJ, Hui SL, et al. After-hours telephone access to physicians with access to computerized medical records. Experience in an inner-city general medicine clinic. Med Care 1985;23:20-6. http://dx.doi.org/10.1097/00005650-198501000-00003.
71. Vedsted P, Christensen MB. The effect of an out-of-hours reform on attendance at casualty wards. The Danish example. Scand J Prim Health Care 2001;19:95-8. http://dx.doi.org/10.1080/ 028134301750235303.
72. McKinstry B, Hammersley V, Burton C, Pinnock H, Elton R, Dowell J, et al. The quality, safety and content of telephone and face-to-face consultations: a comparative study. Qual Saf Health Care 2010;19:298-303. http://dx.doi.org/10.1136/qshc.2008.027763.
73. Stirewalt CF, Linn MW, Godoy G, Knopka F, Linn BS. Effectiveness of an ambulatory care telephone service in reducing drop-in visits and improving satisfaction with care. Med Care 1982;20:739-48. http://dx.doi.org/10.1097/00005650-198207000-00009.
74. Kelly M, Egbunike JN, Kinnersley P, Hood K, Owen-Jones E, Button LA, et al. Delays in response and triage times reduce patient satisfaction and enablement after using out-of-hours services. Fam Pract 2010;27:652-63. http://dx.doi.org/10.1093/fampra/cmq057.
75. Smits M, Huibers L, Oude BA, Giesen P. Patient satisfaction with out-of-hours GP cooperatives: a longitudinal study. Scand J Prim Health Care 2012;30:206-13. http://dx.doi.org/10.3109/ 02813432.2012.735553.
76. Leibowitz R, Day S, Dunt D. A systematic review of the effect of different models of after-hours primary medical care services on clinical outcome, medical workload, and patient and GP satisfaction. Fam Pract 2003;20:311-17. http://dx.doi.org/10.1093/fampra/cmg313.
77. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q 2004;82:581-629. http://dx.doi.org/10.1111/j.0887-378X.2004.00325.x.
78. Kernick D. Wanted: new methodologies for health service research. Is complexity theory the answer? Fam Pract 2006;23:385-90. http://dx.doi.org/10.1093/fampra/cml011.
79. GP Access. PatientAccess. 2013. URL: www.patient-access.org.uk/ (accessed 12 November 2014).
80. Productive Primary Care. Doctor First. 2013. URL: www.productiveprimarycare.co.uk/doctor-first.aspx (accessed 12 November 2014).
81. National Institute for Health Research (NIHR). Health Services and Delivery Research Programme. 2013. URL: www.nets.nihr.ac.uk/programmes/hsdr (accessed 12 November 2014).
82. Chalder M, Wiles NJ, Campbell J, et al. A pragmatic randomised controlled trial to evaluate the cost-effectiveness of a physical activity intervention as a treatment for depression: the treating depression with physical activity (TREAD) trial. Health Technol Assess 2012;16(10). http://dx.doi.org/10.3310/hta16100.