Methods of Formal Consensus in Classification/Diagnostic Criteria and Guideline Development

Seminars in Arthritis and Rheumatism

Volumn 41, Issue 2, 2011, Pages 95-105

  Nair, Raj ^a   Aggarwal, Rohit ^b   Khanna, Dinesh ^c  

^a WASHINGTON HOSPITAL CENTER   (United States)

^b UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Conference; Delphi method; Diagnostic criteria; Formal consensus methods; GRADE; Guideline criteria; National Institutes of Health consensus development; Nominal group technique; RAND UCLA Appropriateness Method

Indexed keywords

ARTICLE; CLINICAL DECISION MAKING; CONSENSUS DEVELOPMENT; CONTROLLED STUDY; DELPHI STUDY; DOCTOR PATIENT RELATION; GROUP DYNAMICS; HUMAN; LIKERT SCALE; MEDICAL EXPERT; MEDICAL PRACTICE; METHODOLOGY; NATIONAL INSTITUTES OF HEALTH CONSENSUS DEVELOPMENT CONFERENCE; NOMINAL GROUP TECHNIQUE; OPEN ENDED QUESTIONNAIRE; OSTEOARTHRITIS; PANEL STUDY; PRACTICE GUIDELINE; PRIORITY JOURNAL; PUBLIC HEALTH PROBLEM; PUBLIC OPINION; RAND UCLA APPROPRIATENESS METHOD; RATING SCALE; RHEUMATOLOGY; SOCIAL BEHAVIOR; STRUCTURED INTERVIEW; SYSTEMIC LUPUS ERYTHEMATOSUS; TASK PERFORMANCE;

CONSENSUS; EVIDENCE-BASED MEDICINE; HUMANS; PRACTICE GUIDELINES AS TOPIC; RESEARCH DESIGN;

EID: 80855144233     PISSN: 00490172     EISSN: 1532866X     Source Type: Journal    
DOI: 10.1016/j.semarthrit.2010.12.001     Document Type: Article

References (67)

1. Lugtenberg M, Burgers JS, Westert GP. Effects of evidence-based clinical practice guidelines on quality of care: A systematic review. Br Med J 385;18(5):385.
2. Chassin M. How do we decide whether an investigation or procedure is appropriate. Appropriate investigation and treatment in clinical practice 1989, 21-29. Royal College of Physicians, London.
3. AHCPR clinical practice guideline program. Report to Congress 1995, Agency for Healthcare Policy and Research.
4. Black N., Murphy M., Lamping D., McKee M., Sanderson C., Askham J., et al. Consensus development methods: A review of best practice in creating clinical guidelines. J Health Serv Res Policy 1999, 4(4):236-248.
5. Ozen S., Ruperto N., Dillon M.J., Bagga A., Barron K., Davin J.C., et al. EULAR/PReS endorsed consensus criteria for the classification of childhood vasculitides. Ann Rheum Dis 2006, 65(7):936-941.
6. Zulian F., Woo P., Athreya B.H., Laxer R.M., Medsger T.A., Lehman T.J., et al. The pediatric rheumatology European Society/American College of Rheumatology/European League Against Rheumatism provisional classification criteria for juvenile systemic sclerosis. Arthritis Rheum 2007, 57(2):203-212.
7. Linstone H.A., Turoff M. The Delphi method: Techniques and applications 1975, Addison-Wesley Pub. Co., Advanced Book Program, Reading (MA).
8. Fink A., Kosecoff J., Chassin M., Brook R.H. Consensus methods: Characteristics and guidelines for use. Am J Public Health 1984, 74(9):979-983.
9. Jones J., Hunter D. Consensus methods for medical and health services research. BMJ 1995, 311(7001):376-380.
10. Saag K.G., Teng G.G., Patkar N.M., Anuntiyo J., Finney C., Curtis J.R., et al. American College of Rheumatology 2008 recommendations for the use of nonbiologic and biologic disease-modifying antirheumatic drugs in rheumatoid arthritis. Arthritis Rheum 2008, 59(6):762-784.
11. Jackson S. Team composition in organizational settings: Issues in managing an increasingly diverse work force. Group Process and Productivity 1992, 138-173. Sage, Newbury Park (CA). S. Worchel, W. Wood, J. Simpson (Eds.).
12. Vinokur A., Burnstein E., Sechrest L., Wortman P.M. Group decision making by experts: Field study of panels evaluating medical technologies. J Pers Soc Psychol 1985, 49(1):70-84.
13. Kahan J.P., Park R.E., Leape L.L., Bernstein S.J., Hilborne L.H., Parker L., et al. Variations by specialty in physician ratings of the appropriateness and necessity of indications for procedures. Med Care 1996, 34(6):512-523.
14. Jacoby I. Evidence and consensus. JAMA 1988, 259(20):3039.
15. Cruse H., Winiarek M., Marshburn J., Clark O., Djulbegovic B. Quality and methods of developing practice guidelines. BMC Health Serv Res 2002, 2(1):1.
16. Dalkey N.C. Delphi 1967, Rand, Santa Monica (CA).
17. Helmer-Hirschberg O. The use of the Delphi technique in problems of educational innovations 1966, Rand, Santa Monica (CA).
18. Dalkey N.C., Helmer-Hirschberg O. An experimental application of the Delphi method to the use of experts 1962, Rand, Santa Monica (CA).
19. Delbecq A.L., Van de Ven A.H., Gustafson D.H. Group techniques for program planning: A guide to nominal group and delphi processes 1975, Green Briar Press, Middleton (WI).
20. Murphy M.K., Black N.A., Lamping D.L., McKee C.M., Sanderson C.F., Askham J., et al. Consensus development methods, and their use in clinical guideline development. Health Technol Assess 1998, 2(3):i. iv, 1-88.
21. Khanna D., Lovell D.J., Giannini E., Clements P.J., Merkel P.A., Seibold J.R., et al. Development of a provisional core set of response measures for clinical trials of systemic sclerosis. Ann Rheum Dis 2008, 67(5):703-709.
22. Distler O., Behrens F., Pittrow D., Huscher D., Denton C.P., Foeldvari I., et al. Defining appropriate outcome measures in pulmonary arterial hypertension related to systemic sclerosis: A Delphi consensus study with cluster analysis. Arthritis Rheum 2008, 59(6):867-875.
23. Loughlin K.G., Moore L.F. Using Delphi to achieve congruent objectives and activities in a pediatrics department. J Med Educ 1979, 54(2):101-106.
24. Thomson W.A., Ponder L.D. Use of delphi methodology to generate a survey instrument to identify priorities for state allied health associations. Allied Health Behav Sci 1979, 2(4):383-399.
25. Bertsias G., Ioannidis J.P., Boletis J., Bombardieri S., Cervera R., Dostal C., et al. EULAR recommendations for the management of systemic lupus erythematosus. Report of a task force of the EULAR standing committee for international clinical studies including therapeutics. Ann Rheum Dis 2008, 67(2):195-205.
26. Gazi H., Pope J.E., Clements P., Medsger T.A., Martin R.W., Merkel P.A., et al. Outcome measurements in scleroderma: Results from a Delphi exercise. J Rheumatol 2007, 34(3):501-509.
27. Dernis E., Lavie F., Pavy S., Wendling D., Flipo R.M., Saraux A., et al. Clinical and laboratory follow-up for treating and monitoring patients with ankylosing spondylitis: Development of recommendations for clinical practice based on published evidence and expert opinion. Joint Bone Spine 2007, 74(4):330-337.
28. Wallace C.A., Ruperto N., Giannini E. Preliminary criteria for clinical remission for select categories of juvenile idiopathic arthritis. J Rheumatol 2004, 31(11):2290-2294. Childhood Arthritis and Rheumatology Research Alliance, Pediatric Rheumatology International Trials Organization, Pediatric Rheumatology Collaborative Study Group.
29. Rider L.G., Giannini E.H., Brunner H.I., Ruperto N., James-Newton L., Reed A.M., et al. International consensus on preliminary definitions of improvement in adult and juvenile myositis. Arthritis Rheum 2004, 50(7):2281-2290.
30. Oddis C.V., Rider L.G., Reed A.M., Ruperto N., Brunner H.I., Koneru B., et al. International consensus guidelines for trials of therapies in the idiopathic inflammatory myopathies. Arthritis Rheum 2005, 52(9):2607-2615.
31. Ruperto N., Meiorin S., Iusan S.M., Ravelli A., Pistorio A., Martini A. Consensus procedures and their role in pediatric rheumatology. Curr Rheumatol Rep 2008, 10(2):142-146.
32. Giannini E.H., Ruperto N., Ravelli A., Lovell D.J., Felson D.T., Martini A. Preliminary definition of improvement in juvenile arthritis. Arthritis Rheum 1997, 40(7):1202-1209.
33. Van de Ven A.H., Delbecq A.L. The nominal group as a research instrument for exploratory health studies. Am J Public Health 1972, 62(3):337-342.
34. Ruperto N., Ravelli A., Cuttica R., Espada G., Ozen S., Porras O., et al. The pediatric rheumatology international trials organization criteria for the evaluation of response to therapy in juvenile systemic lupus erythematosus: Prospective validation of the disease activity core set. Arthritis Rheum 2005, 52(9):2854-2864.
35. Ruperto N., Ravelli A., Oliveira S., Alessio M., Mihaylova D., Pasic S., et al. The pediatric rheumatology international trials Organization/American College of Rheumatology provisional criteria for the evaluation of response to therapy in juvenile systemic lupus erythematosus: Prospective validation of the definition of improvement. Arthritis Rheum 2006, 55(3):355-363.
36. Wallace C.A., Ravelli A., Huang B., Giannini E.H. Preliminary validation of clinical remission criteria using the OMERACT filter for select categories of juvenile idiopathic arthritis. J Rheumatol 2006, 33(4):789-795.
37. Wallace C.A., Huang B., Bandeira M., Ravelli A., Giannini E.H. Patterns of clinical remission in select categories of juvenile idiopathic arthritis. Arthritis Rheum 2005, 52(11):3554-3562.
38. Rider L.G., Giannini E.H., Harris-Love M., Joe G., Isenberg D., Pilkington C., et al. Defining clinical improvement in adult and juvenile myositis. J Rheumatol 2003, 30(3):603-617.
39. Ruperto N., Ravelli A., Murray K.J., Lovell D.J., Andersson-Gare B., Feldman B.M., et al. Preliminary core sets of measures for disease activity and damage assessment in juvenile systemic lupus erythematosus and juvenile dermatomyositis. Rheumatology (Oxford) 2003, 42(12):1452-1459.
40. Goldsmith C.H., Boers M., Bombardier C., Tugwell P. Criteria for clinically important changes in outcomes: Development, scoring and evaluation of rheumatoid arthritis patient and trial profiles. OMERACT committee. J Rheumatol 1993, 20(3):561-565.
41. Tugwell P., Boers M. Developing consensus on preliminary core efficacy endpoints for rheumatoid arthritis clinical trials. OMERACT committee. J Rheumatol 1993, 20(3):555-556.
42. Isenberg D.A., Rahman A., Allen E., Farewell V., Akil M., Bruce I.N., et al. BILAG 2004. Development and initial validation of an updated version of the british isles lupus assessment group's disease activity index for patients with systemic lupus erythematosus. Rheumatology (Oxford) 2005, 44(7):902-906.
43. Gallagher M., Hares T., Spencer J., Bradshaw C., Webb I. The nominal group technique: A research tool for general practice?. Fam Pract 1993, 10(1):76-81.
44. Fitch K. The Rand UCLA appropriateness method user's manual 2001, Rand, Santa Monica (CA).
45. Chassin M.R., Kosecoff J., Solomon D.H., Brook R.H. How coronary angiography is used. Clinical determinants of appropriateness. JAMA 1987, 258(18):2543-2547.
46. Kravitz R.L., Park R.E., Kahan J.P. Measuring the clinical consistency of panelists' appropriateness ratings: The case of coronary artery bypass surgery. Health Policy 1997, 42(2):135-143.
47. Shekelle P.G., Park R.E., Kahan J.P., Leape L.L., Kamberg C.J., Bernstein S.J. Sensitivity and specificity of the RAND/UCLA appropriateness method to identify the overuse and underuse of coronary revascularization and hysterectomy. J Clin Epidemiol 2001, 54(10):1004-1010.
48. Lopez-Olivo M.A., Suarez-Almazor M.E. Developing guidelines in musculoskeletal disorders. Clin Exp Rheumatol 2007, 25(6 Suppl 47):28-36.
49. Fraser G.M., Pilpel D., Kosecoff J., Brook R.H. Effect of panel composition on appropriateness ratings. Int J Qual Health Care 1994, 6(3):251-255.
50. Shekelle P.G., Schriger D.L. Evaluating the use of the appropriateness method in the agency for health care policy and research clinical practice guideline development process. Health Serv Res 1996, 31(4):453-468.
51. MacLean C.H. Quality indicators for the management of osteoarthritis in vulnerable elders. Ann Intern Med 2001, 135(8 Pt 2):711-721.
52. Mikuls T.R., MacLean C.H., Olivieri J., Patino F., Allison J.J., Farrar J.T., et al. Quality of care indicators for gout management. Arthritis Rheum 2004, 50(3):937-943.
53. Silverman S.L., Cummings S.R., Watts N.B. Recommendations for the clinical evaluation of agents for treatment of osteoporosis: Consensus of an expert panel representing the American Society for Bone and Mineral Research (ASBMR), the International Society for Clinical Densitometry (ISCD), and the National Osteoporosis Foundation (NOF). J Bone Miner Res 2008, 23(1):159-165. Consensus Panel of the ASBMR, ISCD, NOF.
54. Yazdany J., Panopalis P., Gillis J.Z., Schmajuk G., MacLean C.H., Wofsy D., et al. A quality indicator set for systemic lupus erythematosus. Arthritis Rheum 2009, 61(3):370-377.
55. Furst D.E., Halbert R.J., Bingham C.O., Fukudome S., Anderson L., Bonafede P., et al. Evaluating the adequacy of disease control in patients with rheumatoid arthritis: A RAND appropriateness panel. Rheumatology (Oxford) 2008, 47(2):194-199.
56. Perry S., Kalberer J.T. The NIH consensus-development program and the assessment of health-care technologies: The first two years. N Engl J Med 1980, 303(3):169-172.
57. Ferguson J.H. The NIH consensus development program. The evolution of guidelines. Int J Technol Assess Health Care 1996, 12(3):460-474.
58. Lomas J. Words without action?. The production, dissemination, and impact of consensus recommendations. Annu Rev Public Health 1991, 12:41-65.
59. NIH consensus statement on total knee replacement. NIH Consens State Sci Statements 2003, 20(1):1-34.
60. Osteoporosis prevention, diagnosis, and therapy. NIH Consens Statement 2000, 17(1):1-45.
61. Total hip replacement. NIH Consens Statement 1994, 12(5):1-31.
62. Intravenous immunoglobulin. Consens Statement 1990, 8(5):1-23.
63. Guyatt G.H., Oxman A.D., Vist G.E., Kunz R., Falck-Ytter Y., Alonso-Coello P., et al. GRADE: An emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008, 336(7650):924-926.
64. Guyatt G.H., Cook D.J., Jaeschke R., Pauker S.G., Schunemann H.J. Grades of recommendation for antithrombotic agents: American College of Chest Physicians evidence-based clinical practice guidelines (8th edition). Chest 2008, 133(Suppl 6):123S-131S.
65. Jaeschke R., Guyatt G.H., Dellinger P., Schunemann H., Levy M.M., Kunz R., et al. Use of GRADE grid to reach decisions on clinical practice guidelines when consensus is elusive. BMJ 2008, 337:a744.
66. Becker R.C., Meade T.W., Berger P.B., Ezekowitz M., O'Connor C.M., Vorchheimer D.A., et al. The primary and secondary prevention of coronary artery disease: American College of Chest Physicians evidence-based clinical practice guidelines (8th edition). Chest 2008, 133(Suppl 6):776S-814S.
67. Shekelle P.G., Kravitz R.L., Beart J., Marger M., Wang M., Lee M. Are nonspecific practice guidelines potentially harmful?. A randomized comparison of the effect of nonspecific versus specific guidelines on physician decision making. Health Serv Res 2000, 34(7):1429-1448.