Using evidence in pain practice: Part I: Assessing quality of systematic reviews and clinical practice guidelines

Pain Medicine

Volumn 9, Issue 5, 2008, Pages 518-530

  Chou, Roger ^a,b,c  

^a OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^b OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^c NONE   (United States)

Author keywords

Bias; Evidence based medicine; Meta analysis; Pain; Practice guidelines; Review literature

Indexed keywords

ANTIDEPRESSANT AGENT; CELECOXIB; CHONDROITIN; CYCLOOXYGENASE 2 INHIBITOR; GLUCOSAMINE; NONSTEROID ANTIINFLAMMATORY AGENT; PARACETAMOL; PLACEBO; QUININE; ROFECOXIB; STEROID;

ACUPUNCTURE; CARDIOVASCULAR RISK; CHRONIC PAIN; CLINICAL DECISION MAKING; CLINICAL PRACTICE; CLINICAL RESEARCH; CLINICAL TRIAL; CONFLICT OF INTEREST; COST BENEFIT ANALYSIS; DRUG COST; DRUG EFFICACY; DRUG SAFETY; EVIDENCE BASED MEDICINE; EXERCISE; GASTROINTESTINAL DISEASE; GASTROINTESTINAL HEMORRHAGE; HEART INFARCTION; HUMAN; LEG CRAMP; LOW BACK PAIN; LOW LEVEL LASER THERAPY; MANIPULATIVE MEDICINE; MEDICAL DECISION MAKING; MUSCULOSKELETAL PAIN; OSTEOARTHRITIS; PAIN; PRACTICE GUIDELINE; PUBLISHING; RESEARCH ETHICS; REVIEW; RISK BENEFIT ANALYSIS; SAMPLE SIZE; SCORING SYSTEM; SENSITIVITY ANALYSIS; TRANSCUTANEOUS NERVE STIMULATION;

CLINICAL TRIALS AS TOPIC; EVIDENCE-BASED MEDICINE; HUMANS; MEDLINE; PAIN; PEER REVIEW, RESEARCH; PHYSICIANS; PRACTICE GUIDELINES AS TOPIC; QUALITY CONTROL; RANDOM ALLOCATION; REVIEW LITERATURE AS TOPIC;

EID: 48449088771     PISSN: 15262375     EISSN: 15264637     Source Type: Journal    
DOI: 10.1111/j.1526-4637.2008.00422_1.x     Document Type: Review

References (134)

1. Verhagen AP, de Vet HCW, De Bie RA, Boers M, van den Brandt PA. The art of quality assessment of rcts included in systematic reviews. J Clin Epidemiol 2001;54:651-4.
2. Davidoff F, Haynes RB, Sackett DL, Smith R. Evidence-based medicine: A new journal to help doctors identify the information they need. BMJ 1995;310:1085-6.
3. Jadad AR, Carroll D, Moore A, McQuay H. Developing a database of published reports of randomised clinical trials in pain research. Pain 1996;66:239-46.
4. Ottenbacher K, DiFabio RP. Efficacy of spinal manipulation/mobilization therapy. A meta-analysis. Spine 1985;10(9):833-7.
5. Assendelft WJ, Morton SC, Yu EI, Suttorp MJ, Shekelle PG. Spinal manipulative therapy for low back pain. A meta-analysis of effectiveness relative to other therapies (see comment) (summary for patients in Ann Intern Med. 2003 Jun 3;138(11):I33; PMID: 12779310). Ann Intern Med 2003;138(11):871-81.
6. Young C, Horton R. Putting clinical trials into context. Lancet 2005;366:107-8.
7. Rothwell PM. External validity of randomised controlled trials: "To whom do the results of this trial apply?" Lancet 2005;365(9453):82-93.
8. Ioannidis JPA. Contradicted and initially stronger effects in highly cited clinical research. JAMA 2005;2005:218-28.
9. Lau J, Ioannidis JPA, Schmid CH. Summing up evidence: One answer is not always enough. Lancet 1998;351:123-7.
10. Cook DJ, Mulrow CD, Haynes RB. Systematic reviews: Synthesis of best evidence for clinical decisions. Ann Intern Med 1997;1126(5):376-80.
11. Egger M, Smith GD, Sterne JAC. Uses and abuses of meta-analysis. Clin Med 2001;1:478-84.
12. Field MJ, Lohr KN, eds. Clinical Practice Guidelines: Directions for a New Program. Washington, DC: National Academy Press; 1990.
13. Jadad AR, McQuay HJ. Meta-analyses to evaluate analgesic interventions: A systematic qualitative review of their methodology. J Clin Epidemiol 1996;49:235-43.
14. Mulrow C. The medical review article: State of the science. Ann Intern Med 1987;106(3):485-8.
15. McAlister FA, Clark HD, van Walraven C, et al. The medical review article revisited: Has the science improved? Ann Intern Med 1999;131:947-51.
16. Gotzsche PC. Reference bias in reports of drug trials. BMJ 1987;295:654-6.
17. Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts: Treatments for myocardial infarction. JAMA 1992;268(2):240-8.
18. Davies HTO, Crombie IK. What is a systematic review? Vol. 2006: What is...? Series Volume 1, Number 5 Hayward Medical Communications; 2001.
19. Pettigrew M. Why certain systematic reviews reach uncertain conclusions. BMJ 2003;326: 756-8.
20. Egger M, Smith GD. Meta-analysis. Potentials and promise. BMJ 1997;315:1371-4.
21. Fishbain D, Cutler RB, Rosomoff HL, Rosomoff RS. What is the quality of the implemented meta-analytic procedures in chronic pain treatment meta-analyses. Clin J Pain 2000;16:73-85.
22. Furlan AD, Clarke J, Esmail R, etal. A critical review of reviews on the treatment of chronic low back pain. Spine 2001;26(7): E155-62.
23. Hoving JL, Gross AR, Gasner D, et al. A critical appraisal of review articles on the effectiveness of conservative treatment for neck pain. Spine 2001;26:196-205.
24. Canter PH, Ernst E. Sources of bias in reviews of spinal manipulation for back pain. Wien Klin Wochenschr 2005;117(9-10):333-41.
25. Oxman AD, Cook DJ, Guyatt GH. Users' guides to the medical literature. VI: How to use an overview. JAMA 1994;272:1367-71.
26. Dickersin K, Scherer R, Lefebvre C. Identifying relevant studies for systematic reviews. BMJ 1994;309:1286-91.
27. Sampson M, Barrowman NJ, Moher D, et al. Should meta-analysts search Embase in addition to Medline? J Clin Epidemiol 2003;56:943-55.
28. Counsell C. Formulating questions and locating primary studies for inclusion in systematic reviews. Ann Intern Med 1997;127(5):380-7.
29. van Tulder M, Furlan AD, Bombardier C, Bouter L, The Editorial Board of the Cochrane Collaboration Back Review Group. Updated method guidelines for systematic reviews in the Cochrane Collaboration Back Review Group. Spine 2003;28(12):1290-9.
30. Egger M, Juni P, Bartlett C, Holenstein F, Sterne J. How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess 2003;7:1-76.
31. McAuley L, Pham B, Tugwell P, Moher D. Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses? Lancet 2000;356:1228-31.
32. Moher D, Pham B, Klassen TP, et al. What contributions do languages other than English make on the results of meta-analyses. J Clin Epidemiol 2000;53:964-72.
33. Furlan AD, van Tulder M, Cherkin D, et al. Acupuncture and dry-needling for low back pain: An updated systematic review within the framework of the Cochrane Collaboration. Spine 2005;30:944-63.
34. Manheimer E, White A, Berman B, Forys K, Ernst E. Meta-analysis acupuncture for low back pain. Ann Intern Med 2005;142:651-63.
35. Pham B, Klassen TP, Lawson ML, MOher D. Language of publication restrictions in systematic reviews gave different results depending on whether the intervention was conventional or complementary. J Clin Epidemiol 2005;58:769-76.
36. Bjordal JM, Couppe C, Chow RT, Tuner J, Ljunggren EA. A systematic review of low level laser therapy with location-specific doses for pain from chronic joint disorders. Aust J Physiother 2003;49:107-16.
37. de Bie RA, Verhagen AP, Lenssen AF, et al. Efficacy of 904 nm laser therapy in the management of musculoskeletal disorders: A systematic review. Phys Ther Rev 1998;3: 59-72.
38. Gur A, Karakoc M, Cevik R, et al. Efficacy of low power laser therapy and exercise on pain and functions in chronic low back pain. Lasers Surg Med 2003;32:233-8.
39. Chou R, Helfand M. Challenges in systematic reviews that assess treatment harms. Ann Intern Med 2005;142(12 part 2):1090-9.
40. Boswell MV, Colson JD, Sehgal N, Dunbar EE, Epter R. A systematic review of therapeutic facet joint interventnions in chronic spinal pain. Pain Phys 2007;10:229-53.
41. Leclaire R, Fortin L, Lambert R, Bergeron YM, Rossignol M. Radiofrequency facet joint denervation in the treatment of low bakc pain. A placebo-controlled clnical trial to assess efficacy. Spine 2001;26:1411-7.
42. van Kleef M, Barendse GAM, Kessels A, et al. Randomized trial of radiofrequency lumbar facet denervation for chronic low back pain. Spine 1999;24:1937-42.
43. Chalmers I, Haynes B. Reporting, updating, and correcting systematic reviews of the effects of health care. BMJ 1994;309:862-5.
44. Shojania KG, Sampson M, Ansari MT, et al. How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med 2007;147(4): 224-33.
45. Towheed TE, Anastassiades TP, Shea B, et al. Glucosamine therapy for treating osteoarthritis. Cochrane Database Syst Rev 2001;(1):CD002946.
46. Towheed TE, Maxwell L, Anastassiades TP, et al. Glucosamine therapy for treating osteoarthritis. Cochrane Database Syst Rev 2005;(2):CD002946.
47. French SD, McDonald S, McKenzie JE, Green SE. Investing in updating: How do conclusions change when Cochrane systematic reviews are updated? BMC Med Res Methodol 2005;5:33.
48. Baer PA, Thomas LM, Shainhouse Z. Treatment of osteoarthritis of the knee with a topical diclofenac solution: A randomised controlled, 6-week trial (ISRCTN53366886). BMC Musculoskelet Disord 2005;6:44.
49. Tugwell PS, Wells GA, Shainhouse JZ. Equivalence study of a topical diclofenac solution (pennsaid) compared with oral diclofenac in symptomatic treatment of osteoarthritis of the knee: A randomized controlled trial (see comment). J Rheumatol 2004;31(10):2002-12.
50. Mason L, Moore RA, Edwards JE, Derry S, McQuay HJ. Topical NSAIDs for chronic musculoskeletal pain: Systematic review and meta-analysis. BMC Musculoskelet Disord 2004;5:28.
51. van Tulder MW, Scholten RJPM, Koes BW, Deyo RA. Nonsteroidal anti-inflammatory drugs for low back pain. A systematic review within theh framework of the Cochrane Collaboration Back Review Group. Spine 2000;25:2501-13.
52. Lau J, Schmid CH, Chalmers TC. Cumulative meta-analysis of clinical trials builds evidence for exemplary medical care. J Clin Epidemiol 1995;48:45-57.
53. Juni P, Nartey L, Reichenbach S, et al. Risk of cardiovascular events and rofecoxib: Cumulative meta-analysis (see comment). Lancet 2004;364(9450):2021-9.
54. Detsky AS, Naylor CD, O'Rourke K, McGeer AJ, L'Abbe KA. Incorporating variations in theh quality of individual randomized trials into meta-analysis. J Clin Epidemiol 1992;45: 255-65.
55. Moja LP, Telaro E, D'Amico R, et al. Assessment of methodological quality of primary studies by systematic reviews: Results of the metaquality cross sectional study. BMJ 2005;330(7499):1053.
56. Juni P, Altman DG, Egger M. Assessing the quality of controlled clinical trials. BMJ 2001;323:42-6.
57. McAlindon TE, LaValley MP, Gulin JP, Felson DT. Glucosamine and chondroitin for treatment of osteoarthritis. JAMA 2000;283:1469-75.
58. Ezzo J, Berman B, Hadhazy VA, et al. Is acupuncture effective for the treatment of chronic pain? A systematic review. Pain 2000;86:217-25.
59. Jadad AR, Moore RA, Carroll D, et al. Assessing the quality of reports of randomized clinical trials: Is blinding necessary? Control Clin Trials 1996;17:1-12.
60. Moher D, Jones A, Cook DJ, et al. Does quality of randomised trials affect estimates of intervention efficacy reported in meta-analyses. Lancet 1998;352:609-13.
61. Moher D, Jadad AR, Nichol G, et al. Assessing the quality of randomized controlled trials: An annotated bibliography of scales and checklists. Control Clin Trials 1995;16 (1): 62-73.
62. Kalauokalani D, Cherkin DC, Sherman KJ, Koepsell TD, Deyo RA. Lessons from a trial of acupuncture and massage for low back pain. Spine 2001;26:1418-24.
63. Deyo RA, Bass JE, Walsh NE, Schoenfeld LS, Ramamurthy S. Can trials of physical treatments be blinded? The example of transcutaneous electrical nerve stimulation for chronic pain. Am J Phys Med Rehabil 1990;69:6-10 (comment 219-20).
64. Hawk C, Long CR, Reiter R, et al. Issues in planning a placebo-controlled tirla of manual methods: Results of a pilot study. J Altern Complement Med 2002;8:21-32.
65. Sherman KJ, Hogeboom CJ, Cherkin DC, Deyo RA. Description and validation of a noninvasive placebo acupuncture procedure. J Altern Complement Med 2002;8:11-9.
66. Balk EM, Bonis PAL, Moskowitz H, et al. Correlation of quality measures with estimates of treatment effect in meta-analyses of randomized controlled trials. JAMA 2002;287:2973-82.
67. Colle F, Rannou F, Revel M, Fermanian J, Poiraudeau S. Impact of quality scales on levels of evidence inferred from a systematic review of exercise therapy and low back pain. Arch Phys Med Rehabil 2002;83:1745-52.
68. Juni P, Witschi A, Bloch R, Egger M. The hazards of scoring the quality of clinical trials for meta-analysis. JAMA 1999;282:1054-60.
69. Bronfort G, Haas M, Evans RL, Bouter LM. Efficacy of spinal manipulation and mobilization for low back pain and neck pain: A systematic review and best evidence synthesis. Spine J 2004;4:335-56.
70. Lau J, Ioannidis JP, Schmid CH. Quantitative synthesis in systematic reviews. Ann Intern Med 1997;127(9): 820-6.
71. Karppinen J, Malmivaara A, Kurunlahti M, etal. Periradicular infiltration for sciatica. Spine 2001;26:1059-67.
72. Vad VB, Bhat AL, Lutz GE, Cammisa F. Transforaminal epidural steroid injections in lumbosacral radiculopathy: A prospective, randomized study. Spine 2002;27:11-6.
73. Abdi S, Datta S, Trescto AM, et al. Epidural steroids in the management of chronic spinal pain: A systematic review. Pain Phys 2007;10:185-212.
74. Chou R, Huffman LH. Nonpharmacologic therapies for acute and chronic low back pain: A review of the evidence for an American Pain Society/ American College of Physicians clinical practice guideline. Ann Intern Med 2007;147:492-504.
75. Glenny AM, Altman DG, Song F, et al. Indirect comparisons of competing interventions. Health Technol Assess 2005;9(26):1-148.
76. GRADE Working Group. Grading quality of evidence and strength of recommendations. BMJ 2004;328:1490-4.
77. Thompson SG. Why sources of heterogeneity in meta-analysis should be investigated. BMJ 1994;309:1351-5.
78. Richy F, Bruyere O, Ethgen O, et al. Structural and symptomatic efficacy of glucosamine and chondroitin in knee osteoarthritis: A comprehensive meta-analysis (see comment). Arch Intern Med 2003;163(13):1514-22.
79. Salerno SM, Browning R, Jackson JL. The effect of antidepressant treatment on chronic back pain: A meta-analysis (see comment). Arch Intern Med 2002;162(1):19-24.
80. Melander H, Ahlqvist-Rastad J, Meijer G, Beermann B. Evidence b(i)ased medicine-Selective reporting from studies sponsored by pharmaceutical industry: Review of studies in new drug applications. BMJ 2003;326:1171-3.
81. Als-Nielsen B, Chen W, Gluud C, Kjaergard LL. Association of funding and conclusions in randomized drug trials. JAMA 2003;290:921-8.
82. Lexchin J, Bero LA, Djulbegovic B, Clark O. Pharmaceutical industry sponsorship and research outcome and quality: Systematic review. BMJ 2003;326:1167-70.
83. Gibson JNA, Waddell G. Surgery for degenerative lumbar spondylosis: Updated Cochrane review. Spine 2005;30:2312-20.
84. Guzman J, Esmail R, Karjalainen K, et al. Multidisciplinary rehabilitation for chronic low back pain: Systematic review. BMJ 2001;322:1511-6.
85. Oxman AD, Guyatt GH. A consumer's guide to subgroup analyses. Ann Intern Med 1992;116:78-84.
86. Montori VM, Smieja M, Guyatt GH. Publication bias: A brief review for clinicians. Mayo Clin Proc 2000;75:1284-8.
87. Sterne JAC, Egger M, Smith GD. Investigating and dealing with publication and other biases in meta-analysis. BMJ 2001;323:101-5.
88. Man-Son-Hing M, Wells G, Lau A. Quinine for nocturnal leg cramps. A meta-analysis including unpublished data. J Gen Intern Med 1998;13:600-6.
89. Bekelman JE, Li Y, Gross CP. Scope and impact of financial conflicts of interest in biomedical research. JAMA 2003;289:454-65.
90. Ridker PM, Torres J. Reported outcomes in major cardiovascular clinical trials funded by for-profit and not-for-profit organization: 2000-2005. JAMA 2006;295:2270-4.
91. Shah RV, Albert TJ, Buegel-Sanchez V, et al. Industry support and correlation to study outcome for papers published in spine. Spine 2005;30:1099-104.
92. Moher D, Cook DJ, Eastwood S, et al. Improving the quality of reports of meta-analyses of randomised controlled trials: The QUORUM statement. Lancet 1999;354:1896-900.
93. Lau J, Ioannidis JPA, Terrin N, Schmid CH, Olkin I. The case of the misleading funnel plot. BMJ 2006;333:597-600.
94. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DRP. Ublication bias in clinical research. Lancet 1991;337:867-72.
95. Hayden JA, van Tulder MW, Malmivaara AV, Koes BW. Meta-analysis: Exercise therapy for nonspecific low back pain. Ann Intern Med 2005;142(9):765-75.
96. De Angelis CD, Drazen JM, Frizelle FA, et al. Is this clinical trial fully registered? - A statement from the International Committee of Medical Journal Editors. N Engl J Med 2005;352:2436-8.
97. Jorgensen AW, Hilden J, Gotzsche PC. Cochrane reviews compared with industry supported meta-analyses and other meta-anlyses of the same drugs: Systematic review. BMJ 2006;333:782. doi:10.1136/ bmj.38973.444699.0B.
98. Anderson R, Meeker WC, Wirick BE, et al. A meta-analysis of clinical trials of spinal manipulation. J Manipulative Physiol Ther 1992;15(3):181-94.
99. Goodman SN, Berlin JA. The use of predicted confidence intervals when planning experiments and the misuse of power when interpreting results. Ann Intern Med 1994;121: 200-6.
100. Moore RA, Derry S, Makinson GT, McQuay HJ. Tolerability and adverse events in clinical trials of celecoxib in osteoarthritis and rheumatoid arthritis: Systematic review and meta-analysis of information from company clinical trial reports. Arthritis Res Ther 2005;7:R644-65.
101. Cook DJ, Greengold NL, Ellrodt AG, Weingarten SR. The relation between systematic reviews and practice guidelines. Ann Intern Med 1997;127:210-6.
102. Jackson R, Feder G. Guidelines for clinical guidelines. BMJ 1998;317:427-8.
103. Lee C, Straus WL, Balshaw R, et al. A comparison of the efficacy and safety of nonsteroidal antiinflammatory agents versus acetaminophen in the treatment of osteoarthritis: A meta-analysis. Arthritis Rheum 2004;51(5):746-54.
104. Zhang W, Jones A, Doherty M. Does paracetamol (acetaminophen) reduce the pain of osteoarthritis? A meta-analysis of randomised controlled trials (see comment). Ann Rheum Dis 2004;63(8):901-7.
105. Hayward RSA, Wilson MC, Tunis SR, et al. How to use clinical practice guidelines, A. Are the recommendations valid? JAMA 1995;274:570-4.
106. Airaksinen O, Brox JI, Cedraschi C, et al. Chapter 4 European guidelines for the management of chronic nonspecific low back pain. Eur Spine J 2006;V15(0): S192-300.
107. Eddy DM. Clinical decision making: From theory to practice. Practice policies-Guidelines for methods. JAMA 1990;263:1839-41.
108. Grilli R, Magrini N, Penna A, Mura G, Liberati A. Practice guidelines developed by specialty societies: The need for a critical appraisal. Lancet 2000;355:103-6.
109. The AGREE Collaboration. Development and validation of an international appraisal instrument for assessing the quality of clinical practice guideliens: The AGREE project. Qual Saf Health Care 2003;12:18-23.
110. Leape LL, Park RE, Kahan JP, Brook RH. Group judgments of appropriateness: The effect of panel composition. Qual Assur Health Care 1992;4(2):151-9.
111. Pencharz JN, Grigoriadis E, Jansz GF, Bombardier C. A critical appraisal of clinical practice guidelins for the treatment of lower-limb osteoarthritis. Arthritis Res 2002;4:36-44.
112. Boswell MV, Trescot AM, Datta S, et al. Interventional techniques: Evidence-based practice guidelines in the management of chronic spinal pain. Pain Phys 2007;10:7-111.
113. Coulter I, Adams A, Shekelle P. Impact of varying panel membership on ratings of appropriateness in consensus panels-A comparison of a multi- and single disciplinary panel. Health Serv Res 1995;34:512-23.
114. van Tulder MW, Tuut MK, Pennick V, Bombardier C, Assendelft WJJ. Quality of primary care guidelines for acute low back pain. Spine 2004;29:E357-62.
115. Owens DK. Patient preferences and the development of practice guidelines. Spine 1998;23:1073-9.
116. Tallon D, Chard J, Dieppe P. Exploring the priorities of patients with osteoarthritis of the knee. Arthritis Care Res 2000;13:312-9.
117. Bigos SJ, Boyer OR, Braen GR, et al. Acute Low Back Problems in Adults. Clinical Practice Guideline Number 4. AHCPR Publication No. 95-0642. Rockville, MD: Agency for Health Care Policy and Research, Public Health Service, U.S. Department of Health and Human Services; December 1994. Available at: http://www.ncbi.nlm.nih.gov/books/bv.fcgi?rid= hstat6.chapter.25870 (access verified May 10, 2005).
118. Deyo RA. The messenger under attack-Intimidation of researchers by special-interest groups. N Engl J Med 1997;336:1176-80.
119. Steinbrook R. Guidance for guidelines. N Engl J Med 2007;356:331-3.
120. Papanikolaou GN, Baltogianni MS, Contopoulos-Ioannidis DG, et al. Reporting of conflicts of interest in guidelines of preventive and therapeutic interventions. BMC Med Res Methodol 2001;1: 3.
121. Taylor R, Giles J. Cash interests taint drug advice. Nature 2005;437(7062):1070-1.
122. Shekelle PG, Ortiz E, Rhodes S, et al. Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: How quickly do guidelines become outdated? JAMA 2001;286:1461-7.
123. Shekelle P, Eccles MP, Grimshaw JM, Woolf SH. When should clinical guidelines be updated? BMJ 2001;323:155-7.
124. Kearney PM, Baigent C, Godwin J, et al. Do selective cyclo-oxygenase-2 inhibitors and traditional non-steroidal anti-inflammatory drugs increase the risk of atherothrombosis? Meta-analysis of randomised trials. BMJ 2006;332:1302.
125. Simon LS, Lipman AG, Jacox AK, et al. Guideline for the Management of Pain in Osteoarthritis, Rheumatoid Arthritis, and Juvenile Chronic Arthritis, Vol. 2, 2nd edition. APS Clinical Practice Guideline Series. Glenview, IL: American Pain Society (APS); 2002.
126. Shaneyfelt TM, Mayo-Smith MF, Rothwangl J. Are guidelines following guidelines? The methodological quality of clinical practice guidelines in the peer-reviewed medical literature. JAMA 1999;281:1900-5.
127. Arnau JM, Vallano A, Lopez A, etal. A critical review of guidelines for low back pain. Eur Spine J 2006;15:543-53.
128. Guyatt G, Gutterman D, Baumann MH, et al. Grading strength of recommendatiosn and quality of evidence in clinical guidelines. Chest 2006;129:174-81.
129. Kalso E, Allan L, Dellemijn PLI, et al. Recommendations for using opioids in chronic non-cancer pain. Eur J Pain 2003;7:381-6.
130. Chou R, Qaseem A, Snow V, et al. Diagnosis and treatment of low back pain: A joint clinical practice guideline from the American College of Physicians and the American Pain Society. Ann Intern Med 2007;147:478-91.
131. Harris RP, Helfand M, Woolf SH, et al. Current methods of the U.S. Preventive Services Task Force. Am J Prev Med 2001;20(3S):21-35.
132. Guyatt G, Vist G, Falck-Ytter Y, et al. An emerging consensus on grading recommendations? ACP J Club 2006;144:A8-9.
133. Schunemann HJ, Fretheim A, Oxman AD. Improving the use of research evidence in guideline development: 9. Grading evidence and recommendations. Health Res Policy Syst 2006;4:21. doi: 10.1186/ 1478-4505-4-21.
134. Chou R, Huffman LH. Medications for acute and chronic low back pain: A review of the evidence for an American Pain Society/American College of Physicians clinical practice guideline. Ann Intern Med 2007;147:505-14.