The Cycle of Bias in Health Research: A Framework and Toolbox for Critical Appraisal Training

Accountability in Research

Volumn 20, Issue 2, 2013, Pages 127-141

  Odierna, Donna H ^a   Forsyth, Susan R ^a   White, Jenny ^a   Bero, Lisa A ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

bias in research; conflicts of interest; evidence based medicine; industry sponsorship of health studies; informed decision making; research ethics

Indexed keywords

ARTICLE; CONFLICT OF INTEREST; CONSENSUS DEVELOPMENT; DECISION MAKING; EDUCATION; ETHICS; EVIDENCE BASED MEDICINE; HEALTH CARE PERSONNEL; HUMAN; MEDICAL RESEARCH; METHODOLOGY; PATIENT EDUCATION; PUBLISHING; STATISTICAL BIAS; TEACHING; THINKING; UNITED STATES;

BIAS (EPIDEMIOLOGY); BIOMEDICAL RESEARCH; CALIFORNIA; CONFLICT OF INTEREST; DECISION MAKING; EVIDENCE-BASED MEDICINE; HEALTH PERSONNEL; HUMANS; PATIENT EDUCATION AS TOPIC; PUBLICATION BIAS; TEACHING; THINKING;

EID: 84874476169     PISSN: 08989621     EISSN: 15455815     Source Type: Journal    
DOI: 10.1080/08989621.2013.768931     Document Type: Article

References (64)

1. Akl, E. A., Oxman, A. D., Herrin, J., Vist, G. E., Terrenato, I., Sperati, F., Costiniuk, C., Blank, D. and Schunemann, H. 2011. Using alternative statistical formats for presenting risks and risk reductions. Cochrane Database Syst. Rev., 3: CD006776
2. Aveyard, H. 2007. Doing a Literature Review in Health and Social Science: A Practical Guide, New York: McGraw-Hill.
3. Barnes, D. E. and Bero, L.A. 1998. Why review articles on the health effects of passive smoking reach different conclusions. JAMA, 279: 1566-1570.
4. Belluck, P. November 10 2008. "Cholesterol-fighting drugs show wider benefit". In New York Times November 10,
5. Berger, B., Steckelberg, A., Meyer, G., Kasper, J. and Muhlhauser, I. 2010. Training of patient and consumer representatives in the basic competencies of evidence-based medicine: a feasibility study. BMC Med. Educ., 10: 16
6. Bero, L. A. and Jadad, A. R. 1997. How consumers and policymakers can use systematic reviews for decision making. Ann. Intern. Med., 127: 37-42.
7. Bero, L., Oostvogel, F., Bacchetti, P. and Lee, K. 2007. Factors associated with findings of published trials of drug-drug comparisons: Why some statins appear more efficacious than others. PLoS Med., 4: e184
8. Cassel, C. K and Guest, J. A. 2012. Choosing wisely: Helping physicians and patients make smart decisions about their care. JAMA: The Journal of the American Medical Association, 307: 1801-1802.
9. Cassels, A., Hughes, M. A, Cole, C, Mintzes, B., Lexchin, J and McCormack, J. P. 2003. Drugs in the news: An analysis of Canadian newspaper coverage of new prescription drugs. CMAJ, 168: 1133-1137.
10. Clinical and Translational Science Institute. (2012). Community Engagement & Health Policy. Univeristy of California, San Francisco 2012, http://ctsi.ucsf.edu/about-us/programs/community-engagement-health-policy (Accessed: 9 August 2012).
11. Cook, D. M., Boyd, E. A., Grossmann, C. and Bero, L. A. 2007. Reporting science and conflicts of interest in the lay press. PLoS One, 2: e1266
12. Coomarasamy, A., Taylor, R. and Khan, K. S. 2003. A systematic review of postgraduate teaching in evidence-based medicine and critical appraisal. Med. Teach., 25: 77-81.
13. Crombie, I. K. 1996. The Pocket Guide to Critical Appraisal, London: BMJ Publishing Group.
14. Dickersin, K., Braun, L, Mead, M., Millikan, R., Wu, A. M, Pietenpol, J., Troyan, S., Anderson, B. and Visco, F. 2001. Development and implementation of a science training course for breast cancer activists: Project LEAD (leadership, education and advocacy development). Health Expect, 4: 213-220.
15. Dickerson, K., Leeman, R. F., Mazure, C. M. and O'Malley, S. S. 2009. The inclusion of women and minorities in smoking cessation clinical trials: a systematic review. Am. J. Addict., 18: 21-28.
16. Dorsch, J. L., Frasca, M. A., Wilson, M. L. and Tomsic, M. L. 1990. A multidisciplinary approach to information and critical appraisal instruction. Bull. Med. Libr. Assoc., 78: 38-44.
17. Enstrom, J. E. and Kabat, G. C. 2003. Environmental tobacco smoke and tobacco related mortality in a prospective study of Californians, 1960-98. BMJ, 326: 1057-1066.
18. FAMRI (2012). Statements. Flight Attendant Medical Research Institute 2007, http://www.famri.org/about_famri/mission_statement.html (Accessed: 9 August 2012).
19. Grady, D. and Redberg, R. F. 2010. Less is more: How less health care can result in better health. Archives of Internal Medicine, 170: 759-750.
20. Graf, C., Wager, E., Bowman, A., Fiack, S., Scott-Lichter, D. and Robinson, A. 2007. Best practice guidelines on publication ethics: A publisher's perspective. International Journal of Clinical Practice, 61: 1-26.
21. Green, M. L. and Ellis, P. J. 1997. Impact of an evidence-based medicine curriculum based on adult learning theory. J. Gen. Intern. Med., 12: 742-750.
22. Greenhalgh, T. 2010. How to Read a Paper: The Basics of Evidence-Based Medicine, 4th, Oxford, UK: Wiley-Blackwell.
23. Guyatt, G., Rennie, D., Meade, M. O. and Cook, D. J. 2008. "Users' Guides to the Medical Literature: A Manual for Evidence-Based Clinical Practice". In JAMA & Archives Journals, Second, New York: McGraw-Hill Medical.
24. Hadley, J. A., Wall, D. and Khan, K. S. 2007. Learning needs analysis to guide teaching evidence-based medicine: Knowledge and beliefs amongst trainees from various specialities. BMC Med. Educ., 7: 11
25. Higgins, J. P. T. and Green, S. 2008. Cochrane Handbook for Systematic Reviews of Interventions, Edited by: Collaboration, Cochrane. Chichester, England: Wiley-Blackwell. Cochrane Book Series
26. Hughes, K. S., Schnaper, L. A., Berry, D., Cirrincione, C., McCormick, B., Shank, B, Wheeler, J., Champion, L. A., Smith, T. J., Smith, B. L., Shapiro, C., Muss, H. B., Winer, E., Hudis, C., Wood, W., Sugarbaker, D., Henderson, I. C. and L. Norton, L. 2004. Lumpectomy plus tamoxifen with or without irradiation in women 70 years of age or older with early breast cancer. N. Engl. J. Med., 351: 971-977.
27. Hyde, C., Parkes, J., Deeks, J. and Milne, R. 2011. "Systematic review of effectiveness of teaching critical appraisal (Structured abstract)". In Database of Abstracts of Reviews of Effects (4)
28. Institute of Medicine, ed. 2009. Conflict of Interest in Medical Research, Education, and Practice. Edited by E. Committee on Conflict of Interest in Medical Research, and Practice, Board on Health Sciences Policy, Washington, DC: National Academies Press. Committee on Conflict of Interest in Medical Research, Education, and Practice, Institute of Medicine. "Front Matter." Conflict of Interest in Medical Research, Education, and Practice. Washington, DC: The National Academies Press, 2009
29. Ioannidis, J. 2005. Why Most Published Research Findings Are False. PLoS Med., 2: e124
30. Jewell, C. J. and Bero, L. A. 2008. Developing Good Taste in Evidence": Facilitators of and hindrances to evidence-informed health policymaking in state government. Milbank Quarterly, 86: 177-208.
31. Kirkby, H. M., Calvert, M., Draper, H., Keeley, T. and Wilson, S. 2012. What potential research participants want to know about research: a systematic review. BMJ Open, 2(3)
32. Last, J. M. 2001. A Dictionary of Epidemiology, 4th, New York: Oxford University Press.
33. Lavis, J. N., Lomas, J., Hamid, M. and Sewankambo, N. K. 2006. Assessing country-level efforts to link research to action. Bulletin of the World Health Organization, 84: 620-628.
34. Lenzer, J. and Brownlee, S. 2008. Naming names: Is there an (unbiased) doctor in the house?. BMJ, 337: a930
35. Lundh, A., Sismondo, S., Lexchin, J., Busuioc, O. A. and Bero, L. A. 2012. Industry sponsorship and research outcome. Cochrane Database of Systematic Reviews., 12 Dec 12: MR000033 doi:10.1002/14651858.MR000033.pub2
36. Moynihan, R. 2003. Making medical journalism healthier. Lancet, 361: 2097-2098.
37. Moynihan, R., Bero, L. A., Ross-Degnan, D., Henry, D., Lee, K., Watkins, J., Mah, C. and Soumerai, S. B. 2000. Coverage by the news media of the benefits and risks of medications. N. Engl. J. Med., 342: 1645-1650.
38. Nabulsi, M., Harris, J., Letelier, L., Ramos, K., Hopayian, K., Parkin, C., Porzsolt, F., Sestini, P., Slavin, M. and Summerskill, W. 2007. Effectiveness of education in evidence-based healthcare: The current state of outcome assessments and a framework for future evaluations. Int. J. Evid. Based. Health c, 5: 468-476.
39. 2008. Who should take a statin?. New York Times, November: 17 New York Times. Editorial
40. Odierna, D. H., White, J., Boland, M. and Bero, L. A. October 18-22 2010. The role of critical appraisal training in healthcare decision making and communication, October 18-22, Keystone, Colorado, USA: Paper read at Cochrane and Campbell Colloquium. 2010
41. Odierna, D. H., White, J., Forsyth, S. and Bero, L. A. 2012. Critical appraisal training increases understanding and confidence, and enhances the use of evidence in diverse categories of learners. Health Expectations., 12 Dec 16 [Epub ahead of print]In press doi:10.1111/hex.12030
42. Oliver, S., Clarke-Jones, L., Rees, R., Milne, R., Buchanan, P., Gabbay, J., Gyte, G., Oakley, A. and Stein, K. 2004. Involving consumers in research and development agenda setting for the NHS: Developing an evidence-based approach. Health Technol. Assess., 8: 1-148. III-IV
43. Parker-Pope, T. 2008. A call for caution in the rush to statins. New York Times, November 18
44. Parkes, J., Hyde, C., Deeks, J. and Milne, R. 2001. Teaching critical appraisal skills in health care settings. Cochrane Database Syst. Rev.,: CD001270
45. Polit, D. F. and Tatano-Beck, C. 2008. Nursing Research: Generating and Assessing Evidence for Nursing Practice, 8th, Philadelphia: Lippincott, Williams, and Wilkins.
46. Resnik, D. B. 1998. Conflicts of Interest in Science. Perspectives on Science, 6: 381-408.
47. Ridker, P. M., Danielson, E., Fonseca, F. A., Genest, J., Gotto, A. M., Kastelein, J. J., Koenig, W., Libby, P., Lorenzatti, A. J., MacFadyen, J. G., Nordestgaard, B. G., Shepherd, J., Willerson, J. T. and Glynn, R. J. 2008. Rosuvastatin to prevent vascular events in men and women with elevated C-reactive protein. N. Engl. J. Med., 359: 2195-2207. JrJUPITER Study Group
48. Rochon, P. A., Clark, J. P., Binns, M. A., Patel, V. and Gurwitz, J. H. 1998. Reporting of gender-related information in clinical trials of drug therapy for myocardial infarction. CMAJ, 159: 321-327.
49. Rochon, P. A., Mashari, A., Cohen, A., Misra, A., Laxer, D., Streiner, D. L., Clark, J. P., Dergal, J. M. and Gold, J. 2004. The inclusion of minority groups in clinical trials: problems of under representation and under reporting of data. Account. Res., 11: 215-223.
50. Rodwin, M. A. (2001). The Politics of Evidence-Based Medicine. Suffolk University Health & Biomedical Law Paper 3. http://lsr.nellco.org/suffolk_hbl/3
51. Roseman, M., Milette, K., Bero, L. A., Coyne, J. C., Lexchin, J., Turner, E. H. and Thombs, B. D. 2011. Reporting of conflicts of interest in meta-analyses of trials of pharmacological treatments. JAMA: The Journal of the American Medical Association, 305: 1008-1017.
52. Roseman, M., Turner, E. T., Lexchin, J., Coyne, J. C., Bero, L. A. and Thombs, B. D. 2012. Reporting of conflicts of interest from drug trials in Cochrane reviews: Cross-sectional study. BMJ, 345
53. Sackett, D., Straus, S. E., Richardson, W.S., Rosenberg, W. and Haynes, R.B. 2000. Evidence-Based Medicine: How to Practice and Teach EBM, 2, New York: Churchill Livingstone.
54. Schulz, K. F. and Grimes, D. A. 2002a. Allocation concealment in randomised trials: Defending against deciphering. The Lancet, 359: 614-618.
55. Schulz, K. F. and Grimes, D. A. 2002b. Blinding in randomised trials: Hiding who got what. The Lancet, 359: 696-700.
56. Schulz, K. F., Chalmers, I., Hayes, R. J. and Altman, D. G. 1995. Empirical evidence of bias: Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA: The Journal of the American Medical Association, 273: 408-412.
57. Shamoo, A. E. and Resnik, D. B. 2009. "Conflicts of Interest and Scientific Objectivity". In Responsible Conduct of Research, Edited by: Shamoo, A. and Resnik, D. Oxford: Oxford University Press.
58. Shaneyfelt, T., Baum, K. D., Bell, K., Feldstein, D., Houston, T. K., Kaatz, S., Whelan, C. and Green, M. 2006. Instruments for evaluating education in evidence-based practice: a systematic review. JAMA, 296: 1116-1127.
59. Steinman, M. A., Bero, L.A., Chren, M. M. and Landefeld, C.S. 2006. Narrative review: The promotion of gabapentin: An analysis of internal industry documents. Ann. Intern. Med., 145: 284-293.
60. Stryer, D. and Bero, L. A. 1996. Characteristics of materials distributed by drug companies. Journal of General Internal Medicine, 11: 575-583.
61. U.S. Department of Health and Human Services. 2011. "Promoting Objectivity in Research for which Public Health Service Funding is Sought and Responsible Prospective Contractors". In Rules and Regulations, Edited by: Register, F. National Institutes of Health.
62. Weinfurt, K. P., Friedman, J. Y., Allsbrook, J., Dinan, M. A., Hall, M. and Sugarman, J. 2006. Views of potential research participants on financial conflicts of interest: Barriers and opportunities for effective disclosure. J. Gen. Intern. Med., 21: 901-906.
63. White, J and Bero, L. A. 2010. Corporate manipulation of research: Strategies are similar across five industries. Stanford Law & Policy Review, 21: 105-134.
64. Yank, V., Rennie, D. and Bero, L. A. 2007. Financial ties and concordance between results and conclusions in meta-analyses: retrospective cohort study. BMJ, 335: 1202-1205.