Measuring the impact of medical research: Moving from outputs to outcomes

American Journal of Psychiatry

Volumn 164, Issue 2, 2007, Pages 206-214

  Weiss, Anthony P ^a,b  

^a MASSACHUSETTS GENERAL HOSPITAL   (United States)

^b HARVARD MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NEUROLEPTIC AGENT;

DECISION MAKING; FUNDING; HEALTH CARE; HEALTH CARE QUALITY; HUMAN; MEDICAL PRACTICE; MEDICAL RESEARCH; MENTAL HEALTH CARE; MODEL; OUTCOME ASSESSMENT; PRIORITY JOURNAL; PROPHYLAXIS; QUALITY OF LIFE; REVIEW; SCHIZOPHRENIA;

EFFICIENCY; GOALS; HUMANS; LOGISTIC MODELS; OUTCOME ASSESSMENT (HEALTH CARE); PHYSICIAN'S PRACTICE PATTERNS; QUALITATIVE RESEARCH; QUALITY-ADJUSTED LIFE YEARS; RESEARCH; RESEARCH DESIGN; RESEARCH SUPPORT AS TOPIC;

EID: 33847288176     PISSN: 0002953X     EISSN: None     Source Type: Journal    
DOI: 10.1176/ajp.2007.164.2.206     Document Type: Review

References (100)

1. Rosenberg LE: Exceptional economic returns on investments in medical research. Med J Aust 2002; 177:368-371
2. Robinson JC: The end of asymmetric information. J Health Polit Policy Law 2001; 26:1045-1053
3. Passell P: Exceptional Returns: The Economic Value of America's Investment in Medical Research. New York, Funding First, Lasker Foundation, May 2000
4. Buxton M, Hanney S, Jones T: Estimating the economic value to societies of the impact of health research: a critical review. Bull World Health Organ 2004; 82:733-739
5. Murphy K, Topel R: Diminishing returns? the costs and benefits of improving health. Perspect Biol Med 2003; 46:S108-S128
6. Comroe JH, Dripps RD: Scientific basis for the support of biomedical science. Science 1976; 192:105-111
7. Garfield E: How can we prove the value of basic research? Curr Contents 1979; 40:5-9
8. Garfield E: The economic impact of research and development. Curr Contents 1981; 51:5-15
9. Wright SM, Beasley BW: Motivating factors for academic physicians within departments of medicine. Mayo Clin Proc 2004; 79:1145-1150
10. Gruman J, Prager D: Health research philanthropy in a time of plenty: a strategic agenda. Health Aff (Millwood) 2002; 21:265-269
11. Hanney SR, Grant J, Wooding S, Buxton MJ: Proposed methods for reviewing the outcomes of health research: the impact of funding by the UK's "Arthritis research campaign." Health Res Policy Syst 2004; 2:4
12. United Way: Measuring Program Outcomes: A Practical Approach. Alexandria, Va, United Way of America, 1996
13. Wholey J: Evaluation: Promise and Performance. Washington, DC, Urban Institute Press, 1979
14. Pincus HA, Fine T: The "anatomy" of research funding of mental illness and addictive disorders. Arch Gen Psychiatry 1992; 49:573-579
15. Brousseau RT, Langill D, Pechura CM: Are foundations overlooking mental health? Health Aff (Millwood) 2003; 22:222-229
16. Atasoylu AA, Wright SM, Beasley BW, Cofrancesco J Jr, Macpherson DS, Partridge T, Thomas PA, Bass EB: Promotion criteria for clinician-educators. J Gen Int Med 2003; 18:711-716
17. Levinson W, Rubenstein A: Mission critical: integrating clinician-educators into academic medical centers. N Engl J Med 1999; 341:840-844
18. Thomas PA, Diener-West M, Canto MI, Martin DR, Post WS, Streiff MB: Results of an academic promotion and career path survey of faculty at the Johns Hopkins University School of Medicine. Acad Med 2004; 79:258-264
19. Batshaw ML, Plotnick LP, Petty BG, Woolf PK, Mellits ED: Academic promotion at a medical school: experience at Johns Hopkins University School of Medicine. N Engl J Med 1988; 318:741-747
20. Gjerde C: Faculty promotion and publication rates in family medicine: 1981 versus 1989. Fam Med 1994; 26:361-365
21. Vydareny KH, Waldrop SM, Jackson VP, Manaster BJ, Nazarian GK, Reich CA, Ruzal-Shapiro CB: The road to success: factors affecting the speed of promotion of academic radiologists. Acad Radiol 1999; 6:564-569
22. Arndt KA: Information excess in medicine: overview, relevance to dermatology, and strategies for coping. Arch Derm 1992; 128:1249-1256
23. Price DJ: Little Science, Big Science, and Beyond. New York, Columbia University Press, 1986
24. Fernandez-Cano A, Torralbo M, Vallejo M: Reconsidering Price's model of scientific growth: an overview. Scientometrics 2004; 61:301-321
25. Milbank Memorial Fund: Better Information, Better Outcomes: The Use of Health Technology Assessment and Clinical Effectiveness Data in Health Care Purchasing Decisions in the United Kingdom and the United States. New York, Milbank Memorial Fund, July 2000
26. Hamilton DP: Publishing by - and for? - the numbers. Science 1990; 250:1331-1332
27. Pendlebury DA: Science, citation, and funding. Science 1991; 251:1410-1411
28. Kennedy D: Clinical trials and public trust. Science 2004; 306:1649
29. Patterson RE, Satia JA, Kristal AR, Neuhouser ML, Drewnowski A: Is there a consumer backlash against the diet and health message? J Am Diet Assoc 2001; 101:37-41
30. Kelch RP: Maintaining the public trust in clinical research. N Engl J Med 2002; 346:285-287
31. Charney DS, Innis RB, Nestler EJ, Davis KL, Nemeroff CB, Weinberger DR: Increasing public trust and confidence in psychiatric research. Biol Psychiatry 1999; 46:1-2
32. Boulware LE, Cooper LA, Ratner LE, LaVeist TA, Powe NR: Race and trust in the health care system. Pub Health Rep 2003; 118:358-365
33. Gamble VN: A legacy of distrust: African Americans and medical research. Am J Prev Med 1993; 9:35-38
34. Asai A, Ohnishi M, Nishigaki E, Sekimoto M, Fukuhara S, Fukui T: Focus group interviews examining attitudes toward medical research among the Japanese: a qualitative study. Bioethics 2004; 18:448-470
35. Corbie-Smith G, Thomas SB, St George DM: Distrust, race, and research. Arch Intern Med 2002; 162:2458-2463
36. Institute of Medicine: Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC, National Academy Press, March 2001
37. Grant J, Cottrell R, Cluzeau F, Fawcett G: Evaluating "payback" on biomedical research from papers cited in clinical guidelines: applied bibliometric study. BMJ 1999; 320:1107-1111
38. Buxton M, Hanney S, Packwood T, Roberts S, Youll P: Assessing benefits from Department of Health and National Health Service research and development. Public Money Management 2000; 20:29-34
39. Buxton M, Hanney S: How can payback from health services research be assessed? Health Serv Res Policy 1996; 1:35-43
40. Molas-Gallart J, Tang P, Morrow S: Assessing the non-academic impact of grant-funded socioeconomic research: results from a pilot study. Res Eval 2000; 9:171-182
41. Lavis J, Ross S, McLeod C, Gildiner A: Measuring the impact of health research. J Health Serv Res Policy 2003; 8:165-170
42. Wells KB: Treatment research at the crossroads: the scientific interface of clinical trials and effectiveness research. Am J Psychiatry 1999; 156:5-10
43. Schoenwald SK, Hoagwood K: Effectiveness, transportability, and dissemination of interventions: what matters when? Psychiatr Serv 2001; 52:1190-1197
44. Glasgow RE, Lictenstein E, Marcus AC: Why don't we see more translation of health promotion research to practice? rethinking the efficacy-to- effectiveness transition. Am J Pub Health 2003; 93:1261-1267
45. Grant RW, Cagliero E, Dubey AK, Gildesgame C, Chueh HC, Barry MJ, Singer DE, Nathan DM, Meigs JB: Clinical inertia in the management of type 2 diabetes metabolic risk factors. Diabet Med 2004; 21:150-155
46. Torrey EF: PORT: updated treatment recommendations. Schizophr Bull 2004; 30:617
47. Garfield E: The impact factor. Curr Contents 1994; 25:3-7
48. Lee KP, Schotland M, Bachetti P, Bero LA: Association of journal quality indicators with methodological quality of clinical research articles. JAMA 2002; 287:2805-2808
49. Saha S: Impact factor: a valid measure of journal quality? J Med Libr Assoc 2003; 91:42-46
50. Tomlinson S: The research assessment exercise and medical research. BMJ 2000; 320:636-639
51. Figa Talamanca A: The "impact factor" in the evaluation of research. Bull Group Int Rech Sci Stomatol Odontol 2002; 44:2-9
52. Fassoulaki A, Sarantopoulos C, Papilas K, Patris K, Melemeni A: Academic anesthesiologists' views on the importance of the impact factor of scientific journals: a North American and European survey. Can J Anesth 2001; 48:953-957
53. Coomarasamy A, Gee H, Publicover M, Khan KS: Medical journals and effective dissemination of health research. Health Info Libr J 2001; 18:183-191
54. Jones T, Hanney S, Buxton M, Burns T: What British psychiatrists read. Br J Psychiatry 2004; 185:251-257
55. Schein M, Paladugu R, Sutija VG, Wise L: What American surgeons read: a survey of a thousand fellows of the American College of Surgeons. Curr Surg 2000; 57:252-258
56. Lewison G: Researchers' and users' perceptions of the relative standing of biomedical papers in different journals. Scientometrics 2002; 53:229-240
57. Lauritsen J, Moller AM: Publications in anesthesia journals: quality and clinical relevance. Anesth Analg 2004; 99:1486-1491
58. Lewison G: From biomedical research to health improvement. Scientometrics 2002; 54:179-192
59. Trelle S: Information management and reading habits of German diabetologists: a questionnaire survey. Diabetologia 2002; 45:764-774
60. Vickery CE, Cotugna N: Journal reading habits of dieticians. J Am Diet Assoc 1992; 92:1510-1512
61. Skinner K, Miller B: Journal reading habits of registered nurses. J Contin Educ Nurs 1989; 20:170-173
62. Saint S, Christakis DA, Saha S, Elmore JG, Welsh DE, Baker P, Koepsell TD: Journal reading habit of internists. J Gen Intern Med 2000; 15:881-884
63. Burke DT, DeVito MC, Schneider JC, Julien S, Judelson AL: Reading habits of physical medicine and rehabilitation resident physicians. Am J Phys Med Rehabil 2004; 83:551-559
64. Burke DT, Judelson AL, Schneider JC, DeVito MC, Latta D: Reading habits of practicing physiatrists. Am J Phys Med Rehabil 2002; 81:779-787
65. Stross JK, Harlan WR: The dissemination of new medical information. JAMA 1979; 241:2622-2624
66. Nagpaul PS, Roy S: Constructing a multi-objective measure of research performance. Scientometrics 2003; 56:383-402
67. Wilson P, Richardson R, Sowden AJ, Evans D: Getting evidence into practice, in Undertaking Systematic Reviews of Research Effectiveness: CRD's Guidance for those Carrying Out or Commissioning Reviews. CRD Report 4, 2nd ed. Centre for Reviews and Dissemination, University of York, York, UK, 2000
68. Katon WJ, Simon G, Russo J, Von Korff M, Lin EH, Ludman E, Ciechanowski P, Bush T: Quality of depression care in a population-based sample of patients with diabetes and major depression. Med Care 2004; 42:1222-1229
69. Stein MB, Sherbourne CD, Craske MG, Means-Christensen A, Bystritsky A, Katon W, Sullivan G, Roy-Byrne PP: Quality of care for primary care patients with anxiety disorders. Am J Psychiatry 2004; 161:2230-2237
70. Wang PS, Demler O, Kessler RC: Adequacy of treatment for serious mental illness in the United States. Am J Pub Health 2002; 92:92-98
71. Lehman AF, Steinwachs DM: Patterns of usual care for schizophrenia: initial results from the Schizophrenia Patient Outcomes Research Team (PORT). Schizophr Bull 1998; 24:11-20
72. Young AS, Klap R, Sherbourne CD, Wells KB: The quality of care for depressive and anxiety disorders in the United States. Arch Gen Psychiatry 2001; 58:55-61
73. West JC, Wilk JE, Olfson M, Rae DS, Marcus S, Narrow WE, Pincus HA, Regier DA: Patterns and quality of treatment for patients with schizophrenia in routine psychiatric practice. Psychiatr Serv 2005; 56:283-291
74. McNeil BJ: Hidden barriers to improvement in the quality of care. N Engl J Med 2001; 345:1612-1620
75. Steyer TE, Freed GL, Lantz PM: Medicaid reimbursement for alternative therapies. Altern Ther Health Med 2002; 8:84-88
76. Casalino L, Gillies RR, Shortell SM, Schmittdiel JA, Bodenheimer T, Robinson JC, Rundall T, Oswald N, Schauffler H, Wang MC: External incentives, information technology, and organized processes to improve health care quality for patients with chronic diseases. JAMA 2003; 289:434-441
77. Fineberg HV: Effects of clinical evaluation on the diffusion of medical technology, in Assessing Medical Technologies. Edited by Institute of Medicine. Washington, DC, National Academy Press, 1985
78. Avorn J, Chen M, Hartley R: Scientific versus commercial sources of influence on the prescribing behavior of physicians. Am J Med 1982; 73:4-8
79. Caplow T: Market attitudes: a research report from the medical field. Harv Bus Rev 1954; 30:105-112
80. Mintzes B, Barer ML, Kravitz RL, Kazanjian A, Bassett K, Lexchin J, Evans RG, Pan R, Marion SA: Influence of direct to consumer pharmaceutical advertising and patients' requests on prescribing decisions: two site cross sectional survey. BMJ 2002; 324:278-279
81. Wazana A: Physicians and the pharmaceutical industry: is a gift ever just a gift? JAMA 2000; 283:373-380
82. Holdford DA: Using buzz marketing to promote ideas, services, and products. J Am Pharm Assoc 2004; 44:387-395
83. Jorm AF, Korten AE, Jacomb PA, Rodgers B, Pollitt P: Beliefs about the helpfulness of interventions for mental disorders: a comparison of general practitioners, psychiatrists, and clinical psychologists. Aust N Z J Psychiatry 1997; 31:844-851
84. Calvo BC, Rubinstein A: Influence of new evidence on prescrition patterns. J Am Board Fam Pract 2002; 15:457-462
85. Fineberg HV: Clinical evaluation: how does it influence medical practice? Bull Cancer 1987; 74:333-346
86. Brunt ME, Murray MD, Hui SL, Kesterson J, Perkins AJ, Tierney WM: Mass media release of medical research results: an analysis of antihypertensive drug prescribing in the aftermath of the calcium channel blocker scare of March 1995. J Gen Intern Med 2003; 18:84-94
87. Berwick DM: Disseminating innovations in health care. JAMA 2003; 289:1969-1975
88. Weisz B, Weiss JR: The impact of methodological factors on child psychotherapy outcome research: a meta-analysis for researchers. J Abnorm Child Psychol 1990; 18:639-670
89. Clarke GN: Improving the transition from basic efficacy research to effectiveness studies: methodological issues and procedures. J Consult Clin Psychol 1995; 63:718-725
90. McHugo GJ, Drake RE, Teague GB, Xie H: Fidelity to assertive community treatment and client outcomes in the New Hampshire dual disorders study. Psychiatr Serv 1999; 50:818-824
91. Curtis NM, Ronan KR, Borduin CM: Multisystemic treatment: a meta-analysis of outcome studies. J Fam Psychol 2004; 18:411-419
92. Weisz JR, Donenberg GR, Han SS, Weiss B: Bridging the gap between laboratory and clinic in child and adolescent psychotherapy. J Consult Clin Psychol 1995; 63:688-701
93. Rauch SL, Greenberg BD, Cosgrove GR: Neurosurgical treatments and deep brain stimulation, in Comprehensive Textbook of Psychiatry, 8th ed. Edited by Sadock BJ, Sadock VA. Philadelphia, Lippincott Williams Wilkins, 2005, pp 2983-2990
94. 108/158 Met genotype and olanzapine treatment on prefrontal cortical function in patients with schizophrenia. Am J Psychiatry 2004; 161:1798-1805
95. Roy-Byrne PP, Sherbourne CD, Craske MG, Stein MB, Katon W, Sullivan G, Means-Christensen A, Bystritsky A: Moving treatment from clinical trials to the real world. Psychiatr Serv 2003; 54:327-332
96. Roy-Byrne PP, Craske MG, Stein MB, Sullivan G, Bystritsky A, Katon W, Golinelli D, Sherbourne CD: A randomized effectiveness trial of cognitive-behavioral therapy and medication for primary care panic disorder. Arch Gen Psychiatry 2005; 62:290-298
97. Bauer MS, Williford WO, Dawson EE, Akiskal HS, Altshuler L, Fye C, Gelenberg A, Glick H, Kinosian B, Sajatovic M: Principles of effectiveness trials and their implementation in VA Cooperative Study #430: "Reducing the efficacy-effectiveness gap in bipolar disorder." J Affect Dis 2001; 67:61-78
98. Swartz MS, Perkins DO, Stroup TS, McEvoy JP, Nieri JM, Haak DC: Assessing clinical and functional outcomes in the Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) schizophrenia trial. Schizophr Bull 2003; 29:33-43
99. Murray CJ, Lopez AD: Global mortality, disability, and the contribution of risk factors: global burden of disease study. Lancet 1997; 349:1436-1442
100. Ware JJ, Sherbourne CD: The MOS 36-item short-form health survey (SF-36), I: conceptual framework and item selection. Med Care 1992; 30:473-483