Evaluating research in cardiovascular medicine: Citation counts are not sufficient

Circulation

Volumn 123, Issue 9, 2011, Pages 1038-1043

  McAlister, Finlay A ^a,b,c   Lawson, Fiona M E ^a   Good, A Heather ^a,b   Armstrong, Paul W ^a,b  

^a UNIVERSITY OF ALBERTA   (Canada)

^b MAZANKOWSKI ALBERTA HEART INSTITUTE   (Canada)

^c UNIVERSITY OF ALBERTA HOSPITAL   (Canada)

Author keywords

atherosclerosis; coronary artery bypass grafting; heart failure; research methodology; secondary prevention

Indexed keywords

ACETYLSALICYLIC ACID; BETA ADRENERGIC RECEPTOR BLOCKING AGENT; DIPEPTIDYL CARBOXYPEPTIDASE INHIBITOR; STATIN;

ACUTE HEART INFARCTION; ARTICLE; ATHEROSCLEROSIS; BIBLIOMETRICS; CARDIOVASCULAR DISEASE; CITATION ANALYSIS; CLINICAL RESEARCH; CORONARY ARTERY DISEASE; FIBRINOLYSIS; HEART FAILURE; HEART MUSCLE REVASCULARIZATION; HUMAN; INTERVENTIONAL CARDIOVASCULAR PROCEDURE; MORTALITY; PRIORITY JOURNAL;

BIBLIOMETRICS; BIOMEDICAL RESEARCH; CARDIOLOGY; HUMANS; PERIODICALS AS TOPIC;

EID: 79952717169     PISSN: 00097322     EISSN: 15244539     Source Type: Journal    
DOI: 10.1161/CIRCULATIONAHA.110.989772     Document Type: Article

References (51)

1. Panel on Return on Investment in Health Research. Making an Impact: A Preferred Framework and Indicators to Measure Returns on Investment in Health Research. Ottawa, ON, Canada: Canadian Academy of Health Sciences; 2009. Available at: http://www.cahs-acss.ca/e/publications/). Accessed January 18, 2010.
2. May RM. The scientific wealth of nations. Science. 1997;275:793-796. (Pubitemid 27074873)
3. Moed HF. The impact-factor debate: the ISI's uses and limits. Nature. 2002;415:731-732. (Pubitemid 34150472)
4. Ioannidis JPA. Contradicted and initially stronger effects in highly cited clinical research. JAMA. 2005;294:218-228.
5. Ford ES, Ajani UA, Croft JB, Critchley JA, Labarthe DR, Kottke TE, Giles WH, Capewell S. Explaining the decrease in U.S. deaths from coronary disease, 1980-2000. N Engl J Med. 2007;356:2388-2398. (Pubitemid 46883773)
6. Patsopoulos NA, Analatos AA, Ioannidis JP. Relative citation impact of various study designs in the health sciences. JAMA. 2005;293:2362-2366. (Pubitemid 40676758)
7. Fuster V, Gotto AM. Risk reduction. Circulation. 2000;102(suppl IV): IV-94 -IV-102.
8. Hall JE. Historical perspective of the renin-angiotensin system. Mol Biotechnol. 2003;24:27-39. (Pubitemid 36578042)
9. Mueller RL, Sanborn TA. The history of interventional cardiology: cardiac catheterization, angioplasty, and related interventions. Am Heart J. 1995;129:146-172.
10. Black JW. Drugs from emasculated hormones: the principles of syntopic antagonism. In: Frängsmyr T, Lindsten J, eds. Nobel Lectures, Physiology or Medicine 1981-1990. Singapore: World Scientific Publishing; 1993: 418-440.
11. Brown MS, Goldstein JL. A receptor-mediated pathway for cholesterol homeostasis. In: Frängsmyr T, Lindsten J, eds. Nobel Lectures, Physiology or Medicine 1981-1990. Singapore: World Scientific Publishing; 1993:284-324.
12. Vane JR. Adventures and excursions in bioassay: the stepping stones to prostacyclin. In: Frängsmyr T, Lindsten J, eds. Nobel Lectures, Physiology or Medicine 1981-1990. Singapore: World Scientific Publishing; 1993:145-170.
13. Comroe JH, Dripps RD. Scientific basis for the support of biomedical science. Science. 1976;192:105-111.
14. Tigerstedt R, Bergman PG. Niere und kreislauf. Skand Arch Physiol. 1898;8:223-271.
15. Goldblatt H, Lynch J, Hanzal RF, Summerville WW. Studies on experimental hypertension, I: the production of persistent elevation of systolic blood pressure by means of renal ischemia. J Exp Med. 1934;59:347-380.
16. Page IH, Helmer OH. A crystalline pressor substance (angiotonin) resulting from the interaction between renin and renin-activator. J Exp Med. 1940;71:29-42.
17. Skeggs LT, Marsh WH, Kahn JR, Shumway NP. The existence of two forms of hypertension. J Exp Med. 1954;29:275-282.
18. Skeggs LT, Kahn JR, Shumway NP. Preparation and function of the hypertensin-converting enzyme. J Exp Med. 1956;103:295-305.
19. Davis JO. In discussion of: Farrell G III. Aldosterone chemistry and physiology: the physiological factors which influence the secretion of aldosterone. Recent Prog Horm Res. 1959;15:275-310.
20. Laragh JH, Angers M, Kelly WG, Lieberman S. Hypotensive agents and pressor substances: the effect of epinephrine, norepinephrine, angiotensin II, and others on the secretory rate of aldosterone in man. JAMA. 1960; 174:234-240.
21. Guyton AC, Langston JB, Navar G. Theory for renal autoregulation by feedback at juxtaglomerular apparatus. Circ Res. 1964;15(suppl): 187-197.
22. Thurau K. Renal hemodynamics. Am J Med. 1964;36:698-719.
23. Ames RP, Borkowski AJ, Sicinski A, Laragh JH. Prolonged infusions of angiotensin II and norepinephrine and blood pressure, electrolyte balance, and aldosterone and cortisol secretion in normal man and in cirrhosis with ascites. J Clin Invest. 1965;44:1171-1185.
24. Ferreira SH, Rocha e Silva M. Potentiation of bradykinin and eledoisin by BPF (bradykinin-potentiating factor) from Bothrops jararaca venom. Experientia. 1965;21:347-349.
25. Pals DT, Masucci FD, Sipos F, Denning GS. Specific competitive antagonists of vascular action of angiotensin II. Circ Res. 1971;29:664-672.
26. Ondetti MA, Williams NJ, Sabo EF, Pluscec J, Weaver ER, Kocy O. Angiotensin-converting enzyme inhibitors from the venom of Bothrops jararaca: isolation, elucidation of structure and synthesis. Biochemistry. 1971;10:4033-4039.
27. Ondetti MA, Rubin B, Cushman DV. Design of specific inhibitors of angiotensin converting enzyme: new class of orally active antihypertensive agents. Science. 1977;196:441-444. (Pubitemid 8073845)
28. Brunner HR, Laragh JH, Baer L. Essential hypertension: renin and aldosterone, heart attack and stroke. N Engl J Med. 1972;286:441-449.
29. Curtiss C, Cohn JN, Vrobel T, Franciosa JA. Role of the renin-angiotensin system in the systemic vasoconstriction of chronic congestive heart failure. Circulation. 1978;58:763-770. (Pubitemid 9042756)
30. Gavras H, Faxon DP, Berkoben J, Brunner HR, Ryan TJ. Angiotensin converting enzyme inhibition in patients with congestive heart failure. Circulation. 1978;58:770-776. (Pubitemid 9042757)
31. Captopril Multicenter Research Group. A placebo-controlled trial of captopril in refractory chronic congestive heart failure. J Am Coll Cardiol. 1983;2:755-763.
32. Pfeffer MA, Pfeffer JM, Steinberg C, Finn P. Survival after an experimental myocardial infarction: beneficial effects of long-term therapy with captopril. Circulation. 1985;72:406-412. (Pubitemid 15019891)
33. The CONSENSUS Trial Study Group. Effects of enalapril on mortality in severe congestive heart failure: results of the Cooperative North Scandinavian Enalapril Survival Study (CONSENSUS). N Engl J Med. 1987; 316:1429-1435.
34. Pfeffer MA, Braunwald E, Moye LA, Basta L, Brown EJ Jr, Cuddy TE, Davis BR, Geltman EM, Goldman S, Flaker GC, Klein M, Lamas GA, Packer M, Rouleau J, Rouleau JL, Rutherford J, Wertheimer JH, Hawkins CM; on behalf of the SAVE Investigators. Effect of captopril on mortality and morbidity in patients with left ventricular dysfunction after myocardial infarction: results of the Survival and Ventricular Enlargement Trial. N Engl J Med. 1992;327:669-677.
35. Yusuf S, Sleight P, Pogue J, Bosch J, Davies R, Dagenais G. Effects of an angiotensin-converting-enzyme inhibitor, ramipril, on cardiovascular events in high-risk patients. N Engl J Med. 2000;342:145-153. (Pubitemid 30051645)
36. McAlister FA, Van Diepen S, Padwal R, Johnson JA, Majumdar SR. How evidence based are the recommendations in evidence-based guidelines? PLoS Med. 2007;4:e250-e258.
37. Chew M, Villanueva EV, Van der Weyden MB. Life and times of the impact factor: retrospective analysis of trends for seven medical journals (1994 -2005) and their Editors' views. J R Soc Med. 2007;100:142-150. (Pubitemid 46569804)
38. Patterson MS, Harris S. The relationship between reviewers' qualityscores and number of citations for papers published in the journal Physics in Medicine and Biology from 2003-2005. Scientometrics. 2009;80: 343-349.
39. Kulkarni AV, Busse JW, Shams I. Characteristics associated with citation rate of the medical literature. PLoS One. 2007;2:e403.
40. Callaham M, Wears RL, Weber E. Journal prestige, publication bias, and other characteristics associated with citation of published studies in peerreviewed journals. JAMA. 2002;287:2847-2850. (Pubitemid 34591981)
41. Lokker C, McKibbon KA, McKinlay RJ, Wilczynski NL, Haynes RB. Prediction of citation counts for clinical articles at two years using data available within three weeks of publication: retrospective cohort study. BMJ. 2008;336:655-657. (Pubitemid 351481236)
42. Hanney S, Frame I, Grant J, Buxton M, Young T, Lewison G. Using categorisations of citations when assessing the outcomes from health research. Scientometrics. 2005;65:357-379. (Pubitemid 41433508)
43. Garfield E. The history and meaning of the journal impact factor. JAMA. 2006;295:90-93. (Pubitemid 43042694)
44. Seglen PO. Why the impact factor of journals should not be used for evaluating research. BMJ. 1997;314:497-499.
45. Dickersin K, Scherer R, Suci EST, Gil-Montero M. Problems with indexing and citation of articles with group authorship. JAMA. 2002;287: 2772-2774. (Pubitemid 34591960)
46. Anonymous. Errors in citation statistics. Nature. 2002;415:101.
47. Kulkarni A, Aziz B, Shams I, Busse JW. Comparisons of citations in Web of Science, Scopus, and Google Scholar for articles published in general medical journals. JAMA. 2009;302:1092-1096.
48. Perneger TV. Relation between online "hit counts" and subsequent citations: prospective study of research papers in the BMJ. BMJ. 2004;329: 546-547. (Pubitemid 39215204)
49. Majumdar SR, McAlister FA, Furberg CD. From publication to practice in chronic cardiovascular disease: the long and winding road. J Am Coll Cardiol. 2004;43:1738-1742. (Pubitemid 38622507)
50. Wooding S, Hanney S, Buxton M, Grant J. Payback arising from research funding: evaluation of the Arthritis Research Campaign. Rheumatology. 2005;44:1145-1156. (Pubitemid 41236022)
51. Grant J, Cottrell R, Cluzeau F, Fawcett G. Evaluating "payback" on biomedical research from papers cited in clinical guidelines: applied bibliometric study. BMJ. 2000;320:1107-1111 (Pubitemid 30213967)