Citation Analysis May Severely Underestimate the Impact of Clinical Research as Compared to Basic Research

PLoS ONE

Volumn 8, Issue 4, 2013, Pages

  van Eck, Nees Jan ^a   Waltman, Ludo ^a   van Raan, Anthony F J ^a   Klautz, Robert J M ^b   Peul, Wilco C ^b  

^a LEIDEN UNIVERSITY   (Netherlands)

^b LEIDEN UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CITATION ANALYSIS; CLINICAL RESEARCH; INTERVENTION STUDY; MEDICAL LITERATURE; METHODOLOGY; PUBLICATION;

BIBLIOMETRICS; BIOMEDICAL RESEARCH; COMPUTER SIMULATION; HUMANS; MODELS, STATISTICAL; RESEARCH;

EID: 84876532091     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0062395     Document Type: Article

References (41)

1. Patel VM, Ashrafian H, Ahmed K, Arora S, Jiwan S, et al. (2011) How has healthcare research performance been assessed? A systematic review. Journal of the Royal Society of Medicine 104(6): 251-261.
2. Hirsch JE, (2005) An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences 102(46): 16569-16572.
3. Chew M, Villanueva EV, Van der Weyden MB, (2007) Life and times of the impact factor: Retrospective analysis of trends for seven medical journals (1994-2005) and their editors' views. Journal of the Royal Society of Medicine 100(3): 142-150.
4. Garfield E, (1996) How can impact factors be improved? British Medical Journal 313(7054): 411-413.
5. Garfield E, (2006) The history and meaning of the journal impact factor. JAMA: Journal of the American Medical Association 295(1): 90-93.
6. Radicchi F, Fortunato S, Castellano C, (2008) Universality of citation distributions: Toward an objective measure of scientific impact. Proceedings of the National Academy of Sciences 105(45): 17268-17272.
7. Waltman L, Van Eck NJ, Van Leeuwen TN, Visser MS, Van Raan AFJ, (2011) Towards a new crown indicator: An empirical analysis. Scientometrics 87(3): 467-481.
8. Glänzel W, Thijs B, Schubert A, Debackere K, (2009) Subfield-specific normalized relative indicators and a new generation of relational charts: Methodological foundations illustrated on the assessment of institutional research performance. Scientometrics 78(1): 165-188.
9. Waltman L, Van Eck NJ, Van Leeuwen TN, Visser MS, Van Raan AFJ, (2011) Towards a new crown indicator: Some theoretical considerations. Journal of Informetrics 5(1): 37-47.
10. Van Eck NJ, Waltman L, (2011) Text mining and visualization using VOSviewer. ISSI Newsletter 7(3): 50-54.
11. Waaijer CJF, Van Bochove CA, Van Eck NJ, (2010) Journal editorials give indication of driving science issues. Nature 463: 157.
12. Waaijer CJF, Van Bochove CA, Van Eck NJ, (2011) On the map: Nature and Science editorials. Scientometrics 86(1): 99-112.
13. Börner K (2010) Atlas of science: Visualizing what we know. MIT Press.
14. Peters HPF, Van Raan AFJ, (1993) Co-word-based science maps of chemical engineering. Part I: Representations by direct multidimensional scaling. Research Policy 22(1): 23-45.
15. Rip A, Courtial JP, (1984) Co-word maps of biotechnology: An example of cognitive scientometrics. Scientometrics 6(6): 381-400.
16. Tijssen RJW, Van Raan AFJ, (1989) Mapping co-word structures: A comparison of multidimensional scaling and LEXIMAPPE. Scientometrics 15(3-4): 283-295.
17. Moed HF (2005) Citation analysis in research evaluation. Springer.
18. Van Eck NJ, Waltman L, Dekker R, Van den Berg J, (2010) A comparison of two techniques for bibliometric mapping: Multidimensional scaling and VOS. Journal of the American Society for Information Science and Technology 61(12): 2405-2416.
19. Borg I, Groenen PJF (2005) Modern multidimensional scaling (2nd ed.). Springer.
20. Van Eck NJ, Waltman L, (2010) Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics 84(2): 523-538.
21. Patsopoulos NA, Analatos AA, Ioannidis JPA, (2005) Relative citation impact of various study designs in the health sciences. JAMA: Journal of the American Medical Association 293(19): 2362-2366.
22. Mavros MN, Bardakas V, Rafailidis PI, Sardi TA, Demetriou E, et al. (2013) Comparison of number of citations to full original articles versus brief reports. Scientometrics 94(1): 203-206.
23. Falagas ME, Zarkali A, Karageorgopoulos DE, Bardakas V, Mavros MN, (2013) The impact of article length on the number of future citations: A bibliometric analysis of general medicine journals. PLoS ONE 8(2): e49476.
24. Seglen PO, (1997) Why the impact factor of journals should not be used for evaluating research. British Medical Journal 314(7079): 498-502.
25. Waltman L, Van Eck NJ, (2012) The inconsistency of the h-index. Journal of the American Society for Information Science and Technology 63(2): 406-415.
26. Neuhaus C, Daniel H-D, (2009) A new reference standard for citation analysis in chemistry and related fields based on the sections of Chemical Abstracts. Scientometrics 78(2): 219-229.
27. Smolinsky L, Lercher A, (2012) Citation rates in mathematics: A study of variation by subdiscipline. Scientometrics 91(3): 911-924.
28. Van Leeuwen TN, Calero Medina C, (2012) Redefining the field of economics: Improving field normalization for the application of bibliometric techniques in the field of economics. Research Evaluation 21(1): 61-70.
29. Opthof T, (2011) Differences in citation frequency of clinical and basic science papers in cardiovascular research. Medical and Biological Engineering and Computing 49(6): 613-621.
30. Lewison G, Paraje G, (2004) The classification of biomedical journals by research level. Scientometrics 60(2): 145-157.
31. Lewison G, Dawson G, (1998) The effect of funding on the outputs of biomedical research. Scientometrics 41(1-2): 17-27.
32. Lewison G, Devey ME, (1999) Bibliometric methods for the evaluation of arthritis research. Rheumatology 38(1): 13-20.
33. Klavans R, Boyack KW, (2010) Toward an objective, reliable and accurate method for measuring research leadership. Scientometrics 82(3): 539-553.
34. Waltman L, Van Eck NJ, (2012) A new methodology for constructing a publication-level classification system of science. Journal of the American Society for Information Science and Technology 63(12): 2378-2392.
35. Glänzel W, Schubert A, Thijs B, Debackere K, (2011) A priori vs. a posteriori normalisation of citation indicators. The case of journal ranking. Scientometrics 87(2): 415-424.
36. Leydesdorff L, Opthof T, (2010) Scopus's source normalized impact per paper (SNIP) versus a journal impact factor based on fractional counting of citations. Journal of the American Society for Information Science and Technology 61(11): 2365-2369.
37. Moed HF, (2010) Measuring contextual citation impact of scientific journals. Journal of Informetrics 4(3): 265-277.
38. Rafols I, Leydesdorff L, O'Hare A, Nightingale P, Stirling A, (2012) How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management. Research Policy 41(7): 1262-1282.
39. Waltman L, Van Eck NJ (2012) Source normalized indicators of citation impact: An overview of different approaches and an empirical comparison. Scientometrics in press.
40. Waltman L, Van Eck NJ, Van Leeuwen TN, Visser MS, (2013) Some modifications to the SNIP journal impact indicator. Journal of Informetrics 7(2): 272-285.
41. Zitt M, Small H, (2008) Modifying the journal impact factor by fractional citation weighting: The audience factor. Journal of the American Society for Information Science and Technology 59(11): 1856-1860.