How are excellent (highly cited) papers defined in bibliometrics? A quantitative analysis of the literature

Research Evaluation

Volumn 23, Issue 2, 2014, Pages 166-173

  Bornmann, Lutz ^a  

^a MAX PLANCK INSTITUTE   (Germany)

Author keywords

excellent papers; highly cited papers; most frequently cited papers; top cited papers

Indexed keywords

EID: 84898858908     PISSN: 09582029     EISSN: 14715449     Source Type: Journal    
DOI: 10.1093/reseval/rvu002     Document Type: Article

References (30)

1. Adams, J., Pendlebury, D. and Stembridge, B. (2013) Building Bricks. Exploring the Global Research and Innovation Impact of Brazil, Russia, India, China and South Korea, Philadelphia, PA, USA: Thomson Reuters.
2. Agresti, A. (2002) Categorical Data Analysis. Hoboken, NJ, USA: John Wiley & Sons, Inc.
3. Aksnes, D. W. (2003) 'Characteristics of highly cited papers ', Research Evaluation, 12: 159-70.
4. Albarran, P., Ortufno, I. and Ruiz-Castillo, J. (2011) ' Averagebased versus high-and low-impact indicators for the evaluation of scientific distributions' , Research Evaluation, 20: 325-39.
5. Bar-Ilan, J. (2 008) ' Informetrics at the beginning of the 21st century-A review' , Journal of Informetrics, 2: 1-52.
6. Bornmann, L. (2013) ' How to analyse percentile citation impact data meaningfully in bibliometrics: The statistical analysis of distributions, percentile rank classes and top-cited papers ' , Journal of the American Society for Information Science and Technology, 64: 587-95.
7. Bornmann, L., De Moya Anego? n, F. and Leydesdorff, L. (2010) 'Do scientific advancements lean on the shoulders of giants A bibliometric investigation of the Ortega hypothesis', PLoS One, 5: E11344.
8. Bornmann L. De Moya Anego?n F Leydesdorff L. (2012) 'The new excellence indicator in the world report of the SCImago institutions rankings 2011' , Journal of Informetrics, 6: 333-5.
9. Bornmann, L. and Leydesdorff, L. (2013) ' The validation of (advanced) bibliometric indicators through peer assessments: A comparative study using data from InCites and F1000' , Journal of Informetrics, 7: 286-91.
10. Bornmann, L., Leydesdorff, L. and Wang, J. ( 2013) ' Which percentile-based approach should be preferred for calculating normalized citation impact values An empirical comparison of five approaches including a newly developed citation-rank approach (P100) ', Journal of Informetrics, 7: 933-44.
11. Bornmann, L. and Marx, W. (2013) ' How good is research really Measuring the citation impact of publications with percentiles increases correct assessments and fair comparisons' , EMBO Reports, 14: 226-30.
12. Bornmann, L., Stefaner, M., De Moya Anego? n, F. and Mutz, R. (2014) ' Ranking and mapping of universities and researchfocused institutions worldwide based on highly-cited papers: A visualization of results from multi-level models ' , Online Information Review, 38: 43-58.
13. Conroy, R. M. (2002) ' Choosing an appropriate real-life measure of effect size: The case of a continuous predictor and a binary outcome' , The Stata Journal, 2: 290-5.
14. Crame? r, H. (1980) Mathematical Methods of Statistics. Princeton, NJ, USA: Princeton University Press.
15. Danell, R. (2011) 'Can the quality of scientific work be predicted using information on the author's track record' , Journal of the American Society for Information Science and Technology, 62: 50-60.
16. Gla?nzel, W. (2007) ' Characteristic scores and scales-A bibliometric analysis of subject characteristics based on long-term citation observation ', Journal of Informetrics, 1: 92-102.
17. Gla?nzel, W. and Schubert, A. (1992) ' Some facts and figures on highly cited papers in the sciences, 1981-5' , Scientometrics, 25: 373-80.
18. Jann B. 2005 Tabulation of multiple response The Stata Journal 5 92-122.
19. Kline, R. B. (2004) Beyond Significance Testing: Reforming Data Analysis Methods in Behavioral Research, Washington, DC, USA: American Psychological Association.
20. Kosmulski, M. (2013) 'Family-tree of bibliometric indices ', Journal of Informetrics, 7: 313-17.
21. Kostoff, R. N., Bar th, R. B. and Lau, C. G. Y. (2008) ' Relation of seminal nanotechnology document production to total nanotechnology document production-South Korea' , Scientometrics, 76: 43-67.
22. Lamont, M. (2012) 'Toward a c omparative sociology of valuation and evaluation' , Annual Review of Sociology, 38: 201-21.
23. Levitt, J. M. and Thelwall, M. (2010) ' Does the higher citation of collaborative research differ from region to region A case study of Economics' , Scientometrics, 85: 171-83.
24. Leydesdorff, L. et al. (2011) 'Turning the tables in citation analysis one mo re time: Principles for comparing sets of documents' , Journal of the American Society for Information Science and Technology, 62: 1370-81.
25. Small, H. (2004) 'Why authors think their papers are highly cited ', Sc ientometrics, 60: 305-16.
26. Van Leeuwen, T. N. et al. (2003) ' Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence' , Scientometrics, 57: 257-80.
27. Vinkler, P. (2012) ' The case of scientometricians with the "absolute relative" impact indicator' , Journal of Informetrics, 6: 254-64.
28. Waltman, L. et al. (2012) 'The Leiden Ranking 2011/2012: Da ta collection, indicators, and interpretation' , Journal of the American Society for Information Science and Technology, 63: 2419-32.
29. Wang, J. (2013) 'Citation time window choice for research impact evaluation ', Sc ientometrics, 94: 851-72.
30. Zhu, X. et al. (2004) ' Highly cited research papers and the evaluation of a research university: A case study: Peking University 1974-2003' , Scientometrics, 60: 237-47.