An Integrated Impact Indicator: A new definition of 'Impact' with policy relevance

Research Evaluation

Volumn 21, Issue 3, 2012, Pages 183-188

  Wagner, Caroline S ^a   Leydesdorff, Loet ^b  

^a OHIO STATE UNIVERSITY   (United States)

^b Amsterdam School of Communication Research (ASCoR)   (Netherlands)

Author keywords

citation; impact; indicator; normalization; percentile; statistics

Indexed keywords

EID: 84866994032     PISSN: 09582029     EISSN: 14715449     Source Type: Journal    
DOI: 10.1093/reseval/rvs012     Document Type: Article

References (30)

1. Bensman, S. J. (2007) 'Garfield and the Impact Factor', Annual Review of Information Science and Technology, 41/1: 93-155.
2. Bornmann, L. and Daniel, H. D. (2008) 'What do Citation Counts Measure? A Review of Studies on Citing Behavior', Journal of Documentation, 64/1: 45-80.
3. Bornmann, L. and Mutz, R. (2011) 'Further Steps Towards an Ideal Method of Measuring Citation Performance: The Avoidance of Citation (Ratio) Averages in Fieldnormalization', Journal of Informetrics, 5/1: 228-30.
4. Bornmann, L., de Moya-Anegó n, F. and Leydesdorff, L. (2012) 'The New Excellence Indicator in the World Report of the SCImago Institutions Rankings 2011', Journal of Informetrics, 6/3: 333-5.
5. Boyack, K. W. and Klavans, R. (2011) 'Multiple Dimensions of Journal Specifity: Why Journals Can't be Assigned to Disciplines'. In: Noyons, E., Ngulube, P. and Leta, J. (eds) The 13th Conference of the International Society for Scientometrics and Informetrics, Vol. I, pp. 123-33. Durban, South Africa: ISSI, Leiden University and the University of Zululand.
6. Donovan, C. (2011) 'State of the Art in Assessing Research Impact: Introduction to a Special Issue', Research Evaluation, 20/3: 175-9.
7. Garfield, E. (1972) 'Citation Analysis as a Tool in Journal Evaluation', Science, 178/4060: 471-9.
8. -. (1979) 'Is Citation Analysis a Legitimate Evaluation Tool?', Scientometrics, 1/4: 359-375.
9. Gingras, Y. and Lariviè re, V. (2011) 'There are Neither "King" Nor "Crown" in Scientometrics: Comments on a Supposed "Alternative" Method of Normalization', Journal of Informetrics, 5/1: 226-7.
10. Hicks, D. (2012) 'Performance-based University Research Funding Systems', Research Policy, 41/2: 251-61.
11. Leydesdorff, L. (2006) 'Can Scientific Journals be Classified in Terms of Aggregated Journal-Journal Citation Relations using the Journal Citation Reports?', Journal of the American Society for Information Science & Technology, 57/5: 601-13.
12. -. (2009) 'How are New Citation-Based Journal Indicators Adding to the Bibliometric Toolbox?', Journal of the American Society for Information Science and Technology, 60/7: 1327-36.
13. Leydesdorff, L. and Bornmann, L. (2011) 'Integrated Impact Indicators (I3) Compared with Impact Factors (IFs): An Alternative Design with Policy Implications', Journal of the American Society for Information Science and Technology, 62/11: 2133-46.
14. -. (2012) 'Testing Differences Statistically with the Leiden Ranking', Scientometrics,http://arxiv.org/abs/1112.4037 accessed 1 June 2012.
15. Leydesdorff, L., Bornmann, L., Mutz, R. and Opthof, T. (2011) 'Turning the Tables in Citation Analysis One More Time: Principles for Comparing Sets of Documents', Journal of the American Society for Information Science and Technology, 62/7: 1370-81.
16. Lundberg, J. (2007) 'Lifting the Crown-Citation z-score', Journal of informetrics, 1/2: 145-54.
17. Merton, R. K. (1968) 'The Matthew Effect in Science', Science, 159/3810: 56-63.
18. National Science Board. (2012) Science and Engineering Indicators. Washington DC: National Science Foundation, http://www.nsf.gov/statistics/ seind12/accessed 1 June 2012.
19. Opthof, T. and Leydesdorff, L. (2010) 'Caveats for the Journal and Field Normalizations in the CWTS ("Leiden") Evaluations of Research Performance', Journal of Informetrics, 4/3: 423-30.
20. Pudovkin, A. I. and Garfield, E. (2002) 'Algorithmic Procedure for Finding Semantically Related Journals', Journal of the American Society for Information Science and Technology, 53/13: 1113-9. (Pubitemid 35359180)
21. Rafols, I. and Leydesdorff, L. (2009) 'Content-based and Algorithmic Classifications of Journals: Perspectives on the Dynamics of Scientific Communication and Indexer Effects', Journal of the American Society for Information Science and Technology, 60/9: 1823-35.
22. Rousseau, R. (2012) 'Basic Properties of Both Percentile Rank Scores and the I3 Indicator', Journal of the American Society for Information Science and Technology, 63/2: 416-20.
23. Schubert, A. and Braun, T. (1986) 'Relative Indicators and Relational Charts for Comparative Assessment of Publication Output and Citation Impact', Scientometrics, 9/5: 281-91.
24. Seglen, P. O. (1992) 'The Skewness of Science', Journal of the American Society for Information Science, 43/9: 628-38.
25. -. (1997) 'Why the Impact Factor of Journals Should Not be Used for Evaluating Research', British Medical Journal, 314: 498-502. (Pubitemid 27081238)
26. Sher, I. H. and Garfield, E. (1965) New tools for improving and evaluating the effectiveness of research, Paper presented at the Second conference on Research Program Effectiveness, July 27-9, Washington, DC.
27. Tijssen, R. J. W., Visser, M. S. and Van Leeuwen, T. N. (2002) 'Benchmarking International Scientific Excellence: Are Highly Cited Research Papers an Appropriate Frame of Reference?', Scientometrics, 54/3: 381-97.
28. Van Raan, A. F. J. et al. (2010) The New Set of Bibliometric Indicators of CWTS, Paper presented at the 11th International Conference on Science and Technology Indicators, September 9-11, 2010, Leiden.
29. Waltman, L. et al. (2011) 'Towards a New Crown Indicator: Some Theoretical Considerations', Journal of Informetrics, 5/1: 37-47.
30. -. (2012) 'The Leiden Ranking 2011/2012: Data Collection, Indicators, and Interpretation',http://arxiv.org/abs/1202.3941accessed 1 June 2012.