Skewed citation distributions and bias factors: Solutions to two core problems with the journal impact factor

Journal of Informetrics

Volumn 6, Issue 2, 2012, Pages 169-176

  Mutz, Rüdiger ^a   Daniel, Hans Dieter ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Journal impact factor; McCall's area transformation; Normalization; Rubin Causal Model

Indexed keywords

EID: 84857025038     PISSN: 17511577     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.joi.2011.12.006     Document Type: Article

References (35)

1. Anseel F., Duyck W., De Baene W., Brysbaert M. Journal impact factors and self-citations: Implications for psychology journals. American Psychologist 2004, 59:49-51.
2. Beirlant J., Glänzel W., Carbonez A., Leemans H. Scoring research output using statistical quantile plotting. Journal of Infometrics 2007, 1:185-192.
3. Boor M. The citation impact factor: Another dubious index of journal quality. American Psychologist 1982, 37(8):975-977.
4. Bornmann L., Mutz R. Further steps towards an ideal method of measuring citation performance: The avoidance of citation (ratio) averages in field-normalization. Journal of Infometrics 2011, 5(1):228-230.
5. Bornmann L., Mutz R., Marx W., Schier H., Daniel H.-D. A multilevel modelling approach to investigating the predictive validity of editorial decisions: Do the editors of a high-profile journal select manuscripts that are highly cited after publication?. Journal of the Royal Statistical Society-Series A: Statistics in Society 2011, 174(Part 4):857-879.
6. Bornmann L., Mutz R., Neuhaus C., Daniel H.-D. Citation counts for research evaluation: Standards of good practice for analyzing bibliometric data and presenting and interpreting results. Ethics in Science and Environmental Politics 2008, 8:93-102.
7. Braun T., Glänzel W., Schubert A. Some data on the distribution of journal publication types in the Science Citation Index Database. Scientometrics 1989, 15:325-330.
8. Cochran W.G. The effectiveness of adjustment by subclassification in removing bias in observational studies. Biometrics 1968, 24(2):295-313.
9. Dekking F.M., Kraaikamp C., Lopuhaö H.P., Meester L.E. A modern introduction to probability and statistics: Understanding why and how 2005, Springer, New York, NY.
10. Egloff B. Some remarks on impact factor. Psychologische Rundschau 2006, 57(2):116-118.
11. Garfield E. Citation indexes to science: A new dimension in documentation through association of ideas. Science 1955, 122:108-111.
12. Garfield E. Journal impact factor: A brief review. Journal of the Canadian Medical Association 1999, 161(8):979-980.
13. Garfield E. The history and meaning of the Journal Impact Factor. Journal of the American Medical Association 2006, 295(1):90-93.
14. Glänzel W. The application of characteristic scores and scales to the evaluation and ranking of scientific journals. Journal of Information Science 2011, 37(1):40-48.
15. Glänzel W., Moed H. Journal impact measures in bibliometric research. Scientometrics 2002, 53(2):171-193.
16. Glänzel W., Schubert A., Thijs B., Debackere K. A priori vs. a posteriori normalisation of citation indicators. The case of journal ranking. Scientometrics 2011, 87:415-424.
17. Guo S., Fraser M.W. Propensity score analysis-Statistical methods and applications 2010, Sage, London, UK.
18. Holland P.W. Statistics and causal inference. Journal of the American Statistical Association 1986, 81:945-970.
19. Huber P.J. Robust statistics 1981, Wiley-Interscience, New York.
20. Krus D.J., Kennedy P.H. Lost: McCall's T scores: Why?. Educational and Psychological Measurement 1977, 37:257-261.
21. Leydesdorff L., Bornmann L. How fractional counting of citations affects the impact factor: Normalization in terms of differences in citation potentials among fields of science. Journal of the American Society for Information Science and Technology 2011, 62(2):217-229.
22. Leydesdorff L., Bornmann L. Integrated indicators compared with impact factors: An alternative research design with policy implications. Journal of the American Society for Information Science and Technology 2011, 62(11):2133-2146.
23. Leydesdorff L., Opthof T. Scopus's source normalized impact per paper (SNIP) versus a journal impact factor based on fractional counting of citations. Journal of the American Society for Information Science and Technology 2010, 61(11):2365-2369.
24. McCall W.A. How to measure in education 1922, Macmillan, New York, NY.
25. Moed H.F. Measuring contextual citation impact of scientific journals. Journal of Informetrics 2010, 4(3):265-277.
26. Moed H.F., van Leeuwen T.N. Improving the accuracy of the Institute for Scientific Information's Journal Impact Factor. Journal of the American Society of Information Science 1995, 46:461-467.
27. Moed H.F., Van Leeuwen T.N., Reeduk J. Towards appropriate indicators of journal impact. Scientometrics 1999, 46(3):575-589.
28. Neuhaus C., Marx W., Daniel H.-D. The publication and citation impact profile of Angewandte Chemie and the Journal of the American Chemical Society based on the sections of Chemical Abstracts: A case study on the limitations of the Journal Impact Factor. Journal of the American Society for Information Science and Technology 2009, 60(1):176-183.
29. Rotton J., Levitt M.J., Foos P. Citation impact, rejection rates, and journal values. American Psychologist 1993, 48:911-912.
30. Rubin D.B. Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology 1974, 66:688-701.
31. Rubin D.B. Assignment to treatment group on the basis of a covariate. Journal of Educational Statistics 1977, 2(1):1-26.
32. Rubin D.B. Teaching statistical inference for causal effects in experiments and observational studies. Journal of Educational and Behavioral Statistics 2004, 29(3):343-367.
33. Rubin D.B. Matched sampling for causal effects 2006, Cambridge University Press, Cambridge, UK.
34. Schweizer K. Judging a journal by the impact factor: Is it appropriate and fair for assessment of journals?. European Journal of Psychological Assessment 2010, 26(4):235-237.
35. Todorov R., Glänzel W. Journal citation measures: A concise review. Journal of Information Science 1988, 14:47-56.