Journal self-citation V: Coercive journal self-citation - Manipulations to increase impact factors may do more harm than good in the long run

Communications of the Association for Information Systems

Volumn 25, Issue 1, 2009, Pages 41-56

  Romano Jr , Nicholas C ^a  

^a OKLAHOMA STATE UNIVERSITY   (United States)

Author keywords

Abuse and misuse; Bias; Editorial coercion; Impact factor; Journal self citation; Manipulation; Scientific integrity

Indexed keywords

ABUSE AND MISUSE; BIAS; EDITORIAL COERCION; IMPACT FACTOR; JOURNAL SELF-CITATION; MANIPULATION; SCIENTIFIC INTEGRITY;

INFORMATION SYSTEMS;

HARDWARE;

EID: 73149122725     PISSN: 15293181     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (74)

1. Abassi (2004). "Editor's Choice: Let's Dump Impact Factors," British Medical Journal 329(7471), http://www.bmj.com/cgi/content/full/329/7471/0-h (accessed April 29, 2009).
2. Agrawal, A. A. (2005). "Corruption of Journal Impact Factors," Trends in Ecology and Evolution 20(4), p. 157 http://users.jyu.fi/~hemipu/1903_Puurtinen.pdf (accessed April 29, 2009).
3. Allen, E. S. (1929). "Periodicals for Mathematicians," Science 70(1825), pp. 592-594.
4. American Psychological Association (2001). "Content and Organization of a Manuscript, 5th Edition A. P. Association (Ed.) Publication Manual of the American Psychological Association, Washington DC, USA: American Psychological Association, pp. 15-17.
5. Archambault, E. and V. Lariviere (2009). "History of the Journal Impact Factor: Contingencies and Consequences," Scientometrics 79(3), pp. 635-649 http://www.ost.uqam.ca/Portals/0/docs/articles/2009/11-arch2036.pdf (accessed April 28, 2009).
6. Banks, M. A. and R. Dellavalle (2008). "Emerging Alternatives to the Impact Factor," OCLC Systems & Services: International Digital Library Perspectives 24(3), pp. 167-173 http://repositories.cdlib.org/cgi/viewcontent.cgi?article=7596&conte xt=postprints (accessed April 29, 2009).
7. Barbosa, P. R. (2007). "Can We Accurately Measure the Impact of Published Articles In Modern Internet Era?," International Journal of Cardiology 120(3), p. 410.
8. Barendse, W. (2007). "The Strike Rate Index: A New Index for Journal Quality Based on Journal Size and the H- Index of Citations," Biomedical Digital Libraries 4(3) http://www.bio-diglib.com/content/4/1/3 (accessed April 29, 2009).
9. Bartlett, T. and S. Smallwood (2004). "Four Academic Plagiarists You've Never Heard of: How Many More are Out There?,"Special Report Plagiarism: Chronicle of Higher Education 51(17), p. A8 http://chronicle.com/free/v51/i17/17a00802.htm (accessed April 29, 2009).
10. Bhandari, M., V. Montori, and E. Schemitsch (2005). "The Undue Influence of Significant P-Values on the PerceivedImportance Of Study Results," Acta Orthopaedica 76(3), pp. 291-295 http://www.ncbi.nlm.nih.gov/pubmed/16156453 (accessed April 29,2009).
11. Biglu, M. H. (2007). "The Comparison of Impact Factor and Self Citation Trend Between French and German Journal," Arquivística.net 2(2), pp. 143-156 http://www.arquivistica.net/ojs/include/getdoc.php?id=295&article=96 &mode=pdf (accessed April 29, 2009).
12. Bornmann, L., R. Mutz, and H-D Daniel (2008) Are There Better Indices for Evaluation Purposes than the H Index? A Comparison of Nine Different Variants of the H Index Using Data from Biomedicine, Journal of the American Society for Information Science 59(5), pp. 830-837 http://www3.interscience.wiley.com/cgi-bin/fulltext/117908948/PDFSTART (accessed April 29, 2009).
13. Couzin, J. and K. Unger (2006). "NEWS FOCUS: Scientific Misconduct: Cleaning Up the Paper Trail," Science 312(5770), pp. 38-43 http://www.sciencemag.org/cgi/content/full/312/5770/38 (accessed April 29, 2009).
14. Dictionary.com (2009). Cite, Dictionary.com Unabridged (v 1.1).: Random House, Inc. http://dictionary.reference.com/browse/Cite. http://dictionary.reference.com. (accessed April 20, 2009).
15. Dictionary.com (2004). Citation, The American Heritage® Dictionary of the English Language, Fourth Edition. Houghton Mifflin Company http://dictionary.reference.com/browse/citation.http://dictionary.refere nce.com. (accessed April 20, 2009).
16. Dixon, P. (2003). "The P-Value Fallacy and How to Avoid it," Canadian Journal of Experimental Psychology 57(3), pp. 189-202 http://www.psych.ualberta.ca/~pdixon/Home/Preprints/pValue.pdf (accessed April 29, 2009).
17. Falagas, M. E. and V. G. Alexiou (2007). "Editors May Inappropriately Influence Authors'Decisions Regarding Selection of References in Scientific Articles (Guest Editorial)," International Journal of Impotence Research 19(5), pp. 443-445 http://www.nature.com/ijir/journal/v19/n5/full/3901583a.html (accessed April 29, 2009).
18. Falagas, M. E. and V. G. Alexiou (2008). "The Top-Ten in Journal Impact Factor Manipulation," Archivum Immunologiae et Therapiae Experimentalis 56(4), pp. 223-226.
19. Frandsen, T. F. (2007). "Journal Self-Citations - Analysing the JIF Mechanism," Journal of Informetrics 1(1), pp. 47-58 http://www.hprints.org/docs/00/32/62/88/PDF/Journalselfcitations.pdf (accessed April 29, 2009).
20. Gallagher, E. J. and D. P. Barnaby (1998). "Evidence of Methodologic Bias in the Derivation of the Science Citation Index Impact Factor," Annals of emergency medicine 31(1), pp. 83-86.
21. Garfield, E. (1974). "Journal Citation Studies Journal Self-Citation Rates--There's a Difference," Essays of an Information Scientist 2(52), pp. 192-194 http://www.garfield.library.upenn.edu/essays/v2p192y1974-76.pdf (accessed April 29, 2009).
22. Garfield, E. (1997). "Editors are Justified in Asking Authors to Cite Equivalent References from Same Journal," British Medical Journal 314(7096), p. 1765 http://www.bmj.com/cgi/content/full/314/7096/1765/a (accessed April 29, 2009).
23. Garfield, E. (2005). "The Agony and the Ecstasy- The History and Meaning of the Journal Impact Factor," International Congress on Peer Review And Biomedical Publication Chicago IL, USA http://www.garfield.library.upenn.edu/papers/jifchicago2005.pdf (accessed April 29, 2009).
24. Garfield, E. (2006). "The History and Meaning of the Journal Impact Factor, Journal of the American Medical Association 295(1), pp. 90-93 http://jama.ama-assn.org/cgi/content/full/295/1/90 (accessed April 29, 2009).
25. Garfield, E. and I. H. Sher (1963). "New Factors in Evaluation of Scientific Literature Through Citation Indexing,"American Documentation 14(3), pp. 195-201 http://www.garfield.library.upenn.edu/essays/v6p492y1983.pdf (accessed April 29, 2009).
26. Gibaldi, J. (2003a). Chapter 5. Documentation: Preparing the List of Works Cited, 6th edition MLA Handbook for Writers of Research Papers New York NY, USA Modern Language Association of America, pp. 142-231.
27. Gibaldi, J. (2003b). Chapter 6, "Documentation: Citing Sources in the Text," 6th edition MLA Handbook for Writers of Research Papers New York NY, USA Modern Language Association of America, pp. 232-259.
28. Gregory, J. (1937). "An Evaluation of Medical Periodicals," Bulletin of the Medical Library Association 25(3), pp. 172-188 http://www.pubmedcentral.nih.gov/picrender.fcgi?artid=234080&blobtyp e=pdf (accessed April 29, 2009).
29. Gross, P. L. K. and E. M. Gross (1927). "College Libraries and Chemical Education," Science 66(1713), pp. 385-389 http://www.garfield.library.upenn.edu/papers/grossandgross_science1927.p df (accessed April 29, 2009).
30. Gowrishankar, J., P. Divakar, M. Baylis, and M. Gravenor et al., (1999). "Sprucing up One's Impact Factor," Nature 401(23), pp. 321-322 http://www.nature.com/nature/journal/v401/n6751/full/401321d0.html (accessed April 29, 2009).
31. Ha, T. C., S. B. Tan, and K. C. Soo (2006). "The Journal Impact Factor: Too Much of an Impact?," Annals of the Academy of Medicine Singapore 35(12), pp. 911-916 http://www.annals.edu.sg/PDF/35VolNo12Dec2006/V35N12p911.pdf (accessed April 29, 2009).
32. Haynes, B. (2007). "Reliance on Bibliometric Databases can Let you Down," Nature 446(7137), p. 725.
33. Hemmingsson, A., T. Mygind, A. Skjennald, and J. Edgren (2002). "Manipulation of Impact Factors by Editors of Scientific Journals, American Journal of Roentgenology 178(3), p. 767 http://www.ajronline.org/cgi/content/full/178/3/767 (accessed April 29, 2009).
34. Hirsch, J. E. (2005). "An Index to Quantify an Individual's Scientific Research Output," Proceedings of the National Academy of Sciences 102(46), pp. 16569-16572 http://www.pnas.org/content/102/46/16569.full.pdf (accessed April 29, 2009).
35. Hoekstra, R., S. Finch, H. A. Kiers, and A. Johnson (2006). "Probability as Certainty: Dichotomous Thinking and the Misuse of P Values," Psychon Bull Rev. 13(6), pp. 1033-1037.
36. Holden, G., G. Rosenberg, K. Barker, and P. Onghena (2006). "Should Decisions About Your Hiring, Reappointment, Tenure, or Promotion Use the Impact Factor Score as a Proxy Indicator of the Impact of Your Scholarship?," Medscape General Medicine 8(3), p. 21 http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1781329 (accessed April 29, 2009).
37. Hooker, R. H. (1935). "A Study of Scientific Periodicals," Review of Scientific Instruments 6(11), pp. 333-338.
38. Krauss, J. (2007). Journal Self-Citation Rates in Ecological Sciences," Scientometrics 73(1), pp. 79-89.
39. Ludwig, D. A. (2005). "Use and Misuse of P-Values in Designed and Observational Studies: Guide for Researchers and Reviewers," Aviat Space Environ Med 76(7), pp. 675-680.
40. McVeigh, M. E. (2004). "Journal Self-Citation in the Journal Citation Reports - Science Edition" (2002) A citation study from the Thomson Corporation: Institute for Scientific Information (ISI) The Thomson Corporation.
41. Merton, R. K. (1968). "The Matthew Effect in Science: The Reward and Communication Systems of Science," Science 159(3810), pp. 55-63.
42. Miller, J. B. (2002). "Impact Factors and Publishing Research (Letter to the editor)," Scientist 16(18), p. 11.
43. Monastersky, R. (2005). "The Number That's Devouring Science," The Chronicle of Higher Education 52(8), p. A12.
44. Moravcsik and Murugesan (1975). "Some Results on the Function and Quality of Citations," Social Studies of Science 5(1), pp. 86-92.
45. Opatrný, T. (2008). "Playing the System to Give Low Impact Journals More Clout," Nature 455 (7210), p.167.
46. Pasterkamp, G., J. I. Rotmans, D. V. P. De Kleijn, and C. Borst (2007) "Citation Frequency: A Biased Measure of Research Impact Significantly Influenced by the Geographical Origin of Research Articles," Scientometrics 70(1), pp. 153-165.
47. Pervan, G. P. and D. J. Klass (1992). "The Use and Misuse of Statistical Methods in Information Systems Research," R. Galliers (Ed.) Information Systems Research: Issues, Methods and Practical Guidelines Boston MA, USA Blackwell, pp. 208-229.
48. PLoS Medicine Editors (2006). "The Impact Factor Game: It is Time to Find a Better Way to Assess the Scientific Literature," PLoS Medicine 3(6), p. e291.
49. Plucker, J. A. (1997). "Debunking the Myth of the 'Highly Significant'Result: Effect Sizes in Gifted Education Research," Roeper Review 20(2), pp. 122-126.
50. Porta, M., J. L. Copete, E. Fernandez, J. Alguacil et al., (2003). "Mixing Journal, Article, and Author Citations, and Other Pitfalls in the Bibliographic Impact Factor," Cadernos de saúde pública 19(6), pp. 1847-1862.
51. Reedijk, J. and H. F. Moed (2008). "Is the Impact of Journal Impact Factors Decreasing?," Journal of Documentation (64) 2, pp. 183-192.
52. Rey-Rocha, J., M. J. Martín-Sempere, J. Martínez-Frías, and F. López-Vera (2001). "Some Misuses of Journal Impact Factor in Research Evaluation," Cortex 37(4), pp. 595-597.
53. Rousseau, R. (1999). "Temporal Differences in Self-Citation Rates of Scientific Journals," Scientometrics 44(3), pp. 521-531.
54. Schutte, H. K. and J. G. Švec (2007). "Reaction of Folia Phoniatrica et Logopaedica on the Current Trend of Impact Factor Measures (Editorial)," Folia Phoniatrica et Logopaedica 59(6), pp. 281-285 http://content.karger.com/ProdukteDB/produkte.asp?Aktion=ShowPDF&Art ikelNr=108334&Ausgabe=23379 2&ProduktNr=224177&filename=108334.pdf (accessed April 29, 2009).
55. Scully, C. and H. Lodge (2005). "Impact Factors and their Significance; Overrated or Misused?," British Dental Journal 198(7), pp. 391-393 http://www.nature.com/bdj/journal/v198/n7/pdf/4812185a.pdf (accessed April 29, 2009).
56. Seglen, P. O. (1997). "Why the Impact Factor of Journals Should not be Used for Evaluating Research," British Medical Journal 314(7079), pp. 497-502 http://www.bmj.com/cgi/content/full/314/7079/497 k.
57. Sevinc, A. (2004). "Manipulating Impact Factor: An Unethical Issue or an Editor's Choice? (Letter to the Editor)," Swiss Medical Weekly 134(27-28), p. 410.
58. Small, H. (1998). "Letter to the Editor: Citations and Consilience in Science," Scientometrics 43(1), pp. 143-148.
59. Smith, R. (1997). "Journal Accused of Manipulating Impact Factor," British Medical Journal 314(7079), p. 461 http://www.bmj.com/cgi/content/full/314/7079/461/d (accessed April 29, 2009).
60. Smith, R. (2008). "Beware the Tyranny of Impact Factors," Journal of Bone and Joint Surgery - British Volume (90-B), pp. 125-126 http://www.jbjs.org.uk/cgi/reprint/90-B/2/125 (accessed April 29, 2009).
61. Spiegel-Rüsing (1977). "Science studies - Bibliometric and Content-Analysis," Social Studies of Science 7(1), pp. 97-113.
62. Swales, J. (1990). Chapter 7. Research articles in English Genre Analysis: English in Academic and Research Settings Cambridge UK, Cambridge University Press pp. 110-176.
63. Takahashi, K., T. C. Aw, and D. Koh (1999). "An Alternative to Journal-Based Impact Factors (Letter)," Occupational Medicine 49(1), pp. 57-58.
64. Testa, J. (2008). "Playing the System Puts Self-Citation's Impact Under Review," Nature 455(7214), p.729.
65. Teufel, S., A. Siddharthan, and D. Tidhar. (2006). "An Annotation Scheme for Citation Function," 7th SIGdial Workshop on Discourse and Dialogue Sydney Australia, 2006 pp. 80-87 http://acl.ldc.upenn.edu/W/W06/W06-1312.pdf (accessed April 29, 2009).
66. Thompson, B. (1999). "Improving Research Clarity and Usefulness With Effect Size Indices as Supplements to Statistical Significance Tests," Exceptional Children 65(3), p. 329.
67. Tsay, M. (2006). "Journal Self-Citation Study for Semiconductor Literature: Synchronous and Diachronous Approach," Information Processing and Management 42(6), pp. 1567-1577.
68. Weingart, P. (2005). "Impact of Bibliometrics Upon the Science System: Inadvertent Consequences?," Scientometrics 62(1), pp. 117-131.
69. Westbrook, J. H. (1960). "Identifying Significant Research," Science 132(3435), pp. 1229-1234.
70. White, H. D. (2004). "Reward, Persuasion, and the Sokal Hoax: A Study in Citation Identities," Scientometrics 60(1), pp. 93-120.
71. Wilcox, A. J. (2008). "Rise and Fall of the Thomson Impact Factor," Epidemiology 19(3), pp. 373-374 http://pdfs.journals.lww.com/epidem/2008/05000/7.pdf (accessed April 29, 2009).
72. Yu, G. and W. Liang (2007). "The Self-Cited Rate of Scientific Journals and the Manipulation of their Impact Factors," Scientometrics 73(3), pp. 321-330.
73. Ziman, J. M. (1968). Public Knowledge: An Essay Concerning the Social Dimensions of Science. Cambridge UK, Cambridge University Press.
74. Zwahlen, M., C. Junker, and M. Egger (2004). "The Journal Impact Factor in the Evaluation of Research Quality: Villain, Scapegoat or Innocent Bystander?," Sozialund Praventivmedizin 49(1), pp. 19-22. http://www.springerlink.com/content/630yetdhyhx28xlv/fulltext.pdf (accessed April 29, 2009).