Towards objectivity in research evaluation using bibliometric indicators - A protocol for incorporating complexity

Basic and Applied Ecology

Volumn 10, Issue 5, 2009, Pages 393-400

  Retzer, Vroni ^a   Jurasinski, Gerald ^b  

^a UNIVERSITY OF BAYREUTH   (Germany)

^b UNIVERSITY OF ROSTOCK   (Germany)

Author keywords

Authorship; Citation analysis; Citation index; Contributorship; Peer review; Publication bias

Indexed keywords

EID: 67650692738     PISSN: 14391791     EISSN: 16180089     Source Type: Journal    
DOI: 10.1016/j.baae.2008.09.001     Document Type: Editorial

References (62)

1. Batista P.D., Campiteli M.G., Kinouchi O., and Martinez A.S. Is it possible to compare researchers with different scientific interests?. Scientometrics 68 1 (2006) 179-189
2. Bloch S., and Walter G. The impact factor: Time for change. Australian and New Zealand Journal of Psychiatry 35 5 (2001) 563-568
3. Bonnet X., Shine R., and Lourdais O. Taxonomic chauvinism. Trends in Ecology and Evolution 17 1 (2002) 1-3
4. Brice J., and Bligh J. Author misconduct: Not just the editors responsibility. Medical Education 39 1 (2005) 83-89
5. Budden A.E., Tregenza T., Aarssen L.W., Koricheva J., Leimu R., and Lortie C.J. Double-blind review favours increased representation of female authors. Trends in Ecology and Evolution 23 1 (2008) 4-6
6. Cartwright V.A., and McGhee C.N.J. Ophthalmology and vision science research - Part 1: Understanding and using journal impact factors and citation indices. Journal of Cataract and Refractive Surgery 31 10 (2005) 1999-2007
7. DFG. (1998). Recommendations of the commission on professional self-regulation in science. 〈http://www.dfg.de/antragstellung/gwp/〉, last access: 27.8.2007.
8. Drenth J.P.H. Multiple authorship: The contribution of senior authors. Journal of the American Medical Association 280 3 (1998) 219-221
9. Eastwood S., Derish P., Leash E., and Ordway S. Ethical issues in biomedical research: Perceptions and practices of postdoctoral research fellows responding to a survey. Science and Engineering Ethics 2 1 (1996) 89-114
10. Egghe L. Theory and practise of the g-index. Scientometrics 69 1 (2006) 131-152
11. Errami M., and Garner H. A tale of two citations. Nature 451 7177 (2008) 397-399
12. Flanagin A., Carey L.A., Fontanarosa P.B., Phillips S.G., Pace B.P., Lundberg G.D., et al. Prevalence of articles with honorary authors and ghost authors in peer-reviewed medical journals. Journal of the American Medical Association 280 3 (1998) 222-224
13. Frey, B. S. (2006). Evaluitis - eine neue Krankheit. Working Paper Series 293. Institute for Empirical Research in Economics, University Zürich.
14. Fuyuno I., and Cyranoski D. Cash for papers: Putting a premium on publication. Nature 441 7095 (2006) 792
15. Garfield E. Citation indexes for science - new dimension in documentation through association of ideas. Science 122 3159 (1955) 108-111
16. Garfield E. The history and meaning of the journal impact factor. Journal of the American Medical Association 295 1 (2006) 90-93
17. Glänzel W. Coauthorship patterns and trends in the sciences (1980-1998): A bibliometric study with implications for database indexing and search strategies. Library Trends 50 3 (2002) 461-473
18. Golder W. Who controls the controllers? Ten statements on the so-called impact factor. Onkologie 23 1 (2000) 73-75
19. Gowrishankar J., and Divakar P. Sprucing up one's impact factor. Nature 401 6751 (1999) 321-322
20. Ha T.C., Tan S.B., and Soo K.C. The journal impact factor: Too much of an impact?. Annals Academy of Medicine Singapore 35 12 (2006) 911-916
21. Hilmer C.E., and Hilmer M.J. How do journal quality, co-authorship, and author order affect agricultural economists' salaries?. American Journal of Agricultural Economics 87 2 (2005) 509-523
22. Hirsch J.E. An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences of the United States of America 102 46 (2005) 16569-16572
23. Hojat M., Gonnella J.S., and Caelleigh A.S. Impartial judgment by the "gatekeepers" of science: Fallibility and accountability in the peer review process. Advances in Health Sciences Education 8 1 (2003) 75-96
24. Hueston W.J., and Mainous A.G. Authors vs. contributors: Accuracy, accountability, and responsibility. Journal of the American Medical Association 279 5 (1998) 356
25. Hunt R. Trying an authorship index. Nature 352 6332 (1991) 187
26. Huth E.J. Irresponsible authorship and wasteful publication. Annals of Internal Medicine 104 2 (1986) 257-259
27. Jones S.R.G., and Riddell W.C. The measurement of unemployment: An empirical approach. Econometrica 67 1 (1999) 147-161
28. Kaltenborn K.F., and Kuhn K. The journal impact factor as a parameter for the evaluation of researchers and research. Medizinische Klinik 98 3 (2003) 153-169
29. Klein C.J., and Moser-Veillon P.B. Authorship: Can you claim a byline?. Journal of the American Dietetic Association 99 1 (1999) 77-79
30. Koricheva J. Non-significant results in ecology: A burden or a blessing in disguise?. Oikos 102 2 (2003) 397-401
31. Kostoff R.N. The use and misuse of citation analysis in research evaluation - Comments on theories of citation?. Scientometrics 43 1 (1998) 27-43
32. Krauss J. Journal self-citation rates in ecological sciences. Scientometrics 73 1 (2007) 79-83
33. Kretschmer H. Author productivity and geodesic distance in bibliographic co-authorship networks, and visibility on the Web. Scientometrics 60 3 (2004) 409-420
34. Kuhn T.S. Die struktur wissenschaftlicher revolutionen (1976), Suhrkamp, Frankfurt am Main
35. Kurmis A.P. Current concepts review - understanding the limitations of the journal impact factor. Journal of Bone and Joint Surgery - American 85A 12 (2003) 2449-2454
36. Laurance W.F. Second thoughts on who goes where in author lists. Nature 442 7098 (2006) 26
37. Lawrence P.A. The politics of publication - authors, reviewers and editors must act to protect the quality of research. Nature 422 6929 (2003) 259-261
38. Leash E. Is it time for a new approach to authorship?. Journal of Dental Research 76 3 (1997) 724-727
39. Leimu R., and Koricheva J. What determines the citation frequency of ecological papers?. Trends in Ecology and Evolution 20 1 (2005) 28-32
40. MacRoberts M.H., and MacRoberts B.R. Problems of citation analysis. Scientometrics 36 3 (1996) 435-444
41. Manten A.A. Multiple authorship in animal - science. Applied Animal Ethology 3 4 (1977) 299-304
42. Moulopoulos S.D., Sideris D.A., and Georgilis K.A. For debate individual contributions to multiauthor papers. British Medical Journal (Clinical Research Ed.) 287 6405 (1983) 1608-1610
43. Peters D.P., and Ceci S.J. Peer-review practices of psychological journals - the fate of accepted, published articles, submitted again. Behavioral and Brain Sciences 5 2 (1982) 187-195
44. Phelan T.J. A compendium of issues for citation analysis. Scientometrics 45 1 (1999) 117-136
45. Rennie D., Flanagin A., and Yank V. The contributions of authors. Journal of the American Medical Association 284 1 (2000) 89-91
46. Rennie D., Yank V., and Emanuel L. When authorship fails. A proposal to make contributors accountable. Journal of the American Medical Association 278 7 (1997) 579-585
47. Schoonbaert D., and Roelants G. Citation analysis for measuring the value of scientific publications: Quality assessment tool or comedy of errors?. Tropical Medicine and International Health 1 6 (1996) 739-752
48. Seglen P.O. Citations and journal impact factors: Questionable indicators of research quality. Allergy 52 11 (1997) 1050-1056
49. Seglen P.O. Citation rates and journal impact factors are not suitable for evaluation of research. Acta Orthopaedica Scandinavica 69 13 (1998) 224-229
50. Shapiro D.W., Wenger N.S., and Shapiro M.F. The contributions of authors to multiauthored biomedical research papers. Journal of the American Medical Association 271 6 (1994) 438-442
51. Todd P.A., Yeo D.C.J., Li D.Q., and Ladle R.J. Citing practices in ecology: Can we believe our own words?. Oikos 116 9 (2007) 1599-1601
52. Tregenza T. Darwin a better name than Wallace?. Nature 385 6616 (1997) 480
53. Trimble V. Patterns in citations of papers by American astronomers. Quarterly Journal of the Royal Astronomical Society 34 2 (1993) 235-250
54. Tscharntke T., Hochberg M.E., Rand T.A., Resh V.H., and Krauss J. Author sequence and credit for contributions in multiauthored publications. Plos Biology 5 1 (2007) 13-14
55. Van Raan A.F.J. Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods. Scientometrics 62 1 (2005) 133-143
56. Verhagen J.V., Collins S.C., and Scott T.R. QUAD system offers fair shares to all authors - Showing who did what could solve the problem of authorship abuse and disputes. Nature 426 6967 (2003) 602
57. Wallin J.A. Bibliometric methods: Pitfalls and possibilities. Basic and Clinical Pharmacology and Toxicology 97 5 (2005) 261-275
58. Weltzin J.F., Belote R.T., Williams L.T., Keller J.K., and Engel E.C. Authorship in ecology: Attribution, accountability, and responsibility. Frontiers in Ecology and the Environment 4 8 (2006) 435-441
59. White H.D., Wellman B., and Nazer N. Does citation reflect social structure? Longitudinal evidence from the "Globenet" interdisciplinary research group. Journal of the American Society for Information Science and Technology 55 2 (2004) 111-126
60. Wong B.B.M., and Kokko H. Is science as global as we think?. Trends in Ecology and Evolution 20 9 (2005) 475-476
61. Wooding S., Wilcox-Jay K., Lewison G., and Grant J. Co-author inclusion: A novel recursive algorithmic method for dealing with homonyms in bibliometric analysis. Scientometrics 66 1 (2005) 11-21
62. Zuckerman H.A. Patterns of name ordering among authors of scientific papers: A study of social symbolism and its ambiguity. The American Journal of Sociology 74 3 (1968) 276-291