A review of theory and practice in scientometrics

European Journal of Operational Research

Volumn 246, Issue 1, 2015, Pages 1-19

  Mingers, John ^a   Leydesdorff, Loet ^b  

^a UNIVERSITY OF KENT   (United Kingdom)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Altmetrics; Citations; H index; Impact factor; Normalisation

Indexed keywords

OPERATIONS RESEARCH;

ALTMETRICS; CITATIONS; H INDICES; IMPACT FACTOR; NORMALISATION;

MATHEMATICAL MODELS;

EID: 84930091862     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2015.04.002     Document Type: Review

References (249)

1. Aad G., Abajyan T., Abbott B., Abdallah J., Abdel Khalek S. et al. Observation of a new particle in the search for the Standard Model Higgs boson with the ATLAS detector at the LHC Physics Letters B 716 1 2012 1 29 10.1016/j.physletb.2012.08.020
2. Abramo G., D'Angelo C. Evaluating research: from informed peer review to bibliometric Scientometrics 87 3 2011 499 514
3. Abramo G., D'Angelo C., Di Costa F. National research assessment exercises: A comparison of peer review and bibliometric rankings Scientometrics 89 2011 929 941
4. Adriaanse L., Rensleigh C. Web of Science, Scopus and Google Scholar The Electronic Library 31 6 2013 727 744 10.1108/EL-12-2011-0174
5. Ahlgren P., Jarneving B., Rousseau R. Requirements for a cocitation similarity measure, with special reference to Pearson's correlation coefficient Journal of the American Society for Information Science and Technology 54 6 2003 550 560 10.1002/asi.10242
6. Aksnes D.W., Schneider J.W., Gunnarsson M. Ranking national research systems by citation indicators. A comparative analysis using whole and fractionalised counting methods Journal of Informetrics 6 1 2012 36 43
7. Alonso S., Cabrerizo F.J., Herrera-Viedma E., Herrera F. h-Index: A review focused in its variants, computation and standardization for different scientific fields Journal of Informetrics 3 4 2009 273 289 10.1016/j.joi.2009.04.001
8. Amara N., Landry R. Counting citations in the field of business and management: why use Google Scholar rather than the Web of Science Scientometrics 93 3 2012 553 581 10.1007/s11192-012-0729-2
9. Archambault É., Vignola-Gagné É., Côté G., Larivière V., Gingras Y. Benchmarking scientific output in the social sciences and humanities: The limits of existing databases Scientometrics 68 3 2006 329 342
10. Aziz N., Rozing M. Profit (p)-index: The degree to which authors profit from co-authors PLoS One 8 4 2013 e59814
11. Bar-Ilan J. Informetrics at the beginning of the 21st century - A review Journal of Informetrics 2 1 2008 1 52
12. Batista P., Campiteli M., Kinouchi O., Martinez A. Is it possible to compare researchers with different scientific interests? Scientometrics 68 1 2006 179 189
13. Baumgartner S., Leydesdorff L. Group-based trajectory modeling (GBTM) of citations in scholarly literature: Dynamic qualities of "transient" and "sticky» knowledge claims Journal of the American Society for Information Science and Technology 65 4 2014 797 811
14. Bergstrom C. Measuring the value and prestige of scholarly journals College & Research Libraries News 68 5 2007 3146
15. Bhaskar R. A realist theory of science 1978 Harvester Hemel Hempstead
16. Björneborn L., Ingwersen P. Toward a basic framework for webometrics Journal of the American Society for Information Science and Technology 55 14 2004 1216 1227 10.1002/asi.20077
17. Blondel V., Guillaume J.-L., Lambiotte R., Lefebvre L. Fast unfolding of communities in large networks Journal of Statistical Mechanics: Theory and Experiment 2008 10 2008 P10008
18. Bollen J., Van de Sompel H., Hagberg A., Bettencourt L., Chute R., Rodriguez M. et al. Clickstream data yields high-resolution maps of science PLoS One 4 3 2009 e4803
19. Bornman L., Daniel H.-D. Does the h-index for ranking of scientists really work? Scientometrics 65 3 2005 391 392
20. Bornmann L. Towards an ideal method of measuring research performance: Some comments to the Opthof and Leydesdorff (2010) paper Journal of Informetrics 4 3 2010 441 443
21. Bornmann L. Scientific peer review Annual Review of Information Science and Technology 45 1 2011 197 245
22. Bornmann L. Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics Journal of Informetrics 8 2014 895 903
23. Bornmann L., Daniel H.-D. What do we know about the h index? Journal of the American Society for Information Science and Technology 58 9 2007 1381 1385 10.1002/asi.20609
24. Bornmann L., Leydesdorff L. Scientometrics in a changing research landscape EMBO Reports 15 12 2014 1228 1232
25. Bornmann L., Leydesdorff L., Mutz R. The use of percentiles and percentile rank classes in the analysis of bibliometric data: Opportunities and limits Journal of Informetrics 7 1 2013 158 165 10.1016/j.joi.2012.10.001
26. Bornmann L., Leydesdorff L., Wang J. How to improve the prediction based on citation impact percentiles for years shortly after the publication date? Journal of Informetrics 8 1 2013 175 180
27. Bornmann L., Leydesdorff L., Wang J. Which percentile-based approach should be preferred for calculating normalized citation impact values? An empirical comparison of five approaches including a newly developed citation-rank approach (P100) Journal of Informetrics 7 4 2013 933 944 10.1016/j.joi.2013.09.003
28. Bornmann L., Mutz R. Further steps towards an ideal method of measuring citation performance: The avoidance of citation (ratio) averages in field-normalization Journal of Informetrics 5 1 2011 228 230
29. Bornmann L., Mutz R., Daniel H.D. Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine Journal of the American Society for Information Science and Technology 59 5 2008 830 837 10.1002/asi.20806
30. Boyack K., Klavans R., Börner K. Mapping the backbone of science Scientometrics 64 3 2005 351 374
31. Braam R., Moed H., van Raan A. Mapping of science by combined co-citation and word analysis I: Structural aspects Journal of the American Society for Information Science 42 4 1991 233 251
32. Braam R., Moed H., van Raan A. Mapping of science by combined co-citation and word analysis. II: Dynamical aspects Journal of the American Society for Information Science 42 4 1991 252 266
33. Bradford S. Sources of information on specific subjects Engineering 137 3550 1934 85 86
34. Braun T. The impact factor of scientific and scholarly journals: Its use and misuse in research evaluation 2007 Akedemiai Kiado Zrt Hungary
35. Braun T., Glänzel W., Schubert A. Scientometric indicators: A 32-country comparison of publication productivity and citation impact 1985 World Scientific Publishing Singapore
36. Braun T., Glänzel W., Schubert A. A Hirsch-type index for journals Scientometrics 69 1 2006 169 173 10.1007/s11192-006-0147-4
37. Brumback R. Worshipping false idols: The impact factor dilemma Journal of Child Neurology 23 2008 365 367
38. Burrell Q. Stochastic modelling of the first-citation distribution Scientometrics 52 1 2001 3 12
39. Burrell Q. The nth-citation distribution and obsolescence Scientometrics 53 3 2002 309 323
40. Burrell Q. Predicting future citation behaviour Journal of the American Society for Information Science 54 5 2003 372 378
41. Burrell Q. Hirsch index or Hirsch rate? Some thoughts arising from Liang's data Scientometrics 73 1 2007 19 28
42. Butler L., McAllister I. Metrics or peer review? Evaluating the 2001 UK Research Assessment Exercise in political science Political Studies Review 7 1 2009 3 17
43. Callon M., Courtial J.-P., Turner W.A., Bauin S. From translations to problematic networks: An introduction to co-word analysis Social Science Information 22 2 1983 191 235 10.1177/053901883022002003
44. Cambell, D., Archambaulte, E., & Cote, G. (2008). Benchmarking of Canadian genomics: 1996-2007. Retrieved from http://www.science-metrix.com/pdf/SM.Benchmarking-Genomics-Canada.pdf.
45. Cameron B. Trends in the usage of ISI bibliometric data: Uses, abuses and implications Libraries and the Academy 5 2005 105 125
46. Campanario J.M. Empirical study of journal impact factors obtained using the classical two-year citation window versus a five-year citation window Scientometrics 87 1 2011 189 204
47. Chapman A. Assessing research: Citation-count shortcomings The Psychologist: Bulletin of the British Psychological Society 8 8 1989 339 341
48. Colliander C. A novel approach to citation normalization: A similarity-based method for creating reference sets Journal of the Association for Information Science and Technology 66 3 2014 489 500 10.1002/asi.23193 Online
49. Costas R., Bordons M. The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level Journal of Informetrics 1 2007 193 203
50. Cozzens S. What do citations count? The rhetoric-first model Scientometrics 15 1989 437 447
51. Crane D. Invisible colleges 1972 University of Chicago Press Chicago
52. Cronin B. Metatheorizing citation Scientometrics 43 1 1998 45 55
53. Cronin B. Hyperauthorship: A postmodern perversion or evidence of a structural shift in scholarly communication practices? Journal of the American Society for Information Science and Technology 52 7 2001 558 569
54. Cuellar, M.J., Takeda, H., & Truex, D.P. (2008). The Hirsch family of bibliometric indices as an improved measure of IS academic journal impact. In AMCIS 2008 Proceedings. Paper 295. http://aisel.aisnet.org/amcis2008/295
55. Davis P.M. Eigenfactor: Does the principle of repeated improvement result in better estimates than raw citation counts? Journal of the American Society for Information Science and Technology 59 13 2008 2186 2188
56. Day R. The data - It is me! B. Cronin C. Sugimoto Beyond bibliometrics: Harnessing multidimensional indicators of scholarly impact 2014 MIT Press London 47 66
57. de Bellis N. History and evolution of (biblio)metrics B. Cronin C. Sugimoto Beyond bibliometrics: Harnessing multidimensional indicators of scholarly impact 2014 MIT Press London 23 44
58. De Moya-Anegón F., Vargas-Quesada B., Chinchilla-Rodríguez Z., Corera-Álvarez E., Munoz-Fernández F., Herrero-Solana V. Visualizing the marrow of science Journal of the American Society for Information Science and Technology 58 14 2007 2167 2179
59. de Nooy W., Mrvar A., Batgelj V. Exploratory social network analysis with Pajek 2nd ed. 2011 Cambridge University Press New York, NY
60. Delgado-López-Cózar E., Cabezas-Clavijo Á. Google Scholar Metrics: An unreliable tool for assessing scientific journals El profesional de la información 21 4 2012 419 427
61. DeMaria A., Bax J., Ben-Yehuda O., Clopton P., Feld G.K., Ginsburg G., Lima J. Highlights of the year in JACC 2007 Journal of the American College of Cardiology 51 4 2008 490 512
62. Doreian P., Fararo T. Structural equivalence in a journal network Journal of the American Society for Information Science 36 1985 28 37
63. Egghe L. A heuristic study of the first citation distribution Scientometrics 48 2000 345 359
64. Egghe L. Power laws in the information production process: Lotkaian informetrics 2005 Elsevier Amsterdam
65. Egghe L. Theory and practice of the g-index Scientometrics 69 1 2006 131 152
66. Egghe L. The Hirsch index and related impact measures Annual Review of Information Science and Technology 44 1 2010 65 114
67. Egghe L., Rousseau R. Introduction to Informetrics 1990
68. Egghe L., Rousseau R. Informetrics 87/88 1988 Elsevier Amsterdam
69. Elkana Y., Lederberg J., Merton R., Thackray A., Zuckerman H. Toward a metric of science: The advent of science indicators 1978 Wiley New York
70. Eysenbach G. Can tweets predict citations? Metrics of social impact based on twitter and correlation with traditional metrics of scientific impact Journal of Medical Internet Research 13 4 2011 e123 10.2196/jmir.2012
71. Falagas M.E., Kouranos V.D., Arencibia-Jorge R., Karageorgopoulos D.E. Comparison of SCImago journal rank indicator with journal impact factor The FASEB Journal 22 8 2008 2623 2628
72. Ferlie E., Ashburner L., Fitzgerald L., Pettigrew A.M. The new public management in action 1996 Oxford U niversity P ress Oxford
73. Fersht A. The most influential journals: Impact factor and eigenfactor Proceedings of the National Academy of Sciences of the United States of America 106 17 2009 6883 6884
74. Franceschet M. A comparison of bibliometric indicators for computer science scholars and journals on Web of Science and Google Scholar Scientometrics 83 1 2010 243 258 10.1007/s11192-009-0021-2
75. Franceschini F., Maisano D.A. Analysis of the Hirsch index's operational properties European Journal of Operational Research 203 2 2010 494 504 10.1016/j.ejor.2009.08.001
76. Furner J. The ethics of evaluative bibliometrics B. Cronin C. Sugimoto Beyond bibliometrics: Harnessing multidimensional indicators of scholarly impact 2014 MIT Press London 85 107
77. García-Pérez M.A. Accuracy and completeness of publication and citation records in the Web of Science, PsycINFO, and Google Scholar: A case study for the computation of h indices in psychology Journal of the American Society for Information Science and Technology 61 10 2010 2070 2085 10.1002/asi.21372
78. Garfield E. Citation indexes for science: A new dimension in documentation through association of ideas Science 122 3159 1955 108 111
79. Garfield E. Citation indexing: Its theory and application in science, technology and humanities 1979 Wiley New York
80. Garfield E. The impact factor and using it correctly Der Unfallchirug 48 2 1998 413
81. Garfield E., Sher I., Thorpie R. The use of citation data in writing the history of science 1964 Institute for Scientific Information Philadelphia
82. Garfield E., Sher I.H. New factors in the evaluation of scientific literature through citation indexing American Documentation 14 3 1963 195 201 10.1002/asi.5090140304
83. Gingras Y. Criteria for evaluating indicators B. Cronin C. Sugimoto Beyond bibliometrics: Harnessing multidimensional indicators of scholarly impact 2014 MIT Press London 110 125
84. Gingras Y., Larivière V. There are neither "king" nor "crown" in scientometrics: Comments on a supposed "alternative" method of normalization Journal of Informetrics 5 1 2011 226 227 10.1016/j.joi.2010.10.005
85. Glänzel W. On the h-index - A mathematical approach to a new measure of publication activity and citation impact Scientometrics 67 2 2006 315 321
86. Glänzel W., Schoepflin U. A bibliometric study of ageing and reception processes of scientific literature Journal of Information Science 21 1995 37 53
87. Glänzel W., Schubert A. Price distribution: An exact formulation of Price's "square root law" Scientometrics 7 3-6 1985 211 219
88. Glänzel W., Schubert A., Thijs B., Debackere K. A priori vs. a posteriori normalisation of citation indicators. The case of journal ranking Scientometrics 87 2 2011 415 424
89. González-Pereira B., Guerrero-Bote V.P., Moya-Anegón F. A new approach to the metric of journals' scientific prestige: The SJR indicator Journal of Informetrics 4 3 2010 379 391 10.1016/j.joi.2010.03.002
90. Guerrero-Bote V.P., Moya-Anegón F. A further step forward in measuring journals' scientific prestige: The SJR2 indicator Journal of Informetrics 6 4 2012 674 688 10.1016/j.joi.2012.07.001
91. Guns R., Rousseau D. Real and rational variants of the h-index and g-index Journal of Informatrics 3 2009 64 71
92. Harzing, A.-W. (2007). Publish or perish, from http://www.harzing.com/pop.htm.
93. Harzing A.-W., Alakangas S., Adams D. hIa: An individual annual h-index to accommodate disciplinary and career length differences Scientometrics 99 3 2014 811 821 10.1007/s11192-013-1208-0
94. Harzing A.-W., van der Wal R. Google Scholar as a new source for citation analysis Ethics in Science and Environmental Politics 8 2008 61 73
95. Harzing A.-W., Van der Wal R. A Google Scholar h-index for journals: An alternative metric to measure journal impact in economics and business? Journal of the American Society for Information Science and Technology 60 1 2009 41 46
96. HEFCE. (2008). Counting what is measured or measuring what counts. HEFCE.
97. HEFCE Report on the pilot exercise to develop bibliometric indicators for the Research Excellence Framework 2009 HEFCE London
98. Hesse M. Revolutions and reconstructions in the philosophy of science 1980 Harvester Press London
99. Hirsch J. An index to quantify an individual's scientific research output Proceedings of the National Academy of Sciences of the United States of America 102 46 2005 16569 16572
100. Hirsch J. Does the h-index have predictive power? Proceedings of the National Academy of Sciences of the United States of America 104 49 2007 19193 19198
101. Holmes, R. (2014). How to win citations and rise in the rankings University Ranking Watch (Vol. 2014).
102. Horrobin D. The philosophical basis of peer review and the suppression of innovation Journal of the American Medical Association 263 1990 1438 1441
103. Huutoniemi K., Klein J.T., Bruun H., Hukkinen J. Analyzing interdisciplinarity: Typology and indicators Research Policy 39 1 2010 79 88 10.1016/j.respol.2009.09.011
104. Iglesias J., Pecharromán C. Scaling the h-index for different scientific ISI fields Scientometrics 73 3 2007 303 320 10.1007/s11192-007-1805-x
105. Irvine J., Martin B., Peacock T., Turner R. Charting the decline of British science Nature 316 1985 587 590
106. Jacso P. As we may search - Comparison of major features of the Web of Science, Scopus, and Google Scholar citation-based and citation-enhanced databases Current Science 89 9 2005 1537 1547
107. Jacso P. Savvy searching: Google Scholar revisited Online Information Review 32 1 2008 102 114
108. Jin B. The h-index: An evaluation indicator proposed by scientist Science Focus 1 1 2006 8 9
109. Jin B. The AR-index: Complementing the h-index ISSI Newsletter 3 1 2007 6
110. Jin B., Liang L., Rousseau R., Egghe L. The R- and AR-indices: Complementing the h-index Chinese Science Bulletin 52 6 2007 855 863
111. Kamada T., Kawai S. An algorithm for drawing general undirected graphs Information Processing Letters 31 1 1989 7 15
112. Kay L., Newman N., Youtie J., Porter A., Rafols I. Patent overlay mapping: Visualizing technological distance Journal of the Association for Information Science and Technology 65 12 2014 2432 2443
113. Konkiel S., Scherer D. New opportunities for repositories in the age of altmetrics Bulletin of the American Society for Information Science and Technology 39 4 2013 22 26
114. Kuhn T. The structure of scientific revolutions 1962 Chicag o University Press Chicago
115. Lancho-Barrantes B.S., Guerrero-Bote V.P., Moya-Anegón F. What lies behind the averages and significance of citation indicators in different disciplines? Journal of Information Science 36 3 2010 371 382
116. Larivière V., Archambault É., Gingras Y., Vignola-Gagné É. The place of serials in referencing practices: Comparing natural sciences and engineering with social sciences and humanities Journal of the American Society for Information Science and Technology 57 8 2006 997 1004
117. Larivière V., Gingras Y. On the relationship between interdisciplinarity and scientific impact Journal of the American Society for Information Science and Technology 61 1 2010 126 131
118. Lawson T. Economics and reality 1997 Routledge London
119. Lehmann S., Jackson A.D., Lautrup B.E. Measures for measures. Nature 444 7122 2006 1003 1004 10.1038/4441003a http://www.nature.com/nature/journal/v444/n7122/suppinfo/4441003a-S1.html
120. Leydesdorff L. The development of frames of references Scientometrics 9 3-4 1986 103 125
121. Leydesdorff L. Theories of citation? Scientometrics 43 1 1998 5 25 10.1023/B:SCIE.0000027678.31097.e0
122. Leydesdorff L. Scientific communication and cognitive codification: Social systems theory and the sociology of scientific knowledge European Journal of Social Theory 10 3 2007 375 388 10.1177/1368431007080701
123. Leydesdorff L. Caveats for the use of citation indicators in research and journal evaluation Journal of the American Society for Information Science and Technology 59 2 2008 278 287
124. Leydesdorff L. How are new citation-based journal indicators adding to the bibliometric toolbox? Journal of the American Society for Information Science and Technology 60 7 2009 1327 1336
125. Leydesdorff L. Alternatives to the journal impact factor: I3 and the top-10% (or top-25%?) of the most highly cited papers Scientometrics 92 2012 355 365
126. Leydesdorff L. The revised SNIP indicator of Elsevier's Scopus Journal of Informetrics 7 2013 859 860
127. Leydesdorff L., Alkemade F., Heimeriks G., Hoekstra R. Patents as instruments for exploring innovation dynamics: geographic and technological perspectives on "photovoltaic cells" Scientometrics 102 1 2015 629 651 10.1007/s11192-014-1447-8
128. Leydesdorff L., Bornmann L. How fractional counting of citations affects the impact factor: Normalization in terms of differences in citation potentials among fields of science Journal of the American Society for Information Science and Technology 62 2 2011 217 229 10.1002/asi.21450
129. Leydesdorff L., Bornmann L. Integrated impact indicators compared with impact factors: An alternative research design with policy implications Journal of the American Society for Information Science and Technology 62 11 2011 2133 2146 10.1002/asi.21609
130. Leydesdorff, L., & Bornmann, L. (2015). The operationalization of "fields" as WoS subject categories (WCs) in evaluative bibliometrics: The cases of "library and information science" and "science & technology studies". Journal of the Association for Information Science and Technology; early view.
131. Leydesdorff L., Bornmann L., Mutz R., Opthof T. Turning the tables on citation analysis one more time: Principles for comparing sets of documents Journal of the American Society for Information Science and Technology 62 7 2011 1370 1381 10.1002/asi.21534
132. Leydesdorff, L., Bornmann, L., Opthof, T., & Mutz, R. (2011). Normalizing the measurement of citation performance: Principles for comparing sets of documents. Preprint arXiv: 1101.3863.2011. Retrieved from arXiv website. http://arxiv.org/
133. Leydesdorff L., Felt U. "Books" and "book chapters" in the book citation index (BKCI) and science citation index (SCI, SoSCI, A&HCI) Proceedings of the American Society for Information Science and Technology 49 1 2012 1 7
134. Leydesdorff L., Milojević S. Scientometrics J.D. Wright M. Lynch et al. The International encyclopedia of social and behavioral sciences, 2nd Edition (Section 8.5: Science and Technology Studies, Subsection 85030) 2015 Elsevier Oxford, UK, etc
135. Leydesdorff L., Opthof T. Scopus's source normalized impact per paper (SNIP) versus a journal impact factor based on fractional counting of citations Journal of the American Society for Information Science and Technology 61 11 2010 2365 2369 10.1002/asi.21371
136. Leydesdorff L., Opthof T. Remaining problems with the "New Crown Indicator" (MNCS) of the CWTS Journal of Informetrics 5 1 2011 224 225
137. Leydesdorff L., Radicchi F., Bornmann L., Castellano C., Nooy W. Fieldnormalized impact factors (IFs): A comparison of rescaling and fractionally counted IFs Journal of the American Society for Information Science and Technology 64 11 2013 2299 2309
138. Leydesdorff L., Rafols I. Indicators of the interdisciplinarity of journals: Diversity, centrality, and citations Journal of Informetrics 5 1 2011 87 100 10.1016/j.joi.2010.09.002
139. Leydesdorff L., Rafols I., Chen C. Interactive overlays of journals and the measurement of interdisciplinarity on the basis of aggregated journal-journal citations Journal of the American Society for Information Science and Technology 64 12 2013 2573 2586
140. Liang L. h-Index sequence and h-index matrix: Constructions and applications Scientometrics 69 1 2006 153 159
141. Lin J., Fenner M. Altmetrics in evolution: Defining and redefining the ontology of article-level metrics Information Standards Quarterly 25 2 2013 10.3789/isqv25no2.2013.04
142. Lotka A. Statistics: The frequency distribution of scientific productivity Journal of the Washington Academy of Sciences 16 12 1926 317 325
143. Luhmann N. Social systems (J. Bednarz & D. Baecker, Trans.) 1995 Stanford University Press Stanford
144. Luhmann N. On the scientific context of the concept of communication Social Science Information 35 2 1996 257 267
145. Lundberg J. Lifting the crown - Citation z-score Journal of Informetrics 1 2 2007 145 154
146. Luukkonen T. Why has Latour's theory of citations been ignored by the bibliometric community? Discussion of sociological interpretations of citation analysis Scientometrics 38 1 1997 27 37 10.1007/bf02461121
147. Ma N., Guan J., Zhao Y. Bringing PageRank to the citation analysis Information Processing and Management 44 2008 800 810
148. Mahdi S., D'Este P., Neely A. Citation counts: Are they good predictors of RAE scores? 2008 AIM Research London
149. Marshakova I. Bibliographic coupling system based on references Nauchno-Tekhnicheskaya Informatsiya Seriya 2 6 1973 3 8
150. Meade N., Islam T. Technological forecasting - Model selection, model stability and combining models Management Science 44 8 1998 1115 1130
151. Meho L., Rogers Y. Citation counting, citation ranking, and h-index of human-computer interaction researchers: A comparison of Scopus and Web of Science Journal American Society for Information Science and Technology 59 11 2008 1711 1726
152. Meho L., Yang K. Impact of data sources on citation counts and rankings of LIS faculty: Web of Science, Scopus and Google Scholar Journal American Society for Information Science and Technology 58 13 2007 2105 2125
153. Merton R. The Matthew effect in science Science 159 3810 1968 56 63
154. Merton R. The Matthew effect in science II: Cumulative advantage and the symbolism of intellectual property ISIS 79 1988 606 623
155. Michels C., Acsmoch U. Impact of bibliometric studies on publication behaviour of authors Scientometrics 98 2014 369 385
156. Mingers J. Can social systems be autopoietic? Assessing Luhmann's social theory Sociological Review 50 2 2002 278 299
157. Mingers J. Exploring the dynamics of journal citations: Modelling with S-curves Journal Operational Research Society 59 8 2008 1013 1025 10.1057/palgrave.jors.2602428
158. Mingers J. Measuring the research contribution of management academics using the Hirsch-index Journal Operational Research Society 60 8 2008 1143 1153
159. Mingers J. Problems with SNIP Journal of Informetrics 8 4 2014 890 894 10.1016/j.joi.2014.09.004
160. Mingers J., Burrell Q. Modelling citation behavior in Management Science journals Information Processing & Management 42 6 2006 1451 1464
161. Mingers J., Leydesdorff L. Identifying research fields within business and management: A journal cross-citation analysis Journal of the Operational Research Society, 2014 10.1057/jors.2014.113 Online
162. Mingers J., Lipitakis E. Counting the citations: A comparison of Web of Science and Google Scholar in the field of management Scientometrics 85 2 2010 613 625
163. Mingers J., Macri F., Petrovici D. Using the h-index to measure the quality of journals in the field of Business and Management Information Processing & Management 48 2 2012 234 241 10.1016/j.ipm.2011.03.009
164. Mingers J., Willmott H. Taylorizing business school research: On the "one best way" performative effects of journal ranking lists Human Relations 66 8 2013 1051 1073
165. Mingers J., Xu F. The drivers of citations in management science journals European Journal of Operational Research 205 2 2010 422 430
166. Moed H. Bibliometric indicators reflect publication and management strategies Scientometrics 47 2 2000 323 346
167. Moed H. The future of research evaluation rests with an intelligent combination of advanced metrics and transparent peer review Science and Public Policy 34 8 2007 575 583
168. Moed H. UK Research Assessment Exercises: Informed judgements on research quality or quantity? Scientometrics 74 1 2008 153 161
169. Moed H. CWTS crown indicator measures citation impact of a research group's publication oeuvre Journal of Informetrics 4 3 2010 436 438
170. Moed H. Measuring contextual citation impact of scientific journals Journal of Informetrics 4 3 2010 265 277
171. Moed, H. (2010c). The Source-Normalized Impact per Paper (SNIP) is a valid and sophisticated indicator of journal citation impact. Preprint arXiv:1005.4906. Retrieved from arXiv website http://arXiv.org
172. Moed H., Visser M. Appraisal of citation data sources 2008 Centre for Science and Technology Studies, Leiden University Leiden
173. Moed H., Visser M., Buter R. Development of bibliometric indicators of research quality 2008 Centre for Science and Technology Studies, Leiden University
174. Moussa S., Touzani M. Ranking marketing journals using the Google Scholar-based hg-index Journal of Informetrics 4 2010 107 117
175. Moxham H., Anderson J. Peer review: A view from the inside Science and Technology Policy 5 1 1992 7 15
176. Nacke O. Informetrie: Ein neuer Name fur eine neue Disziplin Nachrichten fur Dokumentation 30 6 1979 219 226
177. Nalimov V., Mulcjenko B. Measurement of science: Study of the development of science as an information process 1971 Foreign Technology Division Washington, DC
178. Nederhof A. Bibliometric monitoring of research performance in the social sciences and humanities: A review Scientometrics 66 1 2006 81 100
179. Newman M., Girvan M. Finding and evaluating community structure in networks Physical Review E 69 2 2004 026113
180. Nicolaisen J. Citation analysis Annual Review of Information Science and Technology 41 1 2007 609 641 10.1002/aris.2007.1440410120
181. Oppenheim C. Using the h-index to rank influential British researchers in information science and librarianship Journal of the American Society for Information Science and Technology 58 2 2007 297 301
182. Opthof T., Leydesdorff L. Caveats for the journal and field normalizations in the CWTS ("Leiden") evaluations of research performance Journal of Informetrics 4 3 2010 423 430
183. Ossenblok T., Engels T., Sivertsen G. The representation of the social sciences and humanities in the Web of Science-a comparison of publication patterns and incentive structures in Flanders and Norway (2005-9) Research Evaluation 21 4 2012 280 290
184. Oswald A. An examination of the reliability of prestigious scholarly journals: Evidence and implications for decision-makers Economica 74 293 2007 21 31
185. Otlet P. Traité de documentation: le livre sur le livre, théorie et pratique 1934 Editions Mundaneum Brussels
186. Page, L., Brin, S., Motwani, R., & Winograd, T. (1999). The PageRank citation ranking: Bringing order to the web.
187. Perneger, T.V. (2004). Relation between online "hit counts" and subsequent citations: prospective study of research papers in the BMJ (Vol. 329).
188. Pinski G., Narin F. Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics Information Processing & Management 12 5 1976 297 312
189. Pislyakov V. Comparing two "thermometers": Impact factors of 20 leading economic journals according to Journal Citation Reports and Scopus Scientometrics 79 3 2009 541 550
190. Price, D.J.d.S. (1963). Little Science, big science. New York: Columbia University Press.
191. Price D.J.d.S. Networks of scientific papers Science 149 3683 1965 510 515
192. Price D.J.d.S. A general theory of bibliometric and other cumulative advantage processes Journal of the American Society for Information Science 27 1976 292 306
193. Priem J. Altmetrics B. Cronin C. Sugimoto Beyond bibliometrics: Harnessing multidimensional indicators of scholarly impact 2014 MIT Press London 263 288
194. Pritchard A. Statistical bibliography or bibliometrics? Journal of Documentation 25 4 1969 348 349
195. Radicchi F., Castellano C. Testing the fairness of citation indicators for comparison across scientific domains: The case of fractional citation counts Journal of Informetrics 6 1 2012 121 130 10.1016/j.joi.2011.09.002
196. Rafols I., Leydesdorff L., O'Hare A., Nightingale P., Stirling A. How journal rankings can suppress interdisciplinary research: A comparison between innovation studies and business & management Research Policy 41 7 2012 1262 1282
197. Rafols I., Porter A.L., Leydesdorff L. Science overlay maps: A new tool for research policy and library management Journal of the American Society for Information Science and Technology 61 9 2010 1871 1887 10.1002/asi.21368
198. Rao C. Diversity and dissimilarity coefficients: A unified approach Theoretical Population Biology 21 1 1982 24 43
199. Reale E., Barbara A., Costantini A. Peer review for the evaluation of academic research: Lessons from the Italian experience Research Evaluation 16 3 2007 216 228
200. Rehn, C., & Kronman, U. (2008). Bibliometric handbook for Karolinska Institutet. Retrieved from http://ki.se/content/1/c6/01/79/31/bibliometric-handbook-karolinska.institutet-v-1.05.pdf.
201. Roemer R.C., Borchardt R. From bibliometrics to altmetrics: A changing scholarly landscape College & Research Libraries News 73 10 2012 596 600
202. Rossner M., Van Epps H., Hill E. Show me the data The Journal of Cell Biology 179 6 2007 1091 1092
203. Rosvall M., Bergstrom C. Mapping change in large networks PLoS One 5 1 2010 e8694
204. Rousseau R. New developments related to the Hirsch index Science Focus 1 4 2006 23 25
205. Rousseau R. Library science: Forgotten founder of bibliometrics Nature 510 7504 2014 218-218
206. Ruiz-Castillo, J., & Waltman, L. (2014). Field-normalized citation impact indicators using algorithmically constructed classification systems of science. Retrieved from http://orff.uc3m.es/handle/10016/18385.
207. Saad G. Exploring the h-index at the author and journal levels using bibliometric data of productive consumer scholars and business-related journals respectively Scientometrics 69 1 2006 117 120
208. Schubert A., Glänzel W. A systematic analysis of Hirsch-type indices for journals Journal of Informetrics 1 3 2007 179 184 10.1016/j.joi.2006.12.002
209. Seglen P. Why the impact factor of journals should not be used for evaluating research British Medical Journal 314 7079 1997 498 502
210. Seglen P.O. The skewness of science Journal of the American Society for Information Science 43 9 1992 628 638
211. Senge P. The fifth discipline: The art and practice of the learning organization 1990 Century Books London
212. Sichel H. A bibliometric distribution which really works Journal of the American Society for Information Science 36 1985 314 321
213. Silva F.N., Rodrigues F.A., Oliveira O.N. Jr., da Fontoura Costa L. Quantifying the interdisciplinarity of scientific journals and fields Journal of Informetrics 7 2 2013 469 477 10.1016/j.joi.2013.01.007
214. Sivertsen G., Larsen B. Comprehensive bibliographic coverage of the social sciences and humanities in a citation index: An empirical analysis of the potential Scientometrics 91 2 2012 567 575
215. Small H. Co-citation in the scientific literature: A new measure of the relationship between two documents Journal of the American Society for Information Science 24 4 1973 265 269
216. Small H., Sweeney E. Clustering the Science Citation Index using cocitations: A comparison of methods Scientometrics 7 1985 391 409
217. Thelwall M., Vaughan L. Webometrics: An introduction to the special issue Journal of the American Society for Information Science and Technology 55 14 2004 1213 1215
218. Thelwall M., Vaughan L., Björneborn L. Webometrics Annual Review of Information Science and Technology 39 1 2005 81 135
219. Tijssen R., de Leeuw J., van Raan A. Quasi-correspondence analysis on square scientometric transaction matrices Scientometrics 11 5-6 1987 347 361
220. Todeschini R. The j-index: A new bibliometric index and mulitvariate comparisons between other bibliometric indices Scientometrics 87 2011 621 639
221. Truex III D., Cuellar M., Takeda H. Assessing scholarly influence: Using the Hirsch indices to reframe the discourse Journal of the Association for Information Systems 10 7 2009 560 594
222. Van Eck N., Waltman L. Software survey: VOSviewer, a computer program for bibliometric mapping Scientometrics 84 2 2010 523 538
223. van Leeuwen T. The application of bibliometric analyses in the evaluation of social science research. Who benefits from it, and why it is still feasible Scientometrics 66 1 2006 133 154 10.1007/s11192-006-0010-7
224. van Raan A. Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgement for 147 chemistry research groups Scientometrics 67 3 2005 491 502
225. van Raan A. Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods Scientometrics 62 1 2005 133 143
226. van Raan A. Measuring science: Capita selectaof current main issues H. Moed W. Glenzel U. Schmoch Handbook of quantitative science and technology research 19-50 2005 Springer New York
227. van Raan A., van Leeuwen T., Visser M., van Eck N., Waltman L. Rivals for the crown: Reply to Opthof and Leydesdorff Journal of Informetrics 4 3 2011 431 435
228. van Raan A.J. Sleeping beauties in science Scientometrics 59 2004 467 472
229. Van Veller M., Gerritsma W., Van der Togt P., Leon C., Van Zeist C. Bibliometric analyses on repository contents for the evaluation of research at Wageningen UR A. Katsirikou C. Skiadas Qualitative and quantitative methods in libraries: Theory and applications 2009 World Scientific 19 26
230. Vanclay J. Impact factor: outdated artefact or stepping-stone to journal certification? Scientometrics 92 2 2012 211 238
231. Wagner C.S., Roessner J.D., Bobb K., Klein J.T., Boyack K.W., Keyton J. et al. Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature Journal of Informetrics 5 1 2011 14 26 10.1016/j.joi.2010.06.004
232. Waltman L., CaleroMedina C., Kosten J., Noyons E., Tijssen R.J., Eck N.J. et al. The Leiden Ranking 2011/2012: Data collection, indicators, and interpretation Journal of the American Society for Information Science and Technology 63 12 2012 2419 2432
233. Waltman L., van Eck N. Source normalized indicators of citation impact: An overview of different approaches and an empirical comparison Scientometrics 96 2013 699 716
234. Waltman L., van Eck N. A systematic empirical comparison of different approaches for normalizing citation impact indicators Journal of Informetrics 7 4 2013 833 849
235. Waltman L., van Eck N., van Leeuwen T., Visser M. Some modifications to the SNIP journal impact indicator Journal of Informetrics 7 2 2013 272 285 10.1007/s11192-011-0354-5
236. Waltman L., van Eck N., van Leeuwen T., Visser M., van Raan A. Towards a new crown indicator: Some theoretical considerations Journal of Informetrics 5 1 2010 37 47 10.1016/j.joi.2010.08.001
237. Waltman L., van Eck N., van Leeuwen T., Visser M., van Raan A. Towards a new crown indicator: an empirical analysis Scientometrics 87 3 2011 467 481 10.1007/s11192-011-0354-5
238. Weinstock N. Citation indexes A. Kent Encyclopedia of library and information science 1971 Marcel Dekker New York 16 41
239. West J., Bergstrom T., Bergstrom C. Big Macs and Eigenfactor scores: Don't let correlation coefficients fool you Journal of the American Society for Information Science and Technology 61 9 2010 1800 1807 10.1002/asi.21374
240. Wilhite A., Fong E. Coercive citation in academic publishing Science 335 6068 2012 542 543
241. Wilson C. Informetrics Annual Review of Information Science and Technology 34 1999 107 247
242. Wouters P. The signs of science Scientometrics 41 1 1998 225 241
243. Wouters P. The citation: From culture to infrastructure B. Cronin C. Sugimoto Beyond bibliometrics: Harnessing multidimensional indicators of scholarly impact 2014 MIT Press London 47 66
244. Xu F., Liu W.B., Mingers J. New journal classification methods based on the global h-index Information Processing & Management 51 2 2015 50 61 10.1016/j.ipm.2014.10.011
245. Zheng C. The e-index, complementing the h-index for excess citations PLoS One 4 5 2009 e5429
246. Zipf G. The psycho-biology of language: An introduction to dynamic philology 1936 Routledge London
247. Zitt M. Behind citing-side normalization of citations: Some properties of the journal impact factor Scientometrics 89 1 2011 329 344 10.1007/s11192-011-0441-7
248. Zitt M., Bassecoulard E. Development of a method for detection and trend analysis of research fronts built by lexical or cocitation analysis Scientometrics 30 1994 333 351
249. Zitt M., Small H. Modifying the journal impact factor by fractional citation weighting: The audience factor Journal of the American Society for Information Science and Technology 59 11 2008 1856 1860 10.1002/asi.20880