Challenges for scientometric indicators: Data demining, knowledge-flow measurements and diversity issues

Ethics in Science and Environmental Politics

Volumn 8, Issue 1, 2008, Pages 49-60

  Zitt, Michel ^a,b   Bassecoulard, Elise ^a  

^a LERECO   (France)

^b Observatoire des Sciences et des Techniques OST   (France)

Author keywords

Bibliometrics; Evaluation; Indicators; Multidisciplinarity; Scientific networks; Scientometrics

Indexed keywords

DATA MINING; INTERNET; KNOWLEDGE;

EID: 44849112136     PISSN: None     EISSN: 16118014     Source Type: Journal    
DOI: 10.3354/esep00092     Document Type: Article

References (85)

1. Adams J, Smith D (2003) Funding research diversity. The impact of further concentration on university research performance and regional research capacity. Technical report by Evidence Ltd. Universities UK, London
2. Aguillo IF, Granadino B, Ortega JL, Prieto JA (2006) Scientific research activity and communication measured with cybermetrics indicators. J Am Soc Inform Sci Technol 57:1296-1302
3. Aksnes DW, Taxt RE (2004) Peer reviews and bibliometric indicators: a comparative study at a Norwegian university. Res Eval 13:33-41
4. Barabasi AL, Jeong H, Neda Z, Ravasz E, Schubert A, Vicsek T (2002) Evolution of the social network of scientific collaborations. Physica A 311:590-614
5. Barré R (2001) Sense and nonsense of S&T productivity indicators. Sci Public Policy 28:259-266
6. Bassecoulard E, Lelu A, Zitt M (2007) Mapping nanosciences by citation flows: a preliminary analysis. Scientometrics 70:859-880
7. Bjorneborn L, Ingwersen P (2004) Toward a basic framework for webometrics. J Am Soc Inform Sci Technol 55: 1216-1227
8. Bonaccorsi A (2002) Matching properties. Research regimes and institutional systems in science. 'Science as an institution, the institution of science' Conference, Siena, Jan 25-26. Sant' Anna School of Advanced Studies, Pisa
9. Bourdieu P (1975) The specificity of the scientific field and the social conditions of the progress of reason. Soc Sci Inform 14:19-47
10. Boyack KW (2004) Mapping knowledge domains: characterizing PNAS. Proc Natl Acad Sci USA 101:5192-5199
11. Braun T, Bujdoso E (1975) Some tendencies of the radioanalytical literature. Statistical games for trend evaluation. 1-Distribution of the information sources. Radiochem Radioanal Lett 23:195-203
12. Butler L (2003) Explaining Australia's increased share of ISI publications - the effects of a funding formula based on publication counts. Res Policy 32:143-155
13. Butler L (2008) Using a balanced approach to bibliometrics: quantitative performance measures in the Australian Research Quality Framework. Ethics Sci Environ Polit 8:83-92
14. Callon M (1986) The sociology of an actor-network: the case of the electric vehicle. In: Callon M, Law J, Rip A (eds) Mapping the dynamics of science and technology. Macmillan Press, London, p 19-34
15. Callon M, Courtial JP, Turner WA, Bauin S (1983) From translation to problematic networks: an introduction to co-word analysis. Soc Sci Inf 22:191-235
16. Carayol N, Dalle JM (2007) Sequential problem choice and the reward system in Open Science. Struct Change Econ Dyn 18:167-191
17. Cheung WWL (2008) The economics of post-doc publishing. Ethics Sci Environ Polit 8:41-44
18. Cowan R, Jonard N, Zimmermann JB (2006) Evolving networks of inventors. J Evol Econ 16:155-174
19. Cronin B (2004) Normative shaping of scientific practice: The magic of Merton. Scientometrics 60:41-46
20. Daraio C, Simar L (2005) Introducing environmental variables in nonparametric frontier models: A probabilistic approach. J Prod Anal 24:93-121
21. Debackere K, Rappa MA (1994) Institutional variations in problem choice and persistence among scientists in an emerging field. Res Policy 23:425-441
22. de Solla Price DJ (1963) Little science, big science. Columbia University Press, New York
23. de Solla Price D (1970) Citation measures of hard science, soft science, technology, and nonscience. In: Nelson CE, Pollock DK (eds) Communication among scientists and engineers. Heath, Lexington, MA, p 3-22
24. Dyson RG, Allen R, Camanho AS, Podinovski VV, Sarrico CS, Shale EA (2001) Pitfalls and protocols in DEA. Bur J Oper Res 132:245-259
25. Egghe L (1990) The duality of informetric system with applications to the empirical laws. J Inf Sci 16:17-27
26. Egghe L (1991) The exact place of Zipf's law and Pareto's law amongst the classical informetric laws. Scientometrics 20:93-106
27. Etzkowitz H, Leydesdorff L (1997) Universities and the global knowledge economy: a triple helix of university-industry-government relations. Pinter, London
28. Garfield E (1955) Citation indexes for science. A new dimension in documentation through association of ideas. Science 122:108-111
29. Glänzel W, Danell R, Persson O (2003) The decline of Swedish neuroscience: decomposing a bibliometric national science indicator. Scientometrics 57:197-213
30. Gläser J, Laudel G, Hinze S, Butler L (2002) Impact of evaluation-based funding on the production of scientific knowledge: what to worry about, and how to find out. Expertise for the German Ministry for Education and Research, Research Program 'Knowledge for decision-making processes - research on the relationship between science, politics and society' (available at: www.sciencepolicystudies.de/publikation/expertise.htm)
31. Granovetter M (1973) The strength of weak ties. Am J Sociol 78:1360-1380
32. Harnad S (2008) Validating research performance metrics against peer rankings. Ethics Sci Environ Polit 8:103-107
33. Hicks D (2004). The four literatures of social science. In: Glaenzel W, Moed HF, Schmoch U (eds) Handbook of quantitative science and technology research: the use of publication and patent statistics in studies of S&T systems. Kluwer Academic Publishers, Dordrecht, p 473-496
34. Hirsch JE (2005) An index to quantify an individual's scientific research output. Proc Natl Acad Sci USA 102:16569-16572
35. Jackson MO, Wolinsky A (1996) A strategie model of social and economic networks. J Econ Theory 71:44-74
36. Janssens F, Glaenzel W, De Moor B (2007) A hybrid mapping of information science. In: Torres Salinas D, Moed HF (eds) Proc ISSI 2007:11th Int Conf Int Society Scientometrics and Informetrics, Vols I and II. ISSI, Leuven, p 408-420
37. Katz SJ (1999) The self-similar science system. Res Policy 28:501-517
38. Katz JS, Martin BR (1997) What is research collaboration? Res Policy 26:1-18
39. Larédo P, Callon M, Mustar P, Birac AM, Fourest B (1992) Defining the strategic profile of research labs: the research compass card method. In: Van Raan A, de Bruin R, Moed H, Nederhof A, Tijssen R (eds). Science and technology in a policy context. DSWO Press, Leiden, p 184-199
40. Latour B, Woolgar S (1979) Laboratory life. The construction of scientific facts. Sage, London
41. Lewison G, Dawson G (1998,) The effect of funding on the out-puts of biomedical research. Scientometrics 41:17-27
42. Lewison G, Rippon I, de Francisco A, Lipworth S (2004) Out-puts and expenditures on health research in 8 disease areas using a bibliometric approach, 1996-2001. Res Eval 13:181-188
43. Leydesdorff L (2001) The challenge of scientometrics. The development, measurement, and self-organization of scientific communications. Universal Publishers, Boca Raton, FL
44. Leydesdorff L (2007) Mapping interdisciplinarity at the interfaces between the science citation index and the social science citation index. Scientometrics 71:391-405
45. Liu NC, Cheng Y (2005) Academic ranking of world universities - methodologies and problems. 1st Int Conf on World-Class Universities (WCU-1) Shanghai, 16-18 June. Shanghai Jiao Tong University, Shanghai
46. Luwel M (1999) Is the science citation index US-biased? Scientometrics 46:549-562
47. Merton RK (1942) Science and technology in a democratic order. J Legal Political Sociol 1:115-126
48. Moed HF (2002) The impact-factor debate: the ISI's uses and limits. Towards a critical, informative, accurate and policy-relevant bibliometrics. Nature 415:731-732
49. Morillo F, Bordons M, Gomez I (2001) An approach to interdisciplinarity through bibliometric indicators. Scientometrics 51:203-222
50. Murugesan P, Moravcsik MJ (1978) Variation of the nature of citation measures with journal and scientific specialties. J Am Soc Inform Sci 29:141-155
51. Nalimov VV, Mulczenko ZM (1969) Naoukometriia. Izuchenie razvitiia nauki kak informatsionvo prosessa. (Scientometrics. Study of the development of science as an information process). Nauka, Moscow
52. Narin F (1976) Evaluative bibliometrics: the use of publication and citation analysis in the evaluation of scientific activity. (Report prepared for the National Science Foundation, Contract NSF C-627). Computer Horizons, Cherry Hill, NJ
53. Narvaez-Berthelemot N, Russell JM (2001) World distribution of social science journals: A view from the periphery. Scientometrics 51:223-239
54. Nederhof AJ (2006) Bibliometric monitoring of research performance in the social sciences and the humanities: a review. Scientometrics 66:81-100
55. Nederhof AJ, Meijer-RF (1995) Development of bibliometric indicators for utility of research to users in society - measurement of external knowledge transfer via publications in trade journals. Scientometrics 32:37-48
56. Noyons ECM (2004) Science maps within a science policy context - improving the utility of science and domain maps within a science policy and research management context. In: Glaenzel W, Moed HF, Schmach U (eds) Handbook of quantitative science and technology research: the use of publication and patent statistics in studies of S&T systems. Kluwer Academic Publishers, Dordrecht, p 237-255
57. Peritz BC, Bar-Ilan J (2002) The sources used by bibliometrics-scientometrics as reflected in references. Scientometrics 54:269-284
58. Pinski G, Narin F (1976) Citation influence for journal aggregates of scientific publications: theory, with application to the literature of physics. Inform Process Manag 12:297-312
59. Rafols I, Meyer M (2007) Diversity measures and network centralities as indicators of interdisciplinarity: case studies in bionanoscience. In: Torres Salinas D, Moed HF (eds) Proc ISSI 2007: 11th Int Conf Int Soc Scientometrics and Informetrics, Madrid 25-27 June, Vols I and II. ISSI, Leuven, p 631-642
60. Rïnia EJ, van Leeuwen TN, van Vuren HG, van Raan AFJ (1998) Comparative analysis of a set of bibliometric indicators and central peer review criteria - Evaluation of condensed matter physics in the Netherlands. Res Policy 27:95-107
61. Rinia EJ, vanLeeuwen TN, Bruins EEW, vanVuren HG, vanRaan AFJ (2001) Citation delay in interdisciplinary knowledge exchange. Scientometrics 51:293-309
62. Rousseau R (1990) Relations between continuous versions of bibliometric laws. J Am Soc Inform Sci 41:197-203
63. Schoepflin U, Glänzel W (2001) Two decades of "scientometrics" - an interdisciplinary field represented by its leading journal. Scientometrics 50:301-312
64. Schubert A, Glänzel W (2006) Cross-national preference in co-authorship, references and citations. Scientometrics 69:409-428
65. Schubert A, Glänzel W, Braun T (1988) Against absolute methods: relative scientometric indicators and relational charts as evaluation tools. In: Van Raan AFJ (ed) Handbook of quantitative studies of science and technology. Elsevier, Amsterdam, p 137-169
66. Seglen PO (1997) Why the impact factor of journals should not be used for evaluating research. BMJ 314:498-502
67. Small HG (2004) On the shoulders of Robert Merton: towards a normative theory of citation. Scientometrics 60:71-79
68. Small H, Griffith BC (1974) The structure of scientific literatures I: identifying and graphing specialties. Sci Stud 4:17-40
69. Stephan PE (1996) The economics of science J Econ Lit 34: 1199-1235
70. Stirling A (2007) A general framework for analysing diversity in science, technology and society. J R Soc Interface 4:707-719
71. Thelwall M, Vaughan L, Bjorneborn L (2005) Webometrics. Annu Rev Inform Sci Tech 39:81-135
72. van den Besselaar P, Heimeriks G (2006) Mapping research topics using word-reference co-occurrences: a method and an exploratory case study. Scientometrics 68:377-393
73. van Leeuwen TN, Visser MS, Moed HF, Nederhof TJ, van Raan AFJ (2003) Holy Grail of science policy: exploring and combining bibliometric tools in search of scientific excellence. Scientometrics 57:257-280
74. van Raan AFJ (1996) Advanced bibliometric methods as quantitative core of peer review based evaluation and foresight exercises. Scientometrics 36:397-420
75. van Raan AFJ (2001) Competition amongst scientists for publication status: Toward a model of scientific publication and citation distributions. Scientometrics 51:347-357
76. Watts DJ, Strogatz SH (1998) Collective dynamics of 'small-world' networks. Nature 393:440-442
77. Weingart P (2005) Impact of bibliometrics upon the science system: Inadvertent consequences? Scientometrics 62: 117-131
78. White HD, Griffith BC (1981) Author co-citation: a literature measure of intellectual structure. J Am Soc Inf Sci 32:163-172
79. Wouters P (1997) Citation cycles and peer review cycles. Scientometrics 38:39-55
80. Wouters P (2006) Aux origines de la scientométrie. La naissance du Science Citation Index. Actes Rech Sci Soc 164:10-21
81. Zitt M, Bassecoulard E (1994) Development of a method for detection and trend analysis of research fronts built by lexical or cocitation analysis. Scientometrics 30: 333-351
82. Zitt M, Bassecoulard E (2006) Delineating complex scientific fields by a hybrid lexical-citation method: an application to nanosciences. Inform Process Manage 42:1513-1531
83. Zitt M, Bassecoulard E, Okubo Y (2000) Shadows of the past in international cooperation: collaboration profiles of the top five producers of science. Scientometrics 47: 627-657
84. Zitt M, Ramanana-Rahary S, Bassecoulard E (2003) Correcting glasses help fair comparisons in international science landscape: country indicators as a function of ISI database delineation. Scientometrics 56:259-282
85. Zitt M, Ramanana-Rahary S, Bassecoulard E (2005) Relativity of citation performance and excellence measures: From cross-field to cross-scale effects of field-normalisation. Scientometrics 63:373-401