Web indicators for research evaluation. Part 1: Citations and links to academic articles from the Web

Profesional de la Informacion

Volumn 24, Issue 5, 2015, Pages 587-604

  Thelwall, Mike ^a   Kousha, Kayvan ^a  

^a UNIVERSITY OF WOLVERHAMPTON   (United Kingdom)

Author keywords

Alternative indicators; Alternative metrics; Altmetrics; Citation analysis; Google Scholar; Scientometrics; Web indicators; Webometrics

Indexed keywords

EID: 84945189014     PISSN: 13866710     EISSN: 16992407     Source Type: Journal    
DOI: 10.3145/epi.2015.sep.08     Document Type: Article

References (163)

1. Acumen (2014). The Acumen portfolio: Guidelines for good evaluation practice. Acumen Consortium. http://research-acumen.eu/wp-content/uploads/D6.14-Good-Evaluation-Practices.pdf
2. Adie, Euan; Roe, William (2013). "Altmetric: Enriching scholarly content with article-level discussion and metrics". Learned publishing, v. 26, n. 1, pp. 11-17. http://figshare.com/articles/Enriching-scholarly-content-with-article-level-discussion-and-metrics/105851 http://dx.doi.org/10.1087/20130103
3. Aguillo, Isidro F.; Granadino, Begoña; Ortega, José-Luis; Prieto, José-Antonio (2006). "Scientific research activity and communication measured with cybermetrics indicators". Journal of the American Society for Information Science and Technology, v. 57, n. 10, pp. 1296-1302. http://dx.doi.org/10.1002/asi.20433
4. Aguinis, Herman; Suárez-González, Isabel; Lannelongue, Gustavo; Joo, Harry (2012). "Scholarly impact revisited". The Academy of Management Perspectives, v. 26, n. 2, pp. 105-132. http://dx.doi.org/10.5465/amp.2011.0088
5. Almind, Tomas C.; Ingwersen, Peter (1997). "Informetric analyses on the World Wide Web: Methodological approaches to 'Webometrics'". Journal of documentation, v. 53, n. 4, pp. 404-426. http://dx.doi.org/10.1108/EUM0000000007205
6. Amara, Nabil; Landry, Réjean (2012). "Counting citations in the field of business and management: Why use Google Scholar rather than the Web of Science". Scientometrics, v. 93, n. 3, pp. 553-581. http://dx.doi.org/10.1007/s11192-012-0729-2
7. Archambault, Éric; Vignola-Gagné, Étienne; Côté, Grégoire; Larivière, Vincent; Gingras, Yves (2006). "Benchmarking scientific output in the social sciences and humanities: The limits of existing databases". Scientometrics, v. 68, n. 3, pp. 329-342. http://crc.ebsi.umontreal.ca/publications/Benchmarking-Final.pdf
8. Bar-Ilan, Judit (2008). "Which h-index? - A comparison of WoS, Scopus and Google Scholar". Scientometrics, v. 74, n. 2, pp. 257-271. http://dx.doi.org/10.1007/s11192-008-0216-y
9. Bar-Ilan, Judit (2010). "Web of Science with the Conference proceedings citation indexes: The case of computer science". Scientometrics, v. 83, n. 3, pp. 809-824. http://dx.doi.org/10.1007/s11192-009-0145-4
10. Bar-Ilan, Judit; Aharony, Noa (2014). "Twelve years of Wikipedia research". In: Proceedings of the 2014 ACM conference on Web science, pp. 243-244. New York: ACM Press. http://dl.acm.org/citation.cfm?id=2615569&coll=DL&dl=G UIDE&CFID=710889382&CFTOKEN=29904658
11. Bauer, Kathleen; Bakkalbasi, Nisa (2005). "An examination of citation counts in a new scholarly communication environment". D-Lib magazine, v. 11, n. 9. http://www.dlib.org/dlib/september05/bauer/09bauer.html
12. Beel, Joeran; Gipp, Bela (2010a). "Academic search engine spam and Google Scholar's resilience against it". The journal of electronic publishing, v. 13, n. 3. http://dx.doi.org/10.3998/3336451.0013.305
13. Beel, Joeran; Gipp, Bela (2010b). "On the robustness of Google Scholar against spam". In: Proceedings of the 21st ACM Conf on hypertext and hypermedia, pp. 297-298. https://www.interaction-design.org/references/conferences/proceedings-of-the-21st-acm-conference-on-hypertext-and-hypermedia.html
14. Bollen, Johan; Van De Sompel, Herbert (2008). "Usage impact factor: The effects of sample characteristics on usagebased impact metrics". Journal of the American Society for Information Science and Technology, v. 59, n. 1, pp. 136-149. http://dx.doi.org/10.1002/asi.20746
15. Bollen, Johan; Van De Sompel, Herbert; Rodriguez, Marko A. (2008). "Towards usage-based impact metrics: First results from the Mesur project". In: Procs of the ACM Intl conf on digital libraries, Pittsburgh, Pennsylvania, USA, pp. 231-240. http://arxiv.org/abs/0804.3791
16. Borgman, Christine L.; Furner, Jonathan (2002). "Scholarly communication and bibliometrics". Annual review of information science and technology, v. 36, Medford, NJ: Information Today Inc., pp. 3-72. ISBN: 9781573871310 http://polaris.gseis.ucla.edu/gleazer/296-readings/arist02.pdf
17. Bornmann, Lutz; Marx, Werner; Schier, Hermann; Rahm, Erhard; Thor, Andreas; Daniel, Hans-Dieter (2009). "Convergent validity of bibliometric Google Scholar data in the field of chemistry-citation counts for papers that were accepted by Angewandte Chemie International Edition or rejected but published elsewhere, using Google Scholar, Science Citation Index, Scopus, and Chemical Abstracts". Journal of informetrics, v. 3, n. 1, pp. 27-35. http://dx.doi.org/10.1016/j.joi.2008.11.001
18. Brody, Tim; Harnad, Stevan; Carr, Leslie (2006). "Earlier web usage statistics as predictors of later citation impact". Journal of the American Society for Information Science and Technology, v. 57, n. 8, pp. 1060-1072. http://dx.doi.org/10.1002/asi.20373
19. Butler, Linda (2008). "ICT assessment: Moving beyond journal outputs". Scientometrics, v. 74, n. 1, pp. 39-55. http://dx.doi.org/10.1007/s11192-008-0102-7
20. Chen, Xiaotian (2010). "Google Scholar's dramatic coverage improvement five years after debut". Serials review, v. 36, n. 4, pp. 221-226. http://dx.doi.org/10.1080/00987913.2010.10765321
21. Chu, Heting; Krichel, Thomas (2007). "Downloads vs. citations in economics: Relationships, contributing factors and beyond". In: Proceedings of ISSI 2007-11th Intl conf of the International Society for Scientometrics and Informetrics, pp. 207-215, Madrid, Spain, June 25-27. http://eprints.rclis.org/11085/1/DownloadsVsCitations.pdf
22. Costas, Rodrigo; Zahedi, Zohreh; Wouters, Paul (2014). "Do altmetrics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective". arXiv preprint http://arxiv.org/abs/1401.4321
23. Cronin, Blaise (2001). "Bibliometrics and beyond: Some thoughts on web-based citation analysis". Journal of information science, v. 27, n. 1, pp. 1-7. http://dx.doi.org/10.1177/016555150102700101
24. Cronin, Blaise; Snyder, Herbert W.; Rosenbaum, Howard; Martinson, Anna; Callahan, Ewa (1998). "Invoked on the web". Journal of the American Society for Information Science, v. 49, n. 14, pp. 1319-1328 http://dx.doi.org/10.1002/(SICI)1097-4571(1998)49:14<1319::AIDASI9> 3.0.CO;2-W
25. Da-Silva, Jaime-A.-Teixeira (2013). "The need for post-publication peer review in plant science publishing". Frontiers in plant science, 4 December. http://dx.doi.org/10.3389/fpls.2013.00485
26. Darmoni, Stefan J.; Roussel, Francis; Benichou, Jacques; Faure, Gilbert C.; Thirion, Benoit; Pinhas, Nicole (2000). "Reading factor as a credible alternative to impact factor: A preliminary study". Technology and health care, v. 8, n. 3-4, pp. 174-175.
27. Davies, Julia; Merchant, Guy (2007). "Looking from the inside out: Academic blogging as new literacy". In: C. Lankshear & M. Knobel (Eds.), A new literacies sampler, pp. 167-198. New York: Peter Lang. http://www.geocities.ws/cornerbrookresearch07/Sampler. pdf#page=177 http://www.peterlang.com/index.cfm?event=cmp.cst. ebooks.datasheet&id=46696
28. De-Groote, Sandra L.; Raszewski, Rebecca (2012). "Coverage of Google Scholar, Scopus, and Web of Science: A case study of the h-index in nursing". Nursing outlook, v. 60, n. 6, pp. 391-400. http://dx.doi.org/10.1016/j.outlook.2012.04.007
29. De-Winter, Joost C. F.; Zadpoor, Amir A.; Dodou, Dimitra (2014). "The expansion of Google Scholar versus Web of Science: A longitudinal study". Scientometrics, v. 98, n. 2, pp. 1547-1565. http://dx.doi.org/10.1007/s11192-013-1089-2
30. Delgado-López-Cózar, Emilio; Robinson-García, Nicolás; Torres-Salinas, Daniel (2014). "The Google Scholar experiment: How to index false papers and manipulate bibliometric indicators". Journal of the Association for Information Science and Technology, v. 65, n. 3, pp. 446-454. http://dx.doi.org/10.1002/asi.23056
31. Drott, M. Carl (1995). "Reexamining the role of conference papers in scholarly communication". Journal of the American Society for Information Science, v. 46, n. 4, pp. 299-305. http://dx.doi.org/10.1002/(SICI)1097-4571(199505)46:4<299::AIDASI6> 3.0.CO;2-0
32. Duin, Daphne; King, David; Van-den-Besselaar, Peter (2012). "Identifying audiences of e-infrastructures-tools for measuring impact". PloS one, v. 7, n. 12, e50943. http://dx.doi.org/10.1371/journal.pone.0050943
33. Duy, Johanna; Vaughan, Liwen (2006). "Can electronic journal usage data replace citation data as a measure of journal use? An empirical examination". Journal of academic librarianship, v. 32, n. 5, pp. 512-517. http://dx.doi.org/10.1016/j.acalib.2006.05.005
34. Ewins, Rory (2005). "Who are you? Weblogs and academic identity". E-learning, n. 2, pp. 368-377. http://dx.doi.org/10.2304/elea.2005.2.4.368
35. Eyre-Walker, Adam; Stoletzki, Nina (2013). "The assessment of science: The relative merits of post-publication review, the impact factor, and the number of citations". PLoS biology, v. 11, n. 10: e1001675. http://dx.doi.org/10.1371/journal.pbio.1001675
36. Falagas, Matthew E.; Pitsouni, Eleni I.; Malietzis, George A.; Pappas, Georgios (2008). "Comparison of PubMed, Scopus, Web of Science, and Google Scholar: Strengths and weaknesses". Faseb journal, v. 22, n. 2, pp. 338-342. http://dx.doi.org/10.1096/fj.07-9492LSF
37. Franceschet, Massimo (2010). "A comparison of bibliometric indicators for computer science scholars and journals on Web of Science and Google Scholar". Scientometrics, v. 83, n. 1, pp. 243-258. http://dx.doi.org/10.1007/s11192-009-0021-2
38. Franceschet, Massimo; Costantini, Antonio (2011). "The first Italian research assessment exercise: A bibliometric perspective". Journal of informetrics, v. 5, n. 2, pp. 275-291. http://dx.doi.org/10.1016/j.joi.2010.12.002
39. Glänzel, Wolfgang; Schlemmer, Balázs; Thijs, Bart (2003). "Better late than never? On the chance to become highly cited only beyond the standard bibliometric time horizon". Scientometrics, v. 58, n. 3, pp. 571-586. http://dx.doi.org/10.1023/B:SCIE.0000006881.30700.ea
40. Glänzel, Wolfgang; Schoepflin, Urs (1995). "A bibliometric study on ageing and reception processes of scientific literature". Journal of information science, v. 21, n. 1, pp. 37-53. http://dx.doi.org/10.1177/016555159502100104
41. Gorraiz, Juan; Gumpenberger, Christian (2010). "Going beyond citations: Serum-A new tool provided by a network of libraries". Liber quarterly, v. 20, n. 1, pp. 80-93. http://liber.library.uu.nl/index.php/lq/article/view/7978
42. Gorraiz, Juan; Gumpenberger, Christian; Schloegl, Christian (2013). "Differences and similarities in usage versus citation behaviours observed for five subject areas". In: Procs of ISSI 2013-14th Conf of the International Society of Scientometrics and Informetrics, pp. 519-535. Vienna, Austria: AIT Austrian Institute of Technology GmbH Vienna. http://www.issi2013.org/Images/ISSI-Proceedings-Volume-I.pdf
43. Gregg, Melissa (2006) "Feeling ordinary: Blogging as conversational scholarship". Continuum: Journal of media and cultural studies, v. 20, n. 2, pp. 147-160. http://dx.doi.org/10.1080/10304310600641604
44. Groth, Paul; Gurney, Thomas (2010). "Studying scientific discourse on the web using bibliometrics: A chemistry blogging case study". In: Procs of the WebSci10: Extending the frontiers of society on-line, April 26-27th. Raleigh, NC, USA. http://journal.webscience.org/308
45. Gurung, Regan A. R.; Landrum, R. Eric; Daniel, David B. (2012). "Textbook use and learning: A North American perspective". Psychology learning and teaching, v. 11, n. 1, pp. 87-98. http://dx.doi.org/10.2304/plat.2012.11.1.87
46. Gurung, Regan A. R.; Martin, Ryan C. (2011). "Predicting textbook reading: The textbook assessment and usage scale". Teaching of psychology, v. 38, n. 1, pp. 22-28. http://dx.doi.org/10.1177/0098628310390913
47. Harter, Stephen P.; Ford, Charlotte E. (2000). "Web-based analysis of e-journal impact: Approaches, problems, and issues". Journal of the American Society for Information Science, v. 51, n. 13, pp. 1159-1176. http://dx.doi.org/10.1002/1097-4571(2000)9999:9999<::AIDASI1029> 3.0.CO;2-P
48. Harzing, Anne-Wil (2013). "A preliminary test of Google Scholar as a source for citation data: A longitudinal study of Nobel Prize winners". Scientometrics, v. 94, n. 3, pp. 1057-1075. http://dx.doi.org/10.1007/s11192-012-0777-7
49. Harzing, Anne-Wil (2014). "A longitudinal study of Google Scholar coverage between 2012 and 2013". Scientometrics, v. 98, n. 1, pp. 565-575. http://dx.doi.org/10.1007/s11192-013-0975-y
50. Harzing, Anne-Wil; Van der Wal, Ron (2008). "Google Scholar as a new source for citation analysis". Ethics in science and environmental politics, v. 8, n. 1, pp. 61-73. http://www.int-res.com/articles/esep2008/8/e008pp5.pdf
51. Haustein, Stefanie; Siebenlist, Tobias (2011). "Applying social bookmarking data to evaluate journal usage". Journal of informetrics, v. 5, n. 3, pp. 446-457. http://dx.doi.org/10.1016/j.joi.2011.04.002
52. Hefce (2015). The metric tide: Correlation analysis of REF2014 scores and metrics. Supplementary Report II to the Independent review of the role of metrics in research assessment and management. Hefce. http://dx.doi.org/10.13140/RG.2.1.3362.4162
53. Henzinger, Monika; Suñol, Jacob; Weber, Ingmar (2009). "The stability of the h-index". Scientometrics, 84, pp. 465-479. http://dx.doi.org/10.1007/s11192-009-0098-7
54. Herrera, Gail (2011). "Google Scholar users and user behaviors: An exploratory study". College and research libraries, v. 72, n. 4, pp. 316-331. http://dx.doi.org/10.5860/crl-125rl
55. Hicks, Diana (1999). "The difficulty of achieving full coverage of international social science literature and the bibliometric consequences". Scientometrics, v. 44, n. 2, pp. 193-215. http://dx.doi.org/10.1007/BF02457380
56. Hightower, Christy; Caldwell, Christy (2010). "Shifting sands: Science researchers on Google Scholar, Web of Science, and PubMed, with implications for library collections budgets". Issues in science and technology librarianship, 63. http://dx.doi.org/10.5062/F4V40S4J http://www.istl.org/10-fall/refereed3.html
57. Huang, Mu-hsuan; Chang, Yu-wei (2008). "Characteristics of research output in social sciences and humanities: from a research evaluation perspective". Journal of the American Society for Information Science and Technology, v. 59, n. 11, pp. 1819-1828. http://dx.doi.org/10.1002/asi.20885
58. Ingwersen, Peter (1998). "The calculation of Web impact factors". Journal of documentation, v. 54, n. 2, pp. 236-243. http://dx.doi.org/10.1108/EUM0000000007167
59. Jacsó, Péter (2006). "Deflated, inflated and phantom citation counts". Online information review, v. 30, n. 3, pp. 297-309. http://dx.doi.org/10.1108/14684520610675816
60. Jacsó, Péter (2008a). "Google Scholar revisited". Online information review, v. 32, n. 1, pp. 102-114. http://dx.doi.org/10.1108/14684520810866010
61. Jacsó, Péter (2008b). "The pros and cons of computing the h-index using Scopus". Online information review, v. 32, n. 4, pp. 524-535. http://dx.doi.org/10.1108/14684520810897403
62. Jacsó, Péter (2008c). "Testing the calculation of a realistic h-index in Google Scholar, Scopus, and Web of Science for F. W. Lancaster". Library trends, v. 56, n. 4, pp. 784-815. https://goo.gl/BshryH
63. Jacsó, Péter (2010). "Metadata mega mess in Google Scholar". Online information review, v. 34, n. 1, pp. 175-191. http://dx.doi.org/10.1108/14684521011024191
64. Jacsó, Péter (2011). "Google Scholar duped and deduped-the aura of 'robometrics'". Online information review, v. 35, n. 1, pp. 154-160. http://dx.doi.org/10.1108/14684521111113632
65. Khabsa, Madian; Giles, C. Lee (2014). "The number of scholarly documents on the public web". PLoS one, v. 9, n. 5: e93949. http://dx.doi.org/10.1371/journal.pone.0093949
66. Kirkup, Gill (2010). "Academic blogging: Academic practice and academic identity". London review of education, v. 8, n. 1, pp. 75-84. http://oro.open.ac.uk/20714/1/Academic-blogging-ORO.pdf
67. Kjellberg, Sara (2010). "I am a blogging researcher: Motivations for blogging in a scholarly context". First Monday, v. 15, n. 8. http://firstmonday.org/article/view/2962/2580
68. Kling, Rob; McKim, Geoffrey (1999). "Scholarly communication and the continuum of electronic publishing". Journal of the American Society for Information Science, v. 50, n. 10, pp. 890-906. http://dx.doi.org/10.1002/(SICI)1097-4571(1999)50:10<890::AIDASI6> 3.0.CO;2-8
69. Kling, Rob; McKim, Geoffrey (2000). "Not just a matter of time: Field differences and the shaping of electronic media in supporting scientific communication". Journal of the American Society for Information Science and Technology, v. 51, n. 14, pp. 1306-1320. http://dx.doi.org/10.1002/1097-4571(2000)9999:9999<::AIDASI1047> 3.0.CO;2-T
70. Kousha, Kayvan; Thelwall, Mike (2006). "Motivations for URL citations to open access library and information science articles". Scientometrics, v. 68, n. 3, pp. 501-517. http://dx.doi.org/10.1007/s11192-006-0126-9
71. Kousha, Kayvan; Thelwall, Mike (2007a). "Google Scholar citations and Google Web/URL citations: A multi-discipline exploratory analysis". Journal of the American Society for Information Science and Technology, v. 58, n. 7, pp. 1055-1065. http://dx.doi.org/10.1002/asi.20584
72. Kousha, Kayvan; Thelwall, Mike (2007b). "How is science cited on the web? A classification of Google unique web citations". Journal of the American Society for Information Science and Technology, v. 58, n. 11, pp. 1631-1644. http://dx.doi.org/10.1002/asi.20649
73. Kousha, Kayvan; Thelwall, Mike (2008). "Assessing the impact of disciplinary research on teaching: An automatic analysis of online syllabuses". Journal of the American Association for Information Science and Technology, v. 59, n. 13, pp. 2060-2069. http://dx.doi.org/10.1002/asi.20920
74. Kousha, Kayvan; Thelwall, Mike (2008). "Sources of Google Scholar citations outside the Science Citation Index: A comparison between four science disciplines". Scientometrics, v. 74, n. 2, pp. 273-294. http://dx.doi.org/10.1007/s11192-008-0217-x
75. Kousha, Kayvan; Thelwall, Mike (2014). "Web impact metrics for research assessment". In: B. Cronin & C.R. Sugimoto, (Eds), Beyond Bibliometrics: Harnessing Multidimensional Indicators of Scholarly Impact. MIT Press. ISBN: 978 0262525510
76. Kousha, Kayvan; Thelwall, Mike (2015). "An automatic method for assessing the teaching impact of books from online academic syllabi". Journal of the Association for Information Science and Technology. http://dx.doi.org/10.1002/asi.23542
77. Kousha, Kayvan; Thelwall, Mike (in press). "Patent citation analysis with Google". Journal of the Association for Information Science and Technology. http://onlinelibrary.wiley.com/journal/10.1002/(ISSN)2330-1643
78. Kousha, Kayvan; Thelwall, Mike; Rezaie, Somayeh (2010). "Using the web for research evaluation: The integrated online impact indicator". Journal of informetrics, v. 4, n. 1, pp. 124-135. http://dx.doi.org/10.1016/j.joi.2009.10.003
79. Kousha, Kayvan; Thelwall, Mike; Rezaie, Somayeh (2011). "Assessing the citation impact of books: The role of Google Books, Google Scholar, and Scopus". Journal of the American Society for Information Science and Technology, v. 62, n. 11, pp. 2147-2164. http://dx.doi.org/10.1002/asi.21608
80. Kovic, Ivor; Lulic, Ileana; Brumini, Gordana (2008). "Examining the medical blogosphere: an online survey of medical bloggers". Journal of medical internet research, v. 10, n. 3, e28. http://dx.doi.org/10.2196/jmir.1118
81. Kryl, David; Allen, Liz; Dolby, Kevin; Sherbon, Beverley; Viney, Ian (2012). "Tracking the impact of research on policy and practice: investigating the feasibility of using citations in clinical guidelines for research evaluation". BMJ open, v. 2, n. 2, e000897. http://dx.doi.org/10.1136/bmjopen-2012-000897
82. Kulkarni, Abhaya V.; Aziz, Brittany; Shams, Iffat; Busse, Jason W. (2009). "Comparisons of citations in Web of Science, Scopus, and Google Scholar for articles published in general medical journals". JAMA-Journal of the American Medical Association, v. 302, n. 10, pp. 1092-1096. http://dx.doi.org/10.1001/jama.2009.1307
83. Kurtz, Michael J.; Bollen, Johan (2010). "Usage bibliometrics". Annual Review of Information Science and Technology, 44, pp. 1-64. http://dx.doi.org/10.1002/aris.2010.1440440108
84. Kurtz, Michael J.; Eichhorn, Guenther; Accomazzi, Alberto; Grant, Carolyn; Demleitner, Markus; Murray, Stephen S.; Martimbeau, Natalie; Elwell, Barbara (2005). "The bibliometric properties of article readership information". Journal of the American Society for Information Science and Technology, v. 56, n. 2, pp. 111-128. http://dx.doi.org/10.1002/asi.20096
85. Labbé, Ciryl; Labbé, Dominique (2013). "Duplicate and fake publications in the scientific literature: How many SCIgen papers in computer science?". Scientometrics, v. 94, n. 1, pp. 379-396. http://dx.doi.org/10.1007/s11192-012-0781-y
86. Larivière, Vincent; Gingras, Yves (2010). "Brief communication: The impact factor's Matthew effect: A natural experiment in bibliometrics". Journal of the American Society for Information Science and Technology, v. 61, n. 2, pp. 424-427. http://dx.doi.org/10.1002/asi.21232
87. Larsen, Peder-Olesen; Von-Ins, Markus (2010). "The rate of growth in scientific publication and the decline in coverage provided by Science Citation Index". Scientometrics, v. 84, n. 3, pp. 575-603. http://dx.doi.org/10.1007/s11192-010-0202-z
88. Lasda-Bergman, Elaine M. (2012). "Finding citations to social work literature: The relative benefits of using Web of Science, Scopus, or Google Scholar". Journal of academic librarianship, v. 38, n. 6, pp. 370-379. http://dx.doi.org/10.1016/j.acalib.2012.08.002
89. Lee, Carole J.; Sugimoto, Cassidy R.; Zhang, Guo; Cronin, Blaise (2013). "Bias in peer review". Journal of the American Society for Information Science and Technology, v. 64, n. 1, pp. 2-17. http://dx.doi.org/10.1002/asi.22784
90. Lisée, Cynthia; Larivière, Vincent; Archambault, Éric (2008). "Conference proceedings as a source of scientific information: A bibliometric analysis". Journal of the American Society for Information Science and Technology, v. 59, n. 11, pp. 1776-1784. http://dx.doi.org/10.1002/asi.20888
91. Luzón, María-José (2007). "Academic weblogs as tools for e-collaboration among researchers". In N. Kock (Ed.), Encyclopedia of e-collaboration, pp. 1-6. New York: Idea Group.
92. Luzón, María-José (2009). "Scholarly hyperwriting: The function of links in academic weblogs". Journal of the American Society for Information Science and Technology, v. 60, n. 1, pp. 75-89. http://dx.doi.org/10.1002/asi.20937
93. MacRoberts, Michael H.; MacRoberts, Barbara R. (1989). "Problems of citation analysis: A critical review". Journal of the American Society for Information Science, v. 40, n. 5, pp. 342-349. http://dx.doi.org/10.1002/(SICI)1097-4571(198909)40:5<342::AIDASI7> 3.0.CO;2-U
94. MacRoberts, Michael H.; MacRoberts, Barbara R. (1996). "Problems of citation analysis". Scientometrics, v. 36, n. 3, pp. 435-444. http://dx.doi.org/10.1007/BF02129604
95. Mahdi, Surya; D'Este, Pablo; Neely, Andy D. (2008). Citation counts: Are they good predictors of RAE scores? London: Advanced Institute of Management Research. http://www.aimresearch.org/uploads/File/Publications/Academic%20Publications%202/Citations-Counts.pdf
96. Manchikanti, Laxmaiah; Benyamin, Ramsin M.; Falco, Frank J. E.; Caraway, David L.; Datta, Sukdeb; Hirsch, Joshua A. (2012). "Guidelines warfare over interventional techniques: is there a lack of discourse or straw man?". Pain physician, v. 15, E1-E26. http://www.painphysicianjournal.com/current/pdf?article= MTU2MQ%3D%3D&journal=65
97. Mayr, Philipp; Walter, Anne-Kathrin (2007). "An exploratory study of Google Scholar". Online information review, v. 31, n. 6, pp. 814-830. http://dx.doi.org/10.1108/14684520710841784
98. McDonald, John D. (2007). "Understanding journal usage: A statistical analysis of citation and use". Journal of the American Society for Information Science and Technology, v. 58, n. 1, pp. 39-50. http://dx.doi.org/10.1002/asi.20420
99. Meho, Lokman I.; Rogers, Yvonne (2008). "Citation counting, citation ranking, and h-index of human-computer interaction researchers: A comparison of Scopus and Web of Science". Journal of the American Society for Information Science and Technology, v. 59, n. 11, pp. 1711-1726. http://dx.doi.org/10.1002/asi.20874
100. Meho, Lokman I.; Yang, Kiduk (2007). "Impact of data sources on citation counts and rankings of LIS faculty: Web of Science versus Scopus and Google Scholar". Journal of the American Society for Information Science and Technology, v. 58, n. 13, pp. 2105-2125. http://dx.doi.org/10.1002/asi.20677
101. Mewburn, Inger; Thomson, Pat (2013). "Why do academics blog? An analysis of audiences, purposes and challenges". Studies in higher education, v. 38, n. 8, pp. 1105-1119. http://dx.doi.org/10.1080/03075079.2013.835624
102. Meyer, Martin S. (2000a). "What is special about patent citations? Differences between scientific and patent citations". Scientometrics, v. 49, n. 1, pp. 93-123. http://dx.doi.org/10.1023/A:1005613325648
103. Meyer, Martin S. (2000b). "Patent citations in a novel field of technology-What can they tell about interactions between emerging communities of science and technology?". Scientometrics, v. 48, n. 2, pp. 151-178. http://dx.doi.org/10.1023/A:1005692621105
104. Meyer, Martin S. (2001). "Patent citation analysis in a novel field of technology-An exploration of nano-science and nano-technology". Scientometrics, v. 51, n. 1, pp. 163-183. http://dx.doi.org/10.1023/A:1010572914033
105. Meyer, Martin S. (2002). "Tracing knowledge flows in innovation systems". Scientometrics, v. 54, n. 2, pp. 193-212. http://dx.doi.org/10.1023/A:1016057727209
106. Mikki, Susanne (2010). "Comparing Google Scholar and ISI Web of Science for earth sciences". Scientometrics, v. 82, n. 2, pp. 321-331. http://dx.doi.org/10.1007/s11192-009-0038-6
107. Minasny, Budiman; Hartemink, Alfred E.; McBratney, Alex; Jang, Ho-Jun (2013). "Citations and the h index of soil researchers and journals in the Web of Science, Scopus, and Google Scholar". PeerJ 1:e183. http://dx.doi.org/10.7717/peerj.183
108. Mingers, John; Lipitakis, Evangelina A. E. C. G. (2010). "Counting the citations: A comparison of Web of Science and Google Scholar in the field of business and management". Scientometrics, v. 85, n. 2, pp. 613-625. http://dx.doi.org/10.1007/s11192-010-0270-0
109. Mishra, Jennifer; Day, Kiana; Littles, Dan; Vandewalker, Eddie (2011). "A content analysis of introductory courses in music education at NASM-accredited colleges and universities". Bulletin of the Council for Research in Music Education, n. 190, pp. 7-19.
110. Moed, Henk F. (2005a). Citation analysis in research evaluation. New York, New York: Springer. ISBN: 978 1402037139
111. Moed, Henk F. (2005b). "Statistical relationships between downloads and citations at the level of individual documents within a single journal". Journal of the American Society for Information Science and Technology, v. 56, n. 10, pp. 1088-1097. http://dx.doi.org/10.1002/asi.20200
112. Mortensen, Torill; Walker, Jill (2002). "Blogging thoughts: Personal publication as an online research tool". In: A. Morrison (ed.) Researching ICTs in Context, pp. 249-479. Oslo: Intermedia. http://possibleworlds.blogs.com/blogsperiment/files/Researching-ICTs-in-context-Ch11-Mortensen-Walker.pdf
113. Nederhof, Anton J. (2006). "Bibliometric monitoring of research performance in the social sciences and the humanities: A review". Scientometrics, v. 66, n. 1, pp. 81-100. http://dx.doi.org/10.1007/s11192-006-0007-2
114. Nielsen, Finn-Årup (2007). "Scientific citations in Wikipedia". First Monday, v. 12, n. 8. http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/1997/1872
115. Norris, Michael; Oppenheim, Charles (2007). "Comparing alternatives to the Web of Science for coverage of the social sciences' literature". Journal of informetrics, v. 1, n. 2, pp. 161-169. http://dx.doi.org/10.1016/j.joi.2006.12.001
116. Oppenheim, Charles (2000). "Do patent citations count?" In: B. Cronin; H. B. Atkins (Eds.). The web of knowledge: A festschrift in honor of Eugene Garfield, pp. 405-432. Metford, NJ. Information Today Inc. ISBN: 978 1 57387 099 3
117. Orduña-Malea, Enrique; Ayllón, Juan M.; Martín-Martín, Alberto; Delgado-López-Cózar, Emilio (2015). "Methods for estimating the size of Google Scholar". Scientometrics, v. 104, n. 3, pp. 931-949. http://dx.doi.org/10.1007/s11192-015-1614-6
118. Orduña-Malea, Enrique; Delgado-López-Cózar, Emilio (2014). "Google Scholar metrics evolution: An analysis according to languages". Scientometrics, v. 98, n. 3, pp. 2353-2367. http://dx.doi.org/10.1007/s11192-013-1164-8
119. Ortega, José-Luis; Aguillo, Isidro F. (2012). "Science is all in the eye of the beholder: Keyword maps in Google Scholar citations". Journal of the American Society for Information Science and Technology, v. 63, n. 12, pp. 2370-2377. http://dx.doi.org/10.1002/asi.22761
120. Ortega, José-Luis; Aguillo, Isidro F. (2014). "Microsoft academic search and Google Scholar citations: Comparative analysis of author profiles". Journal of the Association for Information Science and Technology, v. 65, n. 6, pp. 1149-1156. http://dx.doi.org/10.1002/asi.23036
121. Pieterse, Alex L.; Evans, Sarah A.; Risner-Butner, Amelia; Collins, Noah M.; Mason, Laura-Beth (2009). "Multicultural competence and social justice training in counseling psychology and counselor education: A review and analysis of a sample of multicultural course syllabi". Counseling psychologist, v. 37, n. 1, pp. 93-115. http://dx.doi.org/10.1177/0011000008319986
122. Priem, Jason; Piwowar, Heather; Hemminger, Bradley M. (2012). Altmetrics in the wild: Using social media to explore scholarly impact. http://arXiv.org/html/1203.4745v1
123. Priem, Jason; Taraborelli, Dario; Groth, Paul; Neylon, Cameron (2010). Altmetrics: A manifesto. http://altmetrics.org/manifesto
124. Puschmann, Cornelius; Mahrt, Merja (2012). "Scholarly blogging: A new form of publishing or science journalism 2.0?" In: A. Tokar, M.; Beurskens, S.; Keuneke, M.; Mahrt, I.; Peters, C.; Puschmann, K.; Weller; T. van Treeck (Eds.) Science and the Internet, pp. 171-182. Düsseldorf: Düsseldorf University Press. http://journals.lub.lu.se/index.php/sciecominfo/article/view/7292/6102
125. REF (2011). Decisions on assessing research impact. h t t p: //w w w. r e f. a c. u k /m e d i a /r e f /c o n t e n t /p u b /decisionsonassessingresearchimpact/01-11.pdf
126. REF (2012). Panel criteria and working methods. h t t p: //w w w. r e f. a c. u k /m e d i a /r e f /c o n t e n t /p u b /panelcriteriaandworkingmethods/01-12.doc
127. Rousseau, Ronald (1997). "Sitations: An exploratory study". Cybermetrics, v. 1, n. 1. http://cybermetrics.cindoc.csic.es/articles/v1i1p1.html
128. Rowlands, Ian; Nicholas, David (2007). "The missing link: Journal usage metrics". In: Aslib proceedings: New information perspectives, v. 59, n. 3, pp. 222-228. http://dx.doi.org/10.1108/00012530710752025
129. Schloegl, Christian; Gorraiz, Juan (2010). "Comparison of citation and usage indicators: The case of oncology journals". Scientometrics, v. 82, n. 3, pp. 567-580. http://dx.doi.org/10.1007/s11192-010-0172-1
130. Schonfeld, Roger C.; Housewright, Ross (2010). Faculty survey 2009: Key strategic insights for libraries, publishers, and societies. Ithaka S+R, New York, NY. http://www.sr.ithaka.org/sites/default/files/reports/Faculty-Study-2009.pdf
131. Seglen, Per O. (1997). "Why the impact factor of journals should not be used for evaluating research". British medical journal, v. 314, n. 7079, pp. 498-502. http://dx.doi.org/10.1136/bmj.314.7079.497
132. Shelton, Robert-Duane; Fadel, Tarek R.; Foland, Patricia (2015). "Causal connections between scientometric indicators: Which ones best explain high-technology manufacturing outputs?" In: Proceedings of ISSI 2015-15th Intl conf of the International Society for Scientometrics and Informetrics. Istanbul, Turkey: Boʇaziçi University Printhouse, pp. 662-672.
133. Shema, Hadas; Bar-Ilan, Judit; Thelwall, Mike (2012). "Research blogs and the discussion of scholarly information". PLoS one, v. 7, n. 5. http://dx.doi.org/10.1371/journal.pone.0035869
134. Shema, Hadas; Bar-Ilan, Judit; Thelwall, Mike (2014). "Do blog citations correlate with a higher number of future citations? Research blogs as a potential source for alternative metrics". Journal of the Association for Information Science and Technology, v. 65, n. 5, pp. 1018-1027. http://dx.doi.org/10.1002/asi.23037
135. Smith, Alastair G. (1999). "A tale of two Web spaces: Comparing sites using Web impact factors". Journal of documentation, v. 55, n. 5, pp. 577-592.
136. Smith, Alastair G.; Thelwall, Mike (2002). "Web impact factors for Australasian universities". Scientometrics, v. 54, n. 3, pp. 363-380. http://dx.doi.org/10.1023/A:1016030415822
137. Sombatsompop, Narongrit; Markpin, Teerasak (2005). "Making an equality of ISI impact factors for different subject fields". Journal of the American Society for Information Science and Technology, v. 56, n. 7, pp. 676-683. http://dx.doi.org/10.1002/asi.20150
138. Stankus, Tony; Rice, Barbara E. (1982). "Handle with care: Use and citation data for science journal management". Collection management, v. 4, n. 1-2, pp. 95-110. http://dx.doi.org/10.1300/J105v04n01-07
139. Stankus, Tony; Spiegel, Sarah E. (2010). "Wikipedia, scholarpedia, and references to books in the brain and behavioral sciences: A comparison of cited sources and recommended readings in matching free online encyclopedia entries". Science & technology libraries, v. 29, n. 1-2, pp. 144-164. http://dx.doi.org/10.1080/01942620903579435
140. Su, Leona-Yi-Fan; Akin, Heather E.; Brossard, Dominique E.; Scheufele, Dietram A.; Xenos, Michael A. (2015). "Science news consumption patterns and their implications for public understanding of science". Journalism & mass communication quarterly. http://dx.doi.org/10.1177/1077699015586415
141. Sud, Pardeep; Thelwall, Mike (2014a). "Linked title mentions: A new automated link search candidate". Scientometrics, v. 101, n. 3, pp. 1831-1849. http://dx.doi.org/10.1007/s11192-014-1374-8
142. Sud, Pardeep; Thelwall, Mike (2014b). "Evaluating altmetrics". Scientometrics, v. 98, n. 2, pp. 1131-1143. http://dx.doi.org/10.1007/s11192-013-1117-2
143. Taylor, Jim; Walker, Ian (2009). "Peer assessment of research: How many publications per staff?". Lancaster University Management School, Working Paper 2009/035. http://eprints.lancs.ac.uk/31757/1/006236.pdf
144. Thelwall, Mike (2001). "Extracting macroscopic information from web links". Journal of the American Society for Information Science and Technology, v. 52, n. 13, pp. 1157-1168. http://dx.doi.org/10.1002/asi.1182
145. Thelwall, Mike (2012). "Journal impact evaluation: A webometric perspective". Scientometrics, v. 92, n. 2, pp. 429-441. http://dx.doi.org/10.1007/s11192-012-0669-x
146. Thelwall, Mike; Fairclough, Ruth (2015). "The influence of time and discipline on the magnitude of correlations between citation counts and quality scores". Journal of informetrics, v. 9, n. 3, pp. 529-541. http://dx.doi.org/10.1016/j.joi.2015.05.006
147. Thelwall, Mike; Harries, Gareth (2003). "The connection between the research of a university and counts of links to its web pages: An investigation based upon a classification of the relationships of pages to the research of the host university". Journal of the American Society for Information Science and Technology, v. 54, n. 7, pp. 594-602. http://dx.doi.org/10.1002/asi.10161
148. Thelwall, Mike; Haustein, Stefanie; Larivière, Vincent; Sugimoto, Cassidy R. (2013). "Do altmetrics work? Twitter and ten other candidates". PLoS one, v. 8, n. 5, e64841. http://dx.doi.org/10.1371/journal.pone.0064841
149. Thelwall, Mike; Kousha, Kayvan (2008). "Online presentations as a source of scientific impact? An analysis of Power-Point files citing academic journals". Journal of the American Society for Information Science & Technology, v. 59, n. 5, pp. 805-815. http://dx.doi.org/10.1002/asi.20803
150. Thelwall, Mike; Maflahi, Nabeil (in press). "Guideline references and academic citations as evidence of the clinical value of health research". Journal of the Association for Information Science and Technology. http://www.scit.wlv.ac.uk/~cm1993/papers/GuidelineMetricsPreprint. pdf
151. Tsay, Ming-Yueh (1998). "The relationship between journal use in a medical library and citation use". Bulletin of the Medical Library Association, v. 86, n. 1, pp. 31-39. http://www.ncbi.nlm.nih.gov/pmc/articles/PMC226323
152. Van den Bosch, Antal; Bogers, Toine; De Kunder, Maurice (2015). "A longitudinal analysis of search engine index size". In: Proceedings of ISSI 2015-15th Intl conf of the International Society for Scientometrics and Informetrics. Istanbul, Turkey: Boʇaziçi University Printhouse, pp. 71-82.
153. Vaughan, Liwen; Hysen, Kathy (2002). "Relationship between links to journal Web sites and impact factors". Aslib proceedings: New information perspectives, v. 54, n. 6, pp. 356-361. http://dx.doi.org/10.1108/00012530210452555
154. Vaughan, Liwen; Shaw, Debora (2003). "Bibliographic and web citations: What is the difference?". Journal of the American Society for Information Science and Technology, v. 54, n. 14, pp. 1313-1322. http://dx.doi.org/10.1002/asi.10338
155. Vaughan, Liwen; Shaw, Debora (2005). "Web citation data for impact assessment: A comparison of four science disciplines". Journal of the American Society for Information Science and Technology, v. 56, n. 10, pp. 1075-1087. http://dx.doi.org/10.1002/asi.20199
156. Vaughan, Liwen; Shaw, Debora (2008). "A new look at evidence of scholarly citation in citation indexes and from web sources". Scientometrics, v. 74, n. 2, pp. 317-330. http://dx.doi.org/10.1007/s11192-008-0220-2
157. Vaughan, Liwen; Thelwall, Mike (2003). "Scholarly use of the Web: What are the key inducers of links to journal Web sites?". Journal of the American Society for Information Science and Technology, v. 54, n. 1, pp. 29-38. http://dx.doi.org/10.1002/asi.10184
158. Wan, Jin-kun; Hua, Ping-huan; Rousseau, Ronald; Sun, Xiukun (2010). "The journal download immediacy index (DII): Experiences using a Chinese full-text database". Scientometrics, v. 82, n. 3, pp. 555-566. http://dx.doi.org/10.1007/s11192-010-0171-2
159. Warner, Julian (2000). "Critical review of the application of citation studies to the Research Assessment Exercises". Journal of information science, v. 26, n. 6, pp. 453-460 http://dx.doi.org/10.1177/016555150002600607
160. Weller, Ann C. (2001). Editorial peer review: Its strengths and weaknesses. Medford, N. J.: Information Today. ISBN: 1 57387 100 1
161. Whitley, Richard (2000). The intellectual and social organization of the sciences (2 ed.), Oxford: Oxford University Press. ISBN: 0199240450
162. Wilkinson, David; Sud, Pardeep; Thelwall, Mike (2014). "Substance without citation: Evaluating the online impact of grey literature". Scientometrics, v. 98, n. 2, pp. 797-806. http://dx.doi.org/10.1007/s11192-013-1068-7
163. Wouters, Paul et al. (2015). The metric tide: Literature review (Supplementary report I to the independent review of the role of metrics in research assessment and management). Hefce. http://dx.doi.org/10.13140/RG.2.1.5066.3520