The thematic orientation of publications mentioned on social media: Large-scale disciplinary comparison of social media metrics with citations

Aslib Journal of Information Management

Volumn 67, Issue 3, 2015, Pages 260-288

  Costas, Rodrigo ^a   Zahedi, Zohreh ^a   Wouters, Paul ^a  

^a LEIDEN UNIVERSITY   (Netherlands)

Author keywords

Altmetrics; Bibliometrics; Citation analysis; Science indicators; Science mapping; Social media metrics

Indexed keywords

BEHAVIORAL RESEARCH; INTERNET; PUBLISHING; SOCIAL SCIENCES;

ALTMETRICS; BIBLIOMETRICS; CITATION ANALYSIS; SCIENCE INDICATORS; SOCIAL MEDIA;

SOCIAL NETWORKING (ONLINE);

EID: 84929666950     PISSN: 20503806     EISSN: 20503814     Source Type: Journal    
DOI: 10.1108/AJIM-12-2014-0173     Document Type: Article

References (51)

1. Alperin, J.P. (2015), “Altmetrics coverage varies by geographic context”, Aslib Journal of Information Management, Vol. 67 No. e, doi:10.1108/AJIM-12-2014-0176.
2. Bar-Ilan, J., Haustein, S., Peters, I., Priem, J., Shema, H. and Terliesner, J. (2012), “Beyond citations: scholars' visibility on the social web”, Proceedings of the 17th International Conference on Science and Technology Indicators, Repro-UQAM, Montreal, pp. 98-109, available at: http://2012.sticonference.org/Proceedings/vol1/Bar-Ilan_Beyond_98.pdf (accessed March 8, 2015).
3. Bornmann, L. (2013), “What is societal impact of research and how can it be assessed? A literature survey”, Journal of the American Society for Information Science and Technology, Vol. 64 No. 2, pp. 217-233.
4. Bornmann, L. (2014a), “Is there currently a scientific revolution in scientometrics?”, Journal of the Association for Information Science and Technology, Vol. 65 No. 3, pp. 647-648.
5. Bornmann, L. (2014b), “Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics”, Journal of Informetrics, Vol. 8 No. 4, pp. 895-903.
6. Chamberlain, S. (2013), “Consuming article-level metrics: observations and lessons”, Information Standards Quarterly, Vol. 25 No. 2, pp. 4-13.
7. Colquhoun, D. (2014), “Why you should ignore altmetrics and other bibliometric nightmares”, DC's Improbable Science, available at: www.dcscience.net/?p=6369 (accessed March 8, 2015). Costas, R., Zahedi, Z. and Wouters, P. (in press), “Do 'altmetrics' correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective”, Journal of the Association for Information Science and Technology, available at: http://arxiv.org/abs/1401.4321 (accessed March 8, 2015).
8. Costas, R., Zahedi, Z., and Wouters, P. (2015), “The thematic orientation of publications mentioned on social media: large-scale disciplinary comparison of social media metrics with citation”, Supplementary material 1 and 2, available at: Fighshare.com doi:10.6084/ m9.figshare.1335773
9. Crotty, D. (2014), “Altmetrics: mistaking the means for the end”, The Scholarly Kitchen, available at: http://scholarlykitchen.sspnet.org/2014/05/01/altmetrics-mistaking-the-means-for-theend (accessed March 8, 2015).
10. De Winter, J.C.F. (2015), “The relationship between tweets, citations, and article views for PLOS ONE articles”, Scientometrics, Vol. 102 No. 2, pp. 1773-1779.
11. Galligan, F. and Dyas-Correia, S. (2013), “Altmetrics: rethinking the way we measure”, Serials Review, Vol. 39 No. 1, pp. 56-61.
12. Glänzel, W., Schubert, A., Schoepflin, U. and Czerwon, H.J. (1999), “An item-by-item subject classification of papers published in journals covered by the SSCI database using reference analysis”, Scientometrics, Vol. 46 No. 3, pp. 431-441.
13. Groth, P. and Gurney, T. (2010), “Studying scientific discourse on the web using bibliometrics: a chemistry blogging case study”, Web Science Conference 2010, Raleigh, NC, April 26-27, available at: http://journal.webscience.org/308/2/websci10_submission_48.pdf (accessed March 8, 2015).
14. Hammarfelt, B. (2014), “Using altmetrics for assessing research impact in the humanities”, Scientometrics, Vol. 101 No. 2, pp. 1419-1430.
15. Haustein, S., Bowman, T.D. and Costas, R. (2015b), “Interpreting ”altmetrics“: viewing acts on social media through the lens of citation and social theories”, in Sugimoto, C.R. (Ed.), Theories of Informetrics: A Festschrift in Honor of Blaise Cronin, De Gruyter Mouton, Boston, MA, pp. 1-24.
16. Haustein, S., Costas, R. and Larivière, V. (2015a), “Characterizing social media metrics of scholarly papers: the effect of document properties and collaboration patterns”, PloS ONE, Vol. 10 No. 3, p. e0120495, doi: 10.1371/journal.pone.0120495
17. Haustein, S., Larivière, V., Thelwall, M., Amyot, D. and Peters, I. (2014a), “Tweets vs Mendeley readers: how do these two social media metrics differ?”, IT- Information Technology, Vol. 56 No. 5, pp. 207-215.
18. Haustein, S., Peters, I., Sugimoto, C.R., Thelwall, M. and Larivière, V. (2014c), “Tweeting biomedicine: an analysis of tweets and citations in the biomedical literature”, Journal of the Association for Information Sciences and Technology, Vol. 65 No. 4, pp. 656-669.
19. Haustein, S., Bowman, T.D., Holmberg, K., Tsou, A., Sugimoto, C.R. and Larivière, V. (in press), “Tweets as impact indicators: examining the implications of automated ”bot“ accounts on Twitter”, Journal of the Association for Information Science and Technology, available at: http://arxiv.org/abs/1410.4139 (accessed March 8, 2015).
20. Haustein, S., Peters, I., Bar-Ilan, J., Priem, J., Shema, H. and Terliesner, J. (2014b), “Coverage and adoption of altmetrics sources in the bibliometric community”, Scientometrics, Vol. 101 No. 2, pp. 1145-1163.
21. Herranz, N. and Ruiz-Castillo, J. (2012), “Multiplicative and fractional strategies when journals are assigned to several subfields”, Journal of the American Society for Information Science and Technology, Vol. 63 No. 11, pp. 2195-2205.
22. Khodiyar, V.K., Rowlett, K.a. and Lawrence, R.N. (2014), “Altmetrics as a means of assessing scholarly output”, Learned Publishing, Vol. 27 No. 5, pp. 25-32.
23. Kwok, R. (2012), “Research impact: altmetricsmake theirmark”, Nature, Vol. 500 No. 7463, pp. 491-493.
24. Li, X., Thelwall, M. and Giustini, D. (2011), “Validating online reference managers for scholarly impact measurement”, Scientometrics, Vol. 91 No. 2, pp. 461-471.
25. Mas-Bleda, A., Thelwall, M., Kousha, K. and Aguillo, I.F. (2014), “Do highly cited researchers successfully use the social web?”, Scientometrics, Vol. 101 No. 1, pp. 337-356.
26. Moed, H.F. (2005), Citation Analysis in Research Evaluation, Springer, Dordrecht.
27. Mohammadi, E. and Thelwall, M. (2014), “Mendeley readership altmetrics for the social sciences and humanities: research evaluation and knowledge flows”, Journal of the Association for Information Science and Technology, Vol. 65 No. 8, pp. 1627-1638.
28. Nederhof, A.J. (2006), “Bibliometric monitoring of research performance in the social sciences and the humanities: a review”, Scientometrics, Vol. 66 No. 1, pp. 81-100.
29. Neylon, C. (2014), “Altmetrics can signal flows of information for paths in scholarly communication not yet mapped”, available at: http://blogs.lse.ac.uk/impactofsocialsciences/ 2014/10/07/altmetrics-what-are-they-good-for/ (accessed March 8, 2015).
30. Nicolaisen, J. (2007), “Citation analysis”, Annual Review of Information Science and Technology, Vol. 41 No. 1, pp. 609-641.
31. Peters, I., Jobmann, A., Eppelin, A., Hoffmann, C.P., Künne, S. and Wollnik-Korn, G. (2014), “Altmetrics for large, multidisciplinary research groups: a case study of the Leibniz association”, Proceedings of the Libraries in the Digital Age Conference, Vol. 13, University of Zadar, Zadar, June 16-20, available at: http://ozk.unizd.hr/proceedings/index.php/lida/ article/view/162/138 (accessed March 8, 2015).
32. Piwowar, H. (2013), “Introduction altmetrics: what, why and where?”, Bulletin of the American Society for Information Science and Technology, Vol. 39, April, pp. 8-9.
33. Priem, J., Piwowar, H.A. and Hemminger, B.M. (2012b), “Altmetrics in the wild: using social media to explore scholarly impact”, available at: http://arxiv.org/abs/1203.4745 (accessed March 8, 2015).
34. Priem, J., Taraborelli, D., Groth, P. and Neylon, C. (2010), “Alt-metrics: a manifesto”, available at: http://altmetrics.org/manifesto/ (accessed March 8, 2015).
35. Priem, J., Parra, C., Piwowar, H., Groth, P. and Waagmeester, A. (2012a), “Uncovering impacts: a case study in using altmetrics tools”, in Garcia Castro, A., Lange, C., van Harmelen, F. and Good, B. (Eds), Proceedings of the 2nd Workshop on Semantic Publishing, Hersonissos, Crete, pp. 1-5.
36. Robinson-García, N., Torres-Salinas, D., Zahedi, Z. and Costas, R. (2014), “New data, new possibilities: exploring the insides of Altmetric.com”, El Profesional de la Informacion, Vol. 23 No. 4, pp. 359-366.
37. Rousseau, R. and Ye, F.Y. (2013), “A multi-metric approach for research evaluation”, Chinese Science Bulletin, Vol. 58 No. 26, pp. 3288-3290.
38. Shema, H., Bar-Ilan, J. and Thelwall, M. (2012), “Research blogs and the discussion of scholarly information”, PloS ONE, Vol. 7 No. 5, p. e35869.
39. Thelwall, M. and Maflahi, N. (in press), “Are scholarly articles disproportionately read in their own country? An analysis of Mendeley readers”, Journal of the Association for Information Science and Technology, doi:10.1002/asi.23252.
40. Torres-Salinas, D., Cabezas-Clavijo, Á. and Jiménez-Contreras, E. (2013), “Altmetrics: new indicators for scientific communication in web 2.0”, Comunicar, Vol. 21 No. 41, pp. 53-60.
41. Van Eck, N.J. and Waltman, L. (2010), “Software survey: VOSviewer, a computer program for bibliometric mapping”, Scientometrics, Vol. 84 No. 2, pp. 523-538.
42. Van Eck, N.J. and Waltman, L. (2011), “Text mining and visualization using VOSviewer”, ISSI Newsletter, Vol. 7 No. 3, pp. 50-54.
43. Waltman, L. and Costas, R. (2014), “F1000 recommendations as a potential new data source for research evaluation: A comparison with citations”, Journal of the Association for Information Science and Technology, Vol. 65 No. 3, pp. 433-445.
44. Wouters, P. (2014), “The citation: from culture to infrastructure”, in Cronin, B. and Sugimoto, C.R. (Eds), Beyond Bibliometrics: Harnessing Multi-dimensional Indicators of Performance, MIT Press, Cambridge, MA, pp. 48-66.
45. Wouters, P. and Costas, R. (2012), Users, Narcissism and Control - Tracking the Impact of Scholarly Publications in the 21st Century, SURFfoundation, Utrecht, available at: www. surf.nl/binaries/content/assets/surf/en/knowledgebase/2011/Users+narcissism+and +control.pdf (accessed March 8, 2015).
46. Zahedi, Z. and van Eck, N.J. (2014), “Visualizing readership activity of Mendeley users using VOSviewer”, Altmetrics14: Expanding Impacts and Metrics, Workshop at Web Science Conference 2014, Bloomington, IN, June 23, doi:10.6084/m9.figshare.1041819.
47. Zahedi, Z., Costas, R. and Wouters, P. (2014), “How well developed are altmetrics? A crossdisciplinary analysis of the presence of 'alternative metrics' in scientific publications”, Scientometrics, Vol. 101 No. 2, pp. 1491-1513.
48. Zahedi, Z., Fenner, M. and Costas, R. (2014), “How consistent are altmetrics providers? Study of 1000 PLOS ONE publications using the PLOS ALM, Mendeley and Altmetric.com APIs”, Altmetrics14: Expanding Impacts and Metrics, Workshop at Web Science Conference 2014, Bloomington, IN, June 23, doi:10.6084/m9.figshare.1041821.
49. Zhu, Y. and Procter, R. (2012), “Use of blogs, Twitter and Facebook by PhD students for scholarly communication: a UK study”, China New Media Communication Annual Conference, Macao, available at: www.escholar.manchester.ac.uk/item/?pid=uk-ac-man-scw:187789 (accessed March 8, 2015).
50. Zuccala, A., Verleysen, F. and Engels, T. (2014), “The societal impact of history texts: Lay readership and the 'altmetric' value of goodreads”, 19th Nordic Workshop on Bibliometrics and Research Policy Reykjavik, University of Iceland, Reykjavik, available at: www.rannis. is/media/erindi-fyrirlesara/8-NordicWorkshop-Zuccala-et-al-15-06-14.pdf
51. Zuccala, A., Verleysen, F., Cornacchia, R. and Engels, T. (2015), “Altmetrics for the humanities: comparing goodreads reader ratings with citations to history books”, Aslib Journal of Information Management, Vol. 67 No. 3, doi: 10.1108/AJIM-11-2014-0152.