Do "altmetrics" correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective

Journal of the Association for Information Science and Technology

Volumn 66, Issue 10, 2015, Pages 2003-2019

  Costas, Rodrigo ^a   Zahedi, Zohreh ^a   Wouters, Paul ^a  

^a LEIDEN UNIVERSITY   (Netherlands)

Author keywords

bibliometrics; databases

Indexed keywords

DATABASE SYSTEMS; SOCIAL NETWORKING (ONLINE);

BIBLIOMETRICS; CITATION ANALYSIS; COMPLEMENTARY TOOLS; MULTIDISCIPLINARY PERSPECTIVES; POSITIVE CORRELATIONS; RESEARCH EVALUATION; SCIENTIFIC FIELDS; SCIENTIFIC PUBLICATIONS;

PUBLISHING;

BIOMEDICINE; CITATION ANALYSIS; FILTRATION; HUMAN; HUMANITIES; PUBLICATION; RECALL; SOCIAL MEDIA; SOCIOLOGY;

EID: 84924998893     PISSN: 23301635     EISSN: 23301643     Source Type: Journal    
DOI: 10.1002/asi.23309     Document Type: Article

References (30)

1. Adie, E., &, Roe, W., (2013). Altmetric: Enriching scholarly content with article-level discussion and metrics. Learned Publishing, 26 (1), 11-17.
2. Bar-Ilan, J., (2012). JASIST@ Mendeley. Presented at ACM Web Science Conference Workshop on Altmetrics, Evanston, IL, 21 June 2012. Retrieved from: http://altmetrics.org/altmetrics12/bar-ilan/
3. Bar-Ilan, J., Haustein, S., Peters, I., Priem, J., Shema, H., &, Terliesner, J., (2012). Beyond citations: Scholars' visibility on the social Web. In Proceedings of the 17th International Conference on Science and Technology Indicators, Montreal, Quebec, Canada. Retrieved from http://arxiv.org/abs/1205.5611/
4. Costas, R., van Leeuwen, T.N., &, Bordons, M., (2010a). A bibliometric classificatory approach for the study and assessment of research performance at the individual level: The effects of age on productivity and impact. Journal of the American Society for Information Science and Technology, 61, 1564-1581.
5. Costas, R., Van Leeuwen, T.N., &, Bordons, M., (2010b). Self-citations at the meso and individual levels: effects of different calculation methods. Scientometrics, 82 (3), 517-537.
6. Cronin, B., &, Weaver, S., (1995). The praxis of acknowledgements: From bibliometrics to influmetrics. Revista Española de Documentaciõn Científica, 18 (2), 172-177.
7. Galligan, F., &, Dyas-Correia, S., (2013). Altmetrics: Rethinking the way we measure. Serials Review, 39 (1): 56-61.
8. Groth, P., &, Gurney, T., (2010). Studying scientific discourse on the Web using bibliometrics: A chemistry blogging case study. Presented at the WebSci10: Extending the Frontiers of Society On-Line. Raleigh, NC. Retrieved from: http://wiki.few.vu.nl/sms/images/9/9c/Websci10-FINAL-29-4-2010f.pdf
9. Haustein, S., Peters, I., Sugimoto, C.R., Thelwall, M., &, Larivière, V., (2014). Tweeting biomedicine: an analysis of tweets and citations in the biomedical literature. Journal of the American Society for Information Science and Technology, 65 (4), 656-669.
10. Haustein, S., Thelwall, M., Larivière, V., &, Sugimoto, C.R., (2013). On the relation between altmetrics and citations in medicine (RIP). In S. Hinze, & A. Lottmann (Eds.), Proceedings of the 18th International Conference on Science and Technology Indicators (STI), Berlin, Germany, September 4-6 (pp. 164-166).
11. Heneberg, P., (2013). effects of print publication lag in dual format journals on scientometric indicators. PloS one, 8 (4), e59877.
12. Moed, H.F., (2007). The effect of "open access" on citation impact: An analysis of ArXiv's condensed matter section. Journal of American Society for Information Science & Technology, 58, 2047-2054.
13. Piwowar, H., (2013). Value all research products. Nature, 493 (159), 2013.
14. Piwowar, H., &, Priem, J., (2013), The power of altmetrics on a CV. Bulletin of Association for Information Science and Technology, 39, 10-13.
15. Priem, J., Piwowar, H., &, Hemminger, B., (2012a). Altmetrics in the wild: Using social media to explore scholarly impact. Retrieved from: http://arxiv.org/html/1203.4745v1
16. Priem, J., Taraborelli, D., Groth, P., &, Neylon, C., (2010b). Altmetrics: A manifesto. Retrieved from: http://altmetrics.org/manifesto/
17. Rousseau, R., &, Ye, F., (2013). A multi-metric approach for research evaluation. Chinese Science Bulletin, 10-12.
18. Schmidt, M., (2012). Development and evaluation of a match key for linking references to cited articles. In Proceedings of the 17th International Conference on Science and Technology Indicators, Montréal; Science-Metrix and OST, Volume 2 (pp. 707-718).
19. Seglen, P.O., (1997). Why the impact factor of journals should not be used for evaluating research. British Medical Journal, 314, 498-502. Retrieved from http://bmj.bmjjournals.com/cgi/content/full/314/7079/497
20. Shema, H., Bar-Ilan, J., &, Thelwall, M., (2012). Research blogs and the discussion of scholarly information. PloS one, 7 (5), e35869.
21. Shema, H., Bar-ilan, J., &, Thelwall, M., (2014). Do blog citations correlate with a higher number of future citations? Research Blogs as a Potential. Journal of the Association for Information Science and Technology (in press).
22. Sud, P., &, Thelwall, M., (2014). Evaluating altmetrics. Scientometrics, 98 (2), 1131-1143.
23. Thelwall, M., Haustein, S., Larivière, V., &, Sugimoto, C.R., (2013). Do altmetrics work? Twitter and ten other social web services. PloS One, 8 (5), e64841.
24. Tort, A.B., Targino, Z.H., &, Amaral, O.B., (2012). Rising publication delays inflate journal impact factors. PloS One, 7 (12), e53374.
25. Waltman, L., Calero-Medina, C., Kosten, J., Noyons, E.C.M., Tijssen, R.J.W., van Eck, N.J., van Leeuwen, T.N., van Raan, A.F.J., Visser, M.S., &, Wouters, P., (2012). The Leiden ranking 2011/2012: Data collection, indicators, and interpretation. Journal of the American Society for Information Science and Technology, 63, 2419-2432.
26. Waltman, L., &, Costas, R., (2014). F1000 Recommendations as a potential new data source for research evaluation: A comparison with citations. Journal of the Association for Information Science and Technology, 65 (3), 433-445.
27. Waltman, L., Van Eck, N.J., Van Leeuwen, T.N., Visser, M.S., &, Van Raan, A.F.J., (2011). Towards a new crown indicator: Some theoretical considerations. Journal of Informetrics, 5 (1), 37-47.
28. Wouters, P., &, Costas, R., (2012). Users, narcissism and control: Tracking the impact of scholarly publications in the 21st century. Utrecht, Netherlands: SURF foundation. Retrieved from: http://research-acumen.eu/wp-content/uploads/Users-narcissism-and-control.pdf
29. Wu, X., &, Notarmarco, C., (2003). Online first publication. Knowledge and Information Systems (KAIS), 5 (1), 1-1.
30. Zahedi, Z., Costas, R., &, Wouters, P., (2013). How well developed are Altmetrics? Cross disciplinary analysis of the presence of "alternative metrics" in scientific publications (RIP). In Proceedings of the 14th International Society of Scientometrics and Informetrics Conference, Vienna, Austria (pp. 876-884). Wien: Facultas Verlags und Buchhandels.