Do Altmetrics Work? Twitter and Ten Other Social Web Services

PLoS ONE

Volumn 8, Issue 5, 2013, Pages

  Thelwall, Mike ^a   Haustein, Stefanie ^b,e   Larivière, Vincent ^b,c   Sugimoto, Cassidy R ^d  

^a UNIVERSITY OF WOLVERHAMPTON   (United Kingdom)

^b UNIVERSITÉ DE MONTRÉAL   (Canada)

^c UNIVERSITÉ DU QUÉBEC À MONTRÉAL   (Canada)

^d INDIANA UNIVERSITY   (United States)

^e Science Metrix   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ACCESS TO INFORMATION; ALTMETRIC MEASUREMENT; ARTICLE; CITATION ANALYSIS; CONTROLLED STUDY; INFORMATION PROCESSING; JOURNAL IMPACT FACTOR; MASS COMMUNICATION; MEDICAL RESEARCH; MULTIMEDIA; ONLINE SYSTEM; SCIENTIFIC LITERATURE; SOCIAL NETWORK; WEB BROWSER;

BIBLIOMETRICS; HUMANS; PUBLISHING; PUBMED; SOCIAL MEDIA;

EID: 84878407126     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0064841     Document Type: Article

References (43)

1. Priem J, Hemminger BM (2010) Scientometrics 2.0: Toward new metrics of scholarly impact on the social web. First Monday 15. Available: http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/2874/257. Accessed 2011 December 7.
2. Adie E, Roe W (2013) Altmetric: enriching scholarly content with article-level discussion and metrics. Learned Publishing 26: 11-17. Available: http://figshare.com/articles/Enriching_scholarly_content_with_article_level_discussion_and_metrics/105851. Accessed 2013 February 19.
3. Seglen PO, (1992) The skewness of science. Journal of the American Society for Information Science 43: 628-638.
4. Neylon C Wu S, (2009) Article-level metrics and the evolution of scientific impact. PLoS Biology 7: e1000242.
5. Lozano GA, Larivière V, Gingras Y, (2012) The weakening relationship between the Impact Factor and papers' citations in the digital age. Journal of the American Society for Information Science and Technology 63: 2140-2145.
6. de Solla Price DJ, Gürsey S, (1976) Studies in Scientometrics I Transience and continuance in scientific authorship. International Forum on Information and Documentation 1: 17-24.
7. Tenopir C, King DW (2000) Towards electronic journals: Realities for scientists, librarians, and publishers. Washington, DC: Special Libraries Association. 488 p.
8. Haustein S (2012) Readership metrics. In: Cronin B, Sugimoto C, editors. Beyond Bibliometrics: Harnessing Multi-dimensional Indicators of Performance. Cambridge, MA: MIT Press, in press.
9. Bornmann L, (2013) What is societal impact of research and how can it be assessed? A literature survey. Journal of the American Society of Information Science and Technology 64: 217-233.
10. Thelwall M, Kousha K, (2008) Online presentations as a source of scientific impact?: An analysis of PowerPoint files citing academic journals. Journal of the American Society for Information Science and Technology 59: 805-815.
11. Kousha K, Thelwall M, (2008) Assessing the impact of disciplinary research on teaching: An automatic analysis of online syllabuses. Journal of the American Society for Information Science and Technology 59: 2060-2069.
12. Delgado-López-Cózar E, Cabezas-Clavijo Á, (2012) Google scholar metrics: An unreliable tool for assessing scientific journals. El Profesional De La Información 21: 419-427.
13. Kousha K, Thelwall M, (2007) Google scholar citations and Google Web/URL citations: A multi-discipline exploratory analysis. Journal of the American Society for Information Science and Technology 58: 1055-1065.
14. Meho LI, Yang K, (2007) Impact of data sources on citation counts and rankings of LIS faculty: Web of science vs Scopus and Google scholar. Journal of the American Society for Information Science and Technology 58: 2105-2125.
15. Kousha K, Thelwall M, (2009) Google book search: Citation analysis for social science and the humanities. Journal of the American Society for Information Science and Technology 60: 1537-1549.
16. Brody T, Harnad S, Carr L, (2006) Earlier web usage statistics as predictors of later citation impact. Journal of the American Society for Information Science and Technology 57: 1060-1072.
17. Moed HF, (2005) Statistical relationships between downloads and citations at the level of individual documents within a single journal. Journal of the American Society for Information Science & Technology 56: 1088-1097.
18. Pinkowitz L, (2002) Research dissemination and impact: Evidence from web site downloads. Journal of Finance 57: 485-499.
19. Priem J (2013) Altmetrics. In: Cronin B, Sugimoto C, editors. Bibliometrics and Beyond: Metrics-Based Evaluation of Scholarly Research, Cambridge: MIT Press, in press.
20. Bar-Ilan J, Shema H, Thelwall M (2013) Bibliographic References in Web 2.0. In Cronin B, Sugimoto C, editors. Bibliometrics and Beyond: Metrics-Based Evaluation of Scholarly Research. Cambridge: MIT Press, in press.
21. Priem J, Groth P, Taraborelli D, (2012) The Altmetrics Collection. PLoS ONE 7: e48753.
22. Taraborelli D (2008) Soft peer review: social software and distributed scientific evaluation. In: Proceedings of the 8th International Conference on the Design of Cooperative Systems. pp. 99-110.
23. Desai T, Shariff A, Shariff A, Kats M, Fang X, et al. (2012) Tweeting the Meeting: An In-Depth Analysis of Twitter Activity at Kidney Week 2011. PLoS ONE 7: e40253.
24. Eysenbach G, (2011) Can tweets predict citations? Metrics of social impact based on twitter and correlation with traditional metrics of scientific impact. Journal of Medical Internet Research 13: e123.
25. Shuai X, Pepe A, Bollen J, (2012) How the scientific community reacts to newly submitted preprints: Article downloads, twitter mentions, and citations. PLoS ONE 7: e47523.
26. Groth P, Gurney T (2010) Studying Scientific Discourse on the Web using Bibliometrics: A Chemistry Blogging Case Study. In: Proceedings of the WebSci10, Raleigh, NC, US. Available: http://journal.webscience.org/308. Accessed 2013 February 18.
27. Shema H, Bar-Ilan J, Thelwall M, (2012) Research Blogs and the Discussion of Scholarly Information. PLoS ONE 7 (5): e35869.
28. Haustein S, Siebenlist T, (2011) Applying social bookmarking data to evaluate journal usage. Journal of Informetrics 5: 446-457.
29. Nielsen F (2007) Scientific citations in Wikipedia. First Monday 12.Available: http://firstmonday.org/htbin/cgiwrap/bin/ojs/indexphp/fm/article/view/1997/1872. Accessed 21 January, 2013.
30. Yan K-K, Gerstein M, (2011) The spread of scientific information: Insights from the Web usage statistics in PLoS Article-Level Metrics. PLoS ONE 6: e19917.
31. Bar-Ilan J (2012a) JASIST@mendeley. Presented at the ACM Web Science Conference Workshop on Altmetrics Evanston, IL. Available: http://altmetricsorg/altmetrics12/bar-ilan. Accessed 21 January 2013.
32. Bar-Ilan J, (2012b) JASIST 2001-2010. Bulletin of the American Society for Information Science and Technology 38: 24-28.
33. Bar-Ilan J, Haustein S, Peters I, Priem J, Shema H, et al. (2012) Beyond citations: Scholars' visibility on the social Web. In: Proceedings of the 17th International Conference on Science and Technology Indicators. Montréal, Canada. pp. 98-109.
34. Li X, Thelwall M (2012) F1000, Mendeley and traditional bibliometric indicators. In: Proceedings of the 17th International Conference on Science and Technology Indicators. Montréal, Canada. pp. 451-551.
35. Li X, Thelwall M, Giustini D, (2012) Validating online reference managers for scholarly impact measurement. Scientometrics 91: 461-471.
36. Priem J, Piwowar HA, Hemminger BM (2012) Altmetrics in the wild: Using social media to explore scholarly impact. ArXiv.org. Available: http://arxiv.org/abs/1203.4745. Accessed 2013 January 21.
37. Schlögl C, Stock WG, (2004) Impact and relevance of LIS journals: A scientometric analysis of international and German-language LIS journals - Citation analysis versus reader survey. Journal of the American Society for Information Science and Technology 55: 1155-1168.
38. Rowlands I, Nicholas D, (2007) The missing link: Journal usage metrics. ASLIB Proceedings 59: 222-228.
39. Kurtz M, Bollen J, (2010) Usage bibliometrics. Annual Review of Information Science and Technology 44: 1-64.
40. NLM (2013) MEDLINE Fact sheet. Available: http://www.nlm.nih.gov/pubs/factsheets/medline.html. Accessed 2013 March 20.
41. Wan JK, Hua PH, Rousseau R, Sun XK, (2010) The journal download immediacy index (DII): experiences using a Chinese full-text database. Scientometrics 82: 555-566.
42. Waltman L, Costas R (2013) F1000 recommendations as a new data source for research evaluation: A comparison with citations. ArXiv. Available: http://arxiv.org/abs/1303.3875. Accessed 2013 April 4.
43. Cohen J (1988) Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates, Publishers.