Map of science with topic modeling: Comparison of unsupervised learning and human-assigned subject classification

Journal of the Association for Information Science and Technology

Volumn 67, Issue 10, 2016, Pages 2464-2476

  Suominen, Arho ^a   Toivanen, Hannes ^a,b  

^a VTT TECHNICAL RESEARCH CENTRE OF FINLAND   (Finland)

^b LAPPEENRANTA UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

automatic classification; machine learning; text mining

Indexed keywords

BIG DATA; CLASSIFICATION (OF INFORMATION); DATA MINING; LEARNING SYSTEMS; MAPS; UNSUPERVISED LEARNING;

AUTOMATED CLASSIFICATION; AUTOMATIC CLASSIFICATION; CLASSIFICATION FRAMEWORK; CLASSIFICATION MODELS; LARGE SCALE DATA SETS; LARGE-SCALE DATA ANALYSIS; SUBJECT CLASSIFICATION; TEXT MINING;

TEXT PROCESSING;

CLASSIFICATION; DATA ANALYSIS; HUMAN; MACHINE LEARNING; MINING; THEORETICAL MODEL;

EID: 84987643700     PISSN: 23301635     EISSN: 23301643     Source Type: Journal    
DOI: 10.1002/asi.23596     Document Type: Article

References (50)

1. Bassecoulard, E., & Zitt, M. (1999). Indicators in a research institute: A multi-level classification of scientific journals. Scientometrics, 44(3), 323–345.
2. Blei, D.M., & Lafferty, J.D. (2007). A correlated topic model of science. The Annals of Applied Statistics, 1(1), 17–35.
3. Blei, D.M., & Lafferty, J.D. (2009). Topic Models. In A.N. Srivastava & M. Sahami (Eds.), Text mining: Classification, clustering, and applications (10th ed., pp. 71–94). Boca Raton FL USA: Taylor and Francis.
4. Blei, D.M., Ng, A.Y., & Jordan, M.I. (2003). Latent Dirichlet Allocation. Journal of Machine Learning Research: JMLR, 3(2003), 993–1022.
5. Blondel, V.D., Guillaume, J.-L., Lambiotte, R., & Lefebvre, E. (2008). Fast unfolding of communities in large networks. Journal of Statistical Mechanics: Theory and Experiment, 2008(10), P10008.
6. Boyack, K.W., Klavans, R., & Börner, K. (2005). Mapping the backbone of science. Scientometrics, 64(3), 351–374.
7. Boyack, K.W., Newman, D., Duhon, R.J., Klavans, R., Patek, M., Biberstine, J.R., … Börner, K. (2011). Clustering more than two million biomedical publications: Comparing the accuracies of nine text-based similarity approaches. PLoS One, 6(3), e18029.
8. Börner, K. (2010). Atlas of science: Visualizing what we know. Cambridge, MA: MIT Press.
9. Börner, K., Chen, C., & Boyack, K.W. (2003). Visualizing knowledge domains. Annual Review of Information Science and Technology, 37(1), 179–255.
10. Braam, R.R., Moed, H.F., & Van Raan, A.F. (1991). Mapping of science by combined cocitation and word analysis: II: Dynamical aspects. Journal of the American Society for Information Science, 42(4), 252–266.
11. Chang, J., Gerrish, S., Wang, C., Boyd-Graber, J.L., & Blei, D.M. (2009). Reading tea leaves: How humans interpret topic models. In Y. Bengio, D. Schuurmans, J.D. Lafferty, C.K.I. Williams, & A. Culotta (Eds.), Advances in neural information processing systems (pp. 288–296). Curran Associates, Inc.
12. Ding, Y., Chowdhury, G.G., & Foo, S. (2001). Bibliometric cartography of information retrieval research by using coword analysis. Information Processing & Management, 37(6), 817–842.
13. Feldman, R., & Sanger, J. (2006). The text mining handbook: Advanced approaches in analyzing unstructured data. New York: Cambridge University Press.
14. Glänzel, W., & Schubert, A. (2003). A new classification scheme of science fields and subfields designed for scientometric evaluation purposes. Scientometrics, 56(3), 357–367.
15. Glänzel, W., Schubert, A., & Czerwon, H.J. (1999). An item-by-item subject classification of papers published in multidisciplinary and general journals using reference analysis. Scientometrics, 44(3), 427–439.
16. Glenisson, P., Glänzel, W., & Persson, O. (2005). Combining full-text analysis and bibliometric indicators. a pilot study. Scientometrics, 63(1), 163–180.
17. Griffith, B.C., Small, H.G., Stonehill, J.A., & Dey, S. (1974). The structure of scientific literatures. II: Toward a macro-and microstructure for science. Social Studies of Science, 4(4), 339–365.
18. Hofmann, T. (1999). Probabilistic latent semantic indexing. In F. Gey, M., Hearst, & R., Tong (Eds.), Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 50–57). Berkley CA USA: ACM.
19. Hood, W.W., & Wilson, C.S. (2001). The literature of bibliometrics, scientometrics, and informetrics. Scientometrics, 52(2), 291–314.
20. Jacomy, M., Heymann, S., Venturini, T., & Bastian, M. (2011). ForceAtlas2, a continuous graph layout algorithm for handy network visualization. Medialab Center of Research, 560.
21. Klavans, R., & Boyack, K.W. (2009). Toward a consensus map of science. Journal of the American Society for Information Science and Technology, 60(3), 455–476.
22. Klavans, R., & Boyack, K.W. (2014). Mapping altruism. Journal of Informetrics, 8(2), 431–447.
23. Lehvo, A., & Nuutinen, A. (2006). Finnish science in international comparison: A bibliometric analysis. Publications of the Academy of Finland, 15(6).
24. Leydesdorff, L., & Rafols, I. (2009). A global map of science based on the ISI subject categories. Journal of the American Society for Information Science and Technology, 60(2), 348–362.
25. Leydesdorff, L., Carley, S., & Rafols, I. (2013). Global maps of science based on the new Web-of-Science categories. Scientometrics, 94(2), 589–593.
26. Leydesdroff, L. (1989). Words and cowords as indicators of intellectual organization. Research Policy, 18(4), 209–223.
27. Liu, X., Yu, S., Janssens, F., Glänzel, W., Moreau, Y., & De Moor, B. (2010). Weighted hybrid clustering by combining text mining and bibliometrics on a large-scale journal database. Journal of the American Society for Information Science and Technology, 61(6), 1105–1119.
28. Mei, Q., Shen, X., & Zhai, C. (2007). Automatic labeling of multinomial topic models. In P. Berkhin, R. Caruana, & X.D. Wu (Eds.), Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 490–499). San Jose, CA, USA: ACM.
29. Moya-Anegón, F., Vargas-Quesada, B., Herrero-Solana, V., Chinchilla-Rodríguez, Z., Corera-Álvarez, E., & Munoz-Fernández, F.J. (2004). A new technique for building maps of large scientific domains based on the cocitation of classes and categories. Scientometrics, 61(1), 129–145.
30. Moya-Anegón, S.G., Vargas-Quesada, B., Chinchilla-Rodríguez, Z., Corera-Álvarez, E., Munoz-Fernández, F.J. & Herrero-Solana, V. (2007). Visualizing the marrow of science. Journal of the American Society for Information Science and Technology, 58(14), 2167–2179.
31. Muhonen, R., Leino, Y., & Puuska, H.-M. (2012). Suomen kansainvälinen yhteisjulkaiseminen. Opetus- ja kulttuuriministeriön julkaisuja 2012:4.
32. Nichols, L.G. (2014). A topic model approach to measuring interdisciplinarity at the National Science Foundation. Scientometrics, 100(3), 741–754.
33. OECD. (2007). Revised field of science and technology (fos) classifications in the frascati manual (DSTI/EAS/STP/NESTI(2006)19/FINAL ed.). Paris.
34. Peters, H., & van Raan, A.F. (1993a). Co-word-based science maps of chemical engineering. Part II: Representations by combined clustering and multidimensional scaling. Research Policy, 22(1), 47–71.
35. Peters, H., & van Raan, A.F. (1993b). Co-word-based science maps of chemical engineering. Part I: Representations by direct multidimensional scaling. Research Policy, 22(1), 23–45.
36. Pudovkin, A.I., & Garfield, E. (2002). Algorithmic procedure for finding semantically related journals. Journal of the American Society for Information Science and Technology, 53(13), 1113–1119.
37. Rip, A., & Courtial, J.P. (1984). Co-word maps of biotechnology: An example of cognitive scientometrics. Scientometrics, 6(6), 381–400.
38. Slotte, V., & Lonka, K. (1999). Spontaneous concept maps aiding the understanding of scientific concepts. International Journal of Science Education, 21(5), 515–531.
39. Small, H. (1973). Co-citation in the scientific literature: A new measure of the relationship between two documents. Journal of the American Society for Information Science, 24(4), 265–269.
40. Small, H. (1993). Macro-level changes in the structure of cocitation clusters: 1983–1989. Scientometrics, 26(1), 5–20.
41. Small, H. (1999). Visualizing science by citation mapping. Journal of the American Society for Information Science, 50(9), 799–813.
42. Small, H. (2004). On the shoulders of Robert Merton: Towards a normative theory of citation. Scientometrics, 60(1), 71–79.
43. Talley, E.M., Newman, D., Mimno, D., Herr, B.W., II, Wallach, H.M., Burns, G.A., … McCallum, A. (2011). Database of NIH grants using machine-learned categories and graphical clustering. Nature Methods, 8(6), 443–444.
44. Toivanen, H., & Suominen, A. (2014). Epistemic integration of the European research area: The shifting geography of the knowledge base of Finnish research, 1995–2010. Science and Public Policy, scu066. http://spp.oxfordjournals.org/content/early/2014/11/23/scipol.scu066.short
45. Veugelers, R. (2010). Towards a multipolar science world: Trends and impact. Scientometrics, 82(2), 439–456.
46. Wallach, H. (2006). Topic modeling: Beyond bag-of-words. In W. Cohen & A. Moore (Eds.), Proceedings of the 23rd International Conference on Machine Learning (p. 977–984). Pittsburgh, PA: ACM.
47. Wei, X., & Croft, W.B. (2006). LDA-based document models for ad-hoc retrieval. In E.N. Efthimiadis, S. Dumais, D. Hawking, & K. Järvelin (Eds.), Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (p. 178–185). Seattle, WA, USA: ACM.
48. Yan, E., Ding, Y., Milojević, S., & Sugimoto, C.R. (2012). Topics in dynamic research communities: An exploratory study for the field of information retrieval. Journal of Informetrics, 6(1), 140–153.
49. Yau, C.-K., Porter, A., Newman, N., & Suominen, A. (2013). Clustering scientific documents with topic modeling. Scientometrics, 100(3), 767–786.
50. Zhang, L., Liu, X., Janssens, F., Liang, L., & Glänzel, W. (2010). Subject clustering analysis based on isi category classification. Journal of Informetrics, 4(2), 185–193.