Applying a dynamic threshold to improve cluster detection of LSI

Science of Computer Programming

Volumn 76, Issue 12, 2011, Pages 1261-1274

  Van Der Spek, Pieter ^a   Klusener, Steven ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Clustering; Feature extraction; Latent Semantic Indexing; Reverse engineering; Software architecture

Indexed keywords

CLUSTER DETECTION; CLUSTERING; DYNAMIC THRESHOLD; LATENT SEMANTIC INDEXING; PHILIPS; SOURCE CODES; STRATEGY PLAY; TREE CUTTINGS;

FEATURE EXTRACTION; HEALTH CARE; INDEXING (OF INFORMATION); PLANT EXTRACTS; REVERSE ENGINEERING; SEMANTICS;

SOFTWARE ARCHITECTURE;

EID: 79958787668     PISSN: 01676423     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.scico.2010.12.004     Document Type: Article

References (55)

1. M.M. Lehman Programs, life cycles, and laws of software evolution Proc. IEEE 68 9 1980 1060 1076
2. S. Deerwester, S.T. Dumais, G.W. Furnas, T.K. Landauer, and R. Harshman Indexing by latent semantic analysis J. Amer. Soc. Inform. Sci. 41 6 1990 391 407
3. T.K. Landauer, P.W. Foltz, and D. Laham Introduction to latent semantic analysis Disc. Proc. 25 1998 259 284
4. J.I. Maletic, A. Marcus, Using latent semantic analysis to identify similarities in source code to support program understanding, in: PICTAI '00, 2000, pp. 4653.
5. D. Binkley, and D. Lawrie Information retrieval applications in software maintenance and evolution P. Laplante, Encyclopedia of Software Engineering 2010 Taylor & Francis LLC (Chapter2)
6. A. Kuhn, S. Ducasse, and T. Gírba Semantic clustering: identifying topics in source code Inf. Softw. Technol. 49 3 2007 230 243 (Pubitemid 46149290)
7. J.I. Maletic, N. Valluri, Automatic software clustering via latent semantic analysis, in: ASE'99, 1999, p. 251.
8. J.I. Maletic, A. Marcus, Supporting program comprehension using semantic and structural information, in: ICSE'01, 2001, pp. 103112. (Pubitemid 32485642)
9. P. van der Spek, S. Klusener, P. van de Laar, Towards recovering architectural concepts using latent semantic indexing, in: CSMR'08, 2008, pp. 253257.
10. P. Langfelder, B. Zhang, and S. Horvath Defining clusters from a hierarchical cluster tree: the Dynamic Tree Cut library for R Bioinformatics 24 5 2007 719 720 (Pubitemid 351321220)
11. A. Marcus, J.I. Maletic, Identification of high-level concept clones in source code, in: ASE'01, 2001, p. 107.
12. A. Marcus, D. Poshyvanyk, The conceptual cohesion of classes, in: ICSM '05, 2005, pp. 133142. (Pubitemid 43790928)
13. D. Poshyvanyk, A. Marcus, The conceptual coupling metrics for object-oriented systems, in: ICSM'06, 2006, pp. 469478. (Pubitemid 47133380)
14. J.H. Hayes, A. Dekhtyar, and S.K. Sundaram Advancing candidate link generation for requirements tracing: the study of methods IEEE Trans. Softw. Eng. 32 1 2006 4 19 (Pubitemid 43193062)
15. G. Antoniol, G. Canfora, G. Casazza, A. de Lucia, and E. Merlo Recovering traceability links between code and documentation IEEE Trans. Softw. Eng. 28 10 2002 970 983
16. A. de Lucia, F. Fasano, R. Oliveto, and G. Tortora Recovering traceability links in software artifact management systems using information retrieval methods ACM Trans. Softw. Eng. Methodol. 16 4 2007 13
17. B. Xu, J. Qian, X. Zhang, Z. Wu, and L. Chen A brief survey of program slicing SIGSOFT Softw. Eng. Notes 30 2 2005 1 36
18. D. Poshyvanyk, Y.-G. Gueheneuc, A. Marcus, G. Antoniol, and V. Rajlich Feature location using probabilistic ranking of methods based on execution scenarios and information retrieval IEEE Trans. Softw. Eng. 33 2007 420 432
19. A. Wierda, E. Dortmans, L. Lou Somers, Using version information in architectural clusteringa case study, in: CSMR'06, 2006, pp. 214228.
20. A.V. Aho Pattern matching in strings Formal Language Theory: Perspectives and Open Problems 1980 Academic Press New York, NY, USA 325 347
21. D.M. Blei, A.Y. Ng, and M.I. Jordan Latent Dirichlet allocation J. Mach. Learn. Res. 3 2003 993 1022
22. P.F. Baldi, C.V. Lopes, E.J. Linstead, and S.K. Bajracharya A theory of aspects as latent topics SIGPLAN Not. 43 10 2008 543 562
23. Y. Liu, D. Poshyvanyk, R. Ferenc, T. Gyimothy, N. Chrisochoides, Modeling class cohesion as mixtures of latent topics, in: ICSM'09, 2009, pp. 233242.
24. G. Maskeri, S. Sarkar, K. Heafield, Mining business topics in source code using latent Dirichlet allocation, in: ISEC'08, 2008, pp. 113120.
25. D.M. Blei, and J.D. Lafferty Topic models A. Srivastava, M. Sahami, Text Mining: Theory and Applications 2009 Taylor and Francis
26. D.M. Blei, and J.D. Lafferty A correlated topic model of science Ann. Appl. Statist. 1 1 2007 17 35
27. T.C. Lethbridge, and N. Anquetil Approaches to clustering for program comprehension and remodularization Advances in Software Engineering: Topics in Evolution, Comprehension and Evaluation 2002 Springer-Verlag New York, Inc. New York, NY, USA 137 157 (Chapter 7)
28. T.A. Wiggerts, Using clustering algorithms in legacy systems remodularization, in: WCRE'97, 1997, p. 33.
29. B. Andreopoulos, A. An, V. Tzerpos, and X. Wang Clustering large software systems at multiple layers Inf. Softw. Technol. 49 3 2007 244 254 (Pubitemid 46149291)
30. R. Adnan, B. Graaf, A. van Deursen, J. Zonneveld, Using cluster analysis to improve the design of component interfaces, in: ASE'08, 2008, pp. 383386.
31. A. van Deursen, T. Kuipers, Identifying objects using cluster and concept analysis, in: ICSE'99, 1999, pp. 246255.
32. D. Poshyvanyk, A. Marcus, Combining formal concept analysis with information retrieval for concept location in source code, in: ICPC'07, 2007, pp. 3748.
33. M. Glorie, A. Zaidman, A. van Deursen, and L. Hofland Splitting a large software repository for easing future software evolutionan industrial experience report J. Softw. Maint. Evol. 21 2 2009 113 141
34. B.S. Mitchell, S. Mancoridis, Comparing the decompositions produced by software clustering algorithms using similarity measurements, in: ICSM'01, 2001, p. 744.
35. J. Wu, A.E. Hassan, R.C. Holt, Comparison of clustering algorithms in the context of software evolution, in: ICSM'05, 2005, pp. 525535. (Pubitemid 43790965)
36. J.R. Kettenring The practice of cluster analysis J. Classification 23 1 2006 3 30 (Pubitemid 44099757)
37. W. Stuetzle Estimating the cluster tree of a density by analyzing the minimal spanning tree of a sample J. Classification 20 1 2003 25 47 (Pubitemid 36742925)
38. D. Dotan-Cohen, S. Kasif, and A.A. Melkman Seeing the forest for the trees: using the gene ontology to restructure hierarchical clustering Bioinformatics 25 14 2009 1789 1795
39. K. Tian, M. Revelle, D. Poshyvanyk, Using latent Dirichlet allocation for automatic categorization of software, in: MSR'09, 2009, pp. 163166.
40. A. Kuhn, Automatic labeling of software components and their evolution using log-likelihood ratio of word frequencies in source code, in: MSR'09, 2009, pp. 175178.
41. E. Enslen, E. Hill, L. Pollock, K. Vijay-Shanker, Mining source code to automatically split identifiers for software analysis, in: MSR'09, 2009, pp. 7180.
42. S.T. Dumais, J. Nielsen, Automating the assignment of submitted manuscripts to reviewers, in: SIGIR'92, 1992, pp. 233244. (Pubitemid 23630489)
43. F. Wild, C. Stahl, G. Stermsek, G. Neumann, Parameters driving effectiveness of automated essay scoring with LSA, in: CAA'05, 2005, pp. 485494.
44. S.T. Dumais Improving the retrieval of information from external sources Behav. Res. Methods Instrum. Comput. 23 3 1991 229 236
45. R Development Core Team, R: A programming environment for data analysis and graphics, R Foundation for Statistical Computing, Vienna, Austria, 2008.
46. S. Ducasse, T. Girba, A. Kuhn, Distribution map, in: ICSM'06, 2006, pp. 203212. (Pubitemid 47133346)
47. X. Xie, D. Poshyvanyk, A. Marcus, 3D visualization for concept location in source code, in: ICSE'06, 2006, pp. 839842. (Pubitemid 46601000)
48. R.K. Yin Case Study Research: Design and Methods 2009 SAGE Publications
49. R. Likert A technique for the measurement of attitudes Arch. Psych. 22 140 1932 1 55
50. A.K. Jain, and R.C. Dubes Algorithms for Clustering Data 1988 Prentice-Hall, Inc. Upper Saddle River, NJ, USA
51. D.B. Walz, J.J. Elam, and B. Curtis Inside a software design team: knowledge acquisition, sharing, and integration Commun. ACM 36 10 1993 63 77
52. R. Xu, and D. Wunsch II Survey of clustering algorithms IEEE Trans. Neural Netw. 16 3 2005 645 678 (Pubitemid 40718010)
53. D. Pelleg, A.W. Moore, X-means: extending K-means with efficient estimation of the number of clusters, in: ICML'00, 2000, pp. 727734.
54. G. Hamerly, C. Elkan, Learning the k in K-means, in: NIPS'03, 2003, pp. 281288.
55. C.D. Manning, P. Raghavan, and H. Schtze An Introduction to Information Retrieval 2009 Cambridge University Press Cambridge England (online edition)