Using heuristics to estimate an appropriate number of latent topics in source code analysis

Science of Computer Programming

Volumn 78, Issue 9, 2013, Pages 1663-1678

  Grant, Scott ^a   Cordy, James R ^a   Skillicorn, David B ^a  

^a QUEEN S UNIVERSITY   (Canada)

Author keywords

Allocation; Code clusters; Dirichlet; Latent; Latent topic model; Source code analysis

Indexed keywords

ALLOCATION; CODE CLUSTERS; DIRICHLET; LATENT; LATENT TOPIC MODEL; SOURCE CODE ANALYSIS;

CLUSTERING ALGORITHMS; COMPUTER PROGRAMMING LANGUAGES; COMPUTER SOFTWARE; STATISTICS;

OPEN SYSTEMS;

EID: 84878892169     PISSN: 01676423     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.scico.2013.03.015     Document Type: Article

References (39)

1. D.J. Bartholomew, and M. Knott Latent Variable Models and Factor Analysis 2nd edn. 1999 Oxford University Press Inc Arnold 0-340-69243-X
2. K.A. Bollen Structural Equations with Latent Variables 1989 Wiley-Interscience New York, NY, USA 0471011711
3. B. Dit, M. Revelle, M. Gethers, D. Poshyvanyk, Feature location in source code: a taxonomy and survey, Journal of Software Maintenance and Evolution: Research and Practice (ISSN: 1532-0618) (2011).
4. T.L. Griffiths, and M. Steyvers Finding scientific topics Proceedings of the National Academy of Sciences of the United States of America 101 2004 5228 5235
5. G. Heinrich Parameter estimation for text analysis, Tech. Rep. 2004
6. D.M. Blei, A.Y. Ng, and M.I. Jordan Latent Dirichlet allocation The Journal of Machine Learning Research 1533-7928 3 2003 993 1022
7. J.I. Maletic, and N. Valluri Automatic software clustering via latent semantic analysis Proceedings of the 14th IEEE International Conference on Automated Software Engineering ASE '99 1999 IEEE Computer Society Washington, DC, USA 0-7695-0415-9 251
8. J.I. Maletic, and A. Marcus Using latent semantic analysis to identify similarities in source code to support program understanding Proceedings of the 12th IEEE International Conference on Tools with Artificial Intelligence ICTAI '00 2000 IEEE Computer Society Washington, DC, USA 46
9. R.B. Bradford An empirical study of required dimensionality for large-scale latent semantic indexing applications Proceeding of the 17th ACM Conference on Information and Knowledge Management CIKM '08 2008 ACM New York, NY, USA 978-1-59593-991-3 153 162
10. A. Kuhn, S. Ducasse, and T. Gírba Semantic clustering: identifying topics in source code Information and Software Technology 0950-5849 49 3 2007 230 243
11. E. Linstead, C. Lopes, and P. Baldi An application of latent Dirichlet allocation to analyzing software evolution Proceedings of the 2008 7th International Conference on Machine Learning and Applications ICMLA '08 2008 IEEE Computer Society Washington, DC, USA 978-0-7695-3495-4 813 818
12. E. Linstead, P. Rigor, S. Bajracharya, C. Lopes, and P. Baldi Mining concepts from code with probabilistic topic models Proceedings of the 22nd IEEE/ACM International Conference on Automated Software Engineering ASE '07 2007 ACM New York, NY, USA 978-1-59593-882-4 461 464
13. G. Maskeri, S. Sarkar, and K. Heafield Mining business topics in source code using latent dirichlet allocation Proceedings of the 1st Conference on India Software Engineering Conference ISEC '08 2008 ACM New York, NY, USA 978-1-59593-917-3 113 120
14. S.W. Thomas, B. Adams, A.E. Hassan, and D. Blostein Validating the use of topic models for software evolution Proceedings of the 2010 10th IEEE Working Conference on Source Code Analysis and Manipulation SCAM '10 2010 IEEE Computer Society Washington, DC, USA 978-0-7695-4178-5 55 64
15. S.W. Thomas, B. Adams, A.E. Hassan, and D. Blostein Modeling the evolution of topics in source code histories Proceedings of the 8th Working Conference on Mining Software Repositories MSR '11 2011 ACM New York, NY, USA 978-1-4503-0574-7 173 182
16. A. Hindle, M. Godfrey, R. Holt, What's hot and what's not: windowed developer topic analysis, in: Proceedings of the 25th IEEE International Conference on Software Maintenance, ICSM'09, (ISSN: 1063-6773), 339-348, 2009.
17. A. Hindle, N.A. Ernst, M.W. Godfrey, and J. Mylopoulos Automated topic naming to support cross-project analysis of software maintenance activities Proceedings of the 8th Working Conference on Mining Software Repositories MSR '11 2011 ACM New York, NY, USA 978-1-4503-0574-7 163 172
18. S.K. Lukins, N.A. Kraft, and L.H. Etzkorn Source code retrieval for bug localization using latent dirichlet allocation Proceedings of the 2008 15th Working Conference on Reverse Engineering 2008 IEEE Computer Society Washington, DC, USA 978-0-7695-3429-9 155 164
19. O.C.Z. Gotel, A.C.W. Finkelstein, An analysis of the requirements traceability problem, in: Proceedings of the 1st International Conference on Requirements Engineering, ICRE'94, 1994, pp. 94-101.
20. G. Antoniol, G. Canfora, G. Casazza, A.D. Lucia, and E. Merlo Recovering traceability links between code and documentation IEEE Transactions on Software Engineering 0098-5589 28 10 2002 970 983
21. A. Marcus, and J.I. Maletic Recovering documentation-to-source-code traceability links using latent semantic indexing Proceedings of the 25th International Conference on Software Engineering ICSE '03 2003 IEEE Computer Society Washington, DC, USA 0-7695-1877-X 125 135
22. R. Oliveto, M. Gethers, D. Poshyvanyk, and A. De Lucia On the equivalence of information retrieval methods for automated traceability link recovery Proceedings of the 2010 IEEE 18th International Conference on Program Comprehension ICPC '10 2010 IEEE Computer Society Washington, DC, USA 68 71
23. H.U. Asuncion, A.U. Asuncion, and R.N. Taylor Software traceability with topic modeling Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1 ICSE '10 2010 ACM New York, NY, USA 978-1-60558-719-6 95 104
24. B. Schölkopf, A.J. Smola, R.C. Williamson, and P.L. Bartlett New support vector algorithms Neural Computation 0899-7667 12 5 2000 1207 1245
25. I. Steinwart On the optimal parameter choice for ν-support vector machines IEEE Transactions on Pattern Analysis and Machine Intelligence 0162-8828 25 2003 1274 1284
26. H. Wallach, D. Mimno, and A. McCallum Rethinking LDA: why priors matter Y. Bengio, D. Schuurmans, J. Lafferty, C.K.I. Williams, A. Culotta, Advances in Neural Information Processing Systems 22 2009 1973 1981
27. P. Comon Independent component analysis, a new concept? Signal Processing 36 3 1994 287 314
28. S. Grant, D.B. Skillicorn, J.R. Cordy, Topic detection using independent component analysis, in: Proceedings of the 2008 Workshop on Link Analysis, Counterterrorism and Security, LACTS '08, 2008, pp.23-28.
29. S. Grant, J.R. Cordy, D.B. Skillicorn, Automated concept location using independent component analysis, in: Proceedings of the 15th Working Conference on Reverse Engineering, WCRE '08, 2008, pp. 138-142.
30. S. Grant, J.R. Cordy, Vector space analysis of software clones, in: 17th IEEE International Conference on Program Comprehension, ICPC '09, 2009, pp. 233-237.
31. S. Grant, and J.R. Cordy Estimating the optimal number of latent concepts in source code analysis Proceedings of the 10th IEEE International Working Conference on Source Code Analysis and Manipulation SCAM '10 2010 IEEE Computer Society Timişoara, Romania
32. C.K. Roy, and J.R. Cordy Near-miss function clones in open source software: an empirical study Journal of Software Maintenance and Evolution, Special Issue on WCRE '08 22 3 2010 165 189
33. C.K. Roy, and J.R. Cordy Are scripting languages really different? Proceedings of the 4th International Workshop on Software Clones (IWSC '10) IWSC '10 2010 ACM New York, NY, USA 978-1-60558-980-0 17 24
34. S. Grant, Topic estimate source code, http://research.cs.queensu.ca/home/ scott/scam10/, 2010.
35. X.-H. Phan, C.-T. Nguyen, GibbsLDA++, A C/C++ implementation of latent dirichlet allocation (LDA) using Gibbs sampling for parameter estimation and inference, http://gibbslda.sourceforge.net, 2013.
36. J.R. Cordy The TXL source transformation language Science of Computer Programming 0167-6423 61 3 2006 190 210
37. A. Hassan, R. Holt, Studying the evolution of software systems using evolutionary code extractors, in: 7th International Workshop on Principles of Software Evolution, 2004. Proceedings, (ISSN: 15504077), 2004, pp. 76-81.
38. S. Grant, J.R. Cordy, D.B. Skillicorn, Reverse engineering co-maintenance relationships using conceptual analysis of source code, in: Proceedings of the 18th Working Conference on Reverse Engineering, WCRE '11, 2011, pp. 87-91.
39. S. Grant, J.R. Cordy, D.B. Skillicorn, Using topic models to support software maintenance, in: Proceedings of the 16th European Conference on Software Maintenance and Reengineering, CSMR '12, 2012, pp. 403-408.