Analyzing and mining a code search engine usage log

Empirical Software Engineering

Volumn 17, Issue 4-5, 2012, Pages 424-466

  Bajracharya, Sushil Krishna ^a   Lopes, Cristina Videira ^a  

^a 5226 Donald Bren Hall   (United States)

Author keywords

Code search engine; Mining topics; Usage log analysis

Indexed keywords

CODE SEARCH ENGINE; LOG ANALYSIS; MODELING ANALYSIS; SEARCH BEHAVIOR; SIMILAR PATTERN; USAGE DATA; WEB SEARCHES;

INTERNET;

SEARCH ENGINES;

EID: 84863725059     PISSN: 13823256     EISSN: 15737616     Source Type: Journal    
DOI: 10.1007/s10664-010-9144-6     Document Type: Conference Paper

References (73)

1. Andrzejewski D, Mulhern A, Liblit B, Zhu X (2007) Statistical debugging using latent topic models. In: Proceedings of the 18th European conference on machine learning. Springer, Warsaw, Poland, pp 6-17
2. Asuncion H, Asuncion A, Taylor R (2010) Software traceability with topic modeling. In: 32nd international conference on software engineering.
3. Aula A, Nordhausen K (2006) Modeling successful performance in web searching. J Am Soc Inf Sci Technol 57(12):1678-1693
4. Baeza-Yates RA, Ribeiro-Neto BA (1999) Modern information retrieval. ACM Press/Addison-Wesley
5. Bajracharya S, Lopes C (2009) Mining search topics from a code search engine usage log. In: 6th IEEE international working conference on mining software repositories, 2009. MSR '09, pp 111-120. doi:10.1109/MSR.2009.5069489
6. Bajracharya S, Ngo T, Linstead E, Dou Y, Rigor P, Baldi P, Lopes C (2006) Sourcerer: A search engine for open source code supporting structure-based search. ACM Press, New York, pp 681-682. doi:10.1145/1176617.1176671
7. Bajracharya S, Ngo T, Linstead E, Rigor P, Dou Y, Baldi P, Lopes C (2007) A study of ranking schemes in internet-scale code search. Tech. Rep. UCI-ISR-07-8, UCI ISR
8. Bajracharya S, Kuhn A, Ye Y (2009) SUITE 2009: First international workshop on search-driven development-users, infrastructure, tools and evaluation. In: 31st international conference on software engineering-companion volume, 2009. ICSE-Companion 2009, pp 445-446
9. Bajracharya S, Ossher J, Lopes C (2010a) Leveraging usage similarity for effective retrieval of examples in code repositories. In: 18th international symposium on the foundations of software engineering
10. Bajracharya S, Ossher J, Lopes C (2010b) Searching API usage examples in code repositories with sourcerer API search. In: Proceedings of 2010 ICSE workshop on search-driven development: Users, infrastructure, tools and evaluation. ACM, Cape Town, South Africa, pp 5-8. doi:10.1145/1809175.1809177
11. Baldi PF, Lopes CV, Linstead EJ, Bajracharya SK (2008) A theory of aspects as latent topics. In: Proceedings of the 23rd ACM SIGPLAN conference on object oriented programming systems languages and applications. ACM, Nashville, TN, USA, pp 543-562. doi:10.1145/1449764. 1449807
12. Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3:993-1022
13. Brandt J, Guo PJ, Lewenstein J, Dontcheva M, Klemmer SR (2009) Two studies of opportunistic programming: Interleaving web foraging, learning, and writing code. In: Proceedings of the 27th international conference on human factors in computing systems. ACM, Boston, MA, USA, pp 1589-1598. doi:10.1145/1518701.1518944.
14. Cui H, Wen J, Nie J, Ma W (2003) Query expansion by mining user logs. IEEE Trans Knowl Data Eng 15(4):829-839
15. Dumais ST (2004) Latent semantic analysis. Annu Rev Inf Sci Technol 38(1):188-230. doi:10.1002/aris.1440380105
16. Furnas GW, Landauer TK, Gomez LM,Dumais ST (1987) The vocabulary problem in human-system communication. Commun ACM 30:964-971. doi:10.1145/32206.32212
17. Griffiths TL, SteyversM(2004) Finding scientific topics. Proc NatlAcad Sci USA 101(Suppl 1):5228-5235. doi:10.1073/pnas.0307752101
18. Grimes C, Tang D, Russell D, Amitay E, Murray C, Teevan J (2007) Query logs alone are not enough. In: Query log analysis: social and technological challenges. A workshop at the 16th international World Wide Web conference (WWW 2007)
19. Grossman DA, Frieder O, Frieder O (2004) Information retrieval algorithms and heuristics, 2nd edn. Springer
20. Henninger S (1997) An evolutionary approach to constructing effective software reuse repositories. ACM Trans Softw Eng Methodol 6(2):111-140. doi:10.1145/248233.248242
21. Hoffmann R, Fogarty J, Weld DS (2007) Assieme: Finding and leveraging implicit references in a web search interface for programmers. In: Proceedings of the 20th annual ACM symposium on User interface software and technology. ACM, Newport, Rhode Island, USA, pp 13-22. doi:10.1145/1294211.1294216
22. Holmes R, Murphy GC (2005) Using structural context to recommend source code examples. ACM Press, New York, pp 117-125. doi:10.1145/1062455.1062491
23. Hummel O, Janjic W, Atkinson C (2008) Code conjurer: Ulling reusable software out of thin air. IEEE Softw 25(5):45-52
24. Jansen BJ, Spink A (2006) How are we searching the world wide web? A comparison of nine search engine transaction logs. Inf Process Manag 42(1):248-263. doi:10.1016/j.ipm.2004.10.007
25. Joachims T (2002) Optimizing search engines using clickthrough data. In: Proceedings of the eighth ACM SIGKDD international conference on knowledge discovery and data mining. ACM, Edmonton, Alberta, Canada, pp 133-142. doi:10.1145/775047.775067
26. Joachims T, Granka L, Pan B, Hembrooke H, Radlinski F, Gay G (2007) Evaluating the accuracy of implicit feedback from clicks and query reformulations in Web search. ACM Trans Inf Syst 25(2):7. doi:10.1145/1229179. 1229181
27. Kawaguchi S, Garg PK, Matsushita M, Inoue K (2006) MUDABlue: An automatic categorization system for open source repositories. J Syst Softw 79(7):939-953
28. Ko AJ, Coblenz MJ, Aung HH (2006) An exploratory study of how developers seek, relate, and collect relevant information during software maintenance tasks. IEEE Trans Softw Eng 32(12): 971-987
29. Ko AJ, DeLine R, Venolia G (2007) Information needs in collocated software development teams. In: Proceedings of the 29th international conference on software engineering. IEEE Computer Society, pp 344-353
30. Koenemann J, Belkin NJ (1996) A case for interaction: A study of interactive information retrieval behavior and effectiveness. In: Proceedings of the SIGCHI conference on human factors in computing systems: Common ground. ACM, Vancouver, British Columbia, Canada, pp 205-212. doi:10.1145/238386.238487
31. Kuhn A, Ducasse S, Gírba T (2007) Semantic clustering: Identifying topics in source code. Inf Softw Technol 49(3):230-243
32. Lemos O, Bajracharya SK, Ossher J, Masiero PC, Lopes C (2009) Applying test-driven code search to the reuse of auxiliary functionality. In: 24th annual ACM symposium on applied computing (SAC 2009)
33. Linstead E, Rigor P, Bajracharya S, Lopes C, Baldi P (2007a) Mining concepts from code with probabilistic topic models. In: Proceedings of the twenty-second IEEE/ACM international conference on automated software engineering. ACM, Atlanta, Georgia, USA, pp 461-464. doi:10.1145/1321631.1321709
34. Linstead E, Rigor P, Bajracharya S, Lopes C, Baldi P (2007b) Mining eclipse developer contributions via author-topic models. In: Proceedings of the fourth international workshop on mining software repositories. IEEE Computer Society, p 30
35. Linstead E, Bajracharya S, Ngo T, Rigor P, Lopes C, Baldi P (2009) Sourcerer: Mining and searching internet-scale software repositories. Data Mining and Knowledge Discovery 18(2):300-336. doi:10.1007/s10618-008-0118-x
36. LiuH, Lethbridge TC (2001) Intelligent search techniques for large software systems. In: Proceedings of the 2001 conference of the Centre for Advanced Studies on Collaborative Research. IBM Press, Toronto, Ontario, Canada, p 10
37. Lopes CV, Bajracharya SK, Ossher J, Baldi PF (2010) UCI source code data sets. University of California, Bren School of Information and Computer Sciences, Irvine. http://www.ics.uci. edu/~lopes/datasets/
38. Lukins SK, Kraft NA, Etzkorn LH (2008) Source code retrieval for bug localization using latent dirichlet allocation. In: 15th Working Conference on reverse engineering, 2008. WCRE'08, pp 155-164
39. Maletic JI, Marcus A (2000) Using latent semantic analysis to identify similarities in source code to support program understanding. In: 12th IEEE international conference on tools with artificial intelligence (ICTAI'00), pp 46-53
40. Maletic JI, Marcus A (2001) Supporting program comprehension using semantic and structural information. In: Proceedings of the 23rd international conference on software engineering. IEEE Computer Society, Toronto, Ontario, Canada, pp 103-112
41. Mandelin D, Xu L, Bodik R, Kimelman D (2005) Jungloid mining: helping to navigate the api jungle. ACM Press, New York, pp 48-61. doi:10.1145/1065010. 1065018
42. Marcus A, Maletic JI (2001) Identification of high-level concept clones in source code. In: Proceedings of the 16th IEEE international conference on automated software engineering, p 107
43. Marcus A, Sergeyev A, Rajlich V, Maletic J (2004) An information retrieval approach to concept location in source code. In: Proceedings of the 11th working conference on reverse engineering (WCRE 2004), pp 214-223
44. Maskeri G, Sarkar S, Heafield K (2008) Mining business topics in source code using latent dirichlet allocation. In: Proceedings of the 1st conference on India software engineering conference. ACM, Hyderabad, India, pp 113-120. doi:10.1145/1342211.1342234
45. McCarey F, Cinneide MO, Kushmerick N (2006) Recommending library methods: An evaluation of the vector space model (vsm) and latent semantic indexing (lsi). Lect Notes Comput Sci 4039:217
46. Murphy GC, Kersten M, Findlater L (2006) How are java software developers using the eclipse IDE? IEEE Softw 23(4):76-83
47. Poshyvanyk D, Marcus A (2007) Combining formal concept analysis with information retrieval for concept location in source code. In: Proceedings of the 15th IEEE international conference on program comprehension. IEEE Computer Society, pp 37-48
48. Poshyvanyk D, Gueheneuc Y, Marcus A, Antoniol G, Rajlich V (2007) Feature location using probabilistic ranking of methods based on execution scenarios and information retrieval. IEEE Trans Softw Eng 33(6):420-432
49. Quan X, Liu G, Lu Z, Ni X, Wenyin L (2009) Short text similarity based on probabilistic topics. Knowl Inf Syst 1-19. http://www.springerlink.com/content/ 75r0k316w8600684/.
50. Reiss SP (2009) Semantics-based code search. In: Proceedings of the 2009 IEEE 31st international conference on software engineering. IEEE Computer Society, pp 243-253. doi:10.1109/ICSE.2009.5070525
51. Sillito J, Murphy GC, Volder KD (2006) Questions programmers ask during software evolution tasks. ACM, Portland, Oregon, USA, pp 23-34. doi:10.1145/1181775.1181779
52. Silverstein C, Marais H, Henzinger M, Moricz M (1999) Analysis of a very large web search engine query log. SIGIR Forum 33(1):6-12. doi:10.1145/331403. 331405
53. Sim SE, Clarke CLA, Holt RC (1998) Archetypal source code searches: A survey of software developers and maintainers, p 180
54. Singer J, Lethbridge T, Vinson N, Anquetil N (1997) An examination of software engineering work practices. IBM Press, p 21
55. Thummalapenta S, Xie T (2007) Parseweb: A programmer assistant for reusing open source code on the web. In: Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering. ACM, Atlanta, Georgia, USA, pp 204-213. doi:10.1145/1321631.1321663
56. Tian K, Revelle M, Poshyvanyk D (2009) Using latent dirichlet allocation for automatic categorization of software. In: 6th IEEE international working conference on mining software repositories.
57. Umarji M, Sim S, Lopes C (2008) Archetypal internet-scale source code searching. In: Open source development, communities and quality. IFIP International Federation for Information Processing, vol 275/2008. Springer, Boston, pp 257-263
58. Web page for Koders log analysis github repository (2010) http://www.github.com/sushil/kodersloganalysis. Accessed 8 August 2010
59. Web site for AGID word list (2010) http://wordlist.sourceforge.net/. Accessed 8 August 2010
60. Web site for Apache Mahout (2010) http://lucene.apache.org/mahout/. Accessed 8 August 2010
61. Web site for GibsLDA++ (2010) http://gibbslda.sourceforge.net/. Accessed 8 August 2010
62. Web site for Google Code Search (2010) http://www.google.com/codesearch. Accessed 8 August 2010
63. Web site for Koders (2010) http://www.koders.com. Accessed 8 August 2010
64. Web site for Krugle (2010) http://www.krugle.com. Accessed 8 August 2010
65. Web site for LDA-C (2010) http://www.cs.princeton.edu/blei/lda-c/index. html. Accessed 8 August 2010
66. Web site for LDA-J (2010) http://www.arbylon.net/projects/. Accessed 8 August 2010
67. Web site for Matlab TopicModeling Toolbox (2010) http://psiexp.ss.uci. edu/research/programs-data/toolbox.htm. Accessed 8 August 2010
68. Whittle M, Eaglestone B, Ford N, Gillet VJ, Madden A (2007) Data mining of search engine logs. J Am Soc Inf Sci Technol 58:2382-2400
69. Xu J, Croft WB (1996) Query expansion using local and global document analysis. In: Proceedings of the 19th annual international ACM SIGIR conference on research and development in information retrieval. ACM, Zurich, Switzerland, pp 4-11. doi:10.1145/243199.243202
70. Ye Y, Fischer G (2002) Supporting reuse by delivering task-relevant and personalized information. In: Proceedings of the 24th international conference on software engineering. ACM, Orlando, Florida, pp 513-523. doi:10.1145/581339. 581402
71. Zazo F, Figuerola CG, Berrocal JLA, Rodriguez E (2005) Reformulation of queries using similarity thesauri. Inf Process Manag 41(5):1163-1173
72. Zhou X, Zhang X, Hu X (2007) Dragon toolkit: Incorporating auto-learned semantic knowledge into large-scale text retrieval and mining. In: 19th IEEE international conference on tools with artificial intelligence, ICTAI 2007, vol 2, pp 197-201. doi:10.1109/ICTAI.2007.117
73. Zhu Y, Gruenwald L (2005) Query expansion using web access log files. In: Database and expert systems applications. Lecture notes in computer science, vol 3588/2005. Springer, Berlin, pp 686-695