Analyze this! 145 questions for data scientists in software engineering

Proceedings - International Conference on Software Engineering

Volumn , Issue 1, 2014, Pages 12-23

  Begel, Andrew ^a   Zimmermann, Thomas ^a  

^a MICROSOFT RESEARCH   (United States)

Author keywords

Analytics; Data Science; Software Engineering

Indexed keywords

ENGINEERS; SURVEYS;

ANALYTICS; DATA SCIENCE; SOFTWARE INDUSTRY; SOFTWARE PROCESS;

SOFTWARE ENGINEERING;

EID: 84994087115     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2568225.2568233     Document Type: Conference Paper

References (52)

1. May, T. The New Know: Innovation Powered by Analytics. Wiley, 2009.
2. Davenport, T. H., Harris, J. G., and Morison, R. Analytics at Work: Smarter Decisions, Better Results. Harvard Business Review Press, 2010.
3. Lewis, M. Moneyball: The Art of Winning an Unfair Game. W. W. Norton & Company, 2003.
4. Hassan, A. E. and Xie, T. Software intelligence: the future of mining software engineering data. In FOSER'10: Proceedings of the Workshop on Future of Software Engineering Research (2010), 161-166.
5. Zhang, D., Dang, Y., Lou, J.-G., Han, S., Zhang, H., and Xie, T. Software Analytics as a Learning Case in Practice: Approaches and Experiences. In MALETS'11: Proceedings International Workshop on Machine Learning Technologies in Software Engineering (2011).
6. Buse, R. P. L. and Zimmermann, T. Analytics for software development. In FOSER'10: Proceedings of the Workshop on Future of Software Engineering Research (2010), 77-80.
7. Davenport, T. H. and Patil, D. J. Data Scientist: The Sexiest Job of the 21st Century. Harvard Business Review (October 2012).
8. MCKINSEY GLOBAL INSTITUTE. Big data: The next frontier for innovation, competition, and productivity. http: //www. mckinsey. com/insights/business-technology/bi g-data-thefinext-frontierforinnovation. 2011.
9. Wilson, G. Ten Questions for Researchers. http: //neverworkintheory.org/2012/08/22/ten-questionsfor-empirical-researchers. html. 2012.
10. Meyer, B. Empirical answers to fundamental software engineering questions. http: //bertrandmeyer. com/2013/08/29/empirical-answersto-fundamental-software-engineering-questions/. 2013.
11. Begel, A. and Zimmermann, T. Appendix to Analyze This! 145 Questions for Data Scientists in Software Engineering. Technical Report, MSR-TR-2013-84, http: //aka. ms/145Questions, Microsoft Research, Redmond, WA, USA, 2013.
12. Menzies, T. and Zimmermann, T. Software Analytics: So What? IEEE Software, 30, 4 (July 2013), 31-37.
13. Accenture. Most U. S. Companies Say Business Analytics Still Future Goal, Not Present Reality. http: //newsroom. accenture. com/article-display. cfm?article -id=4777. 2008.
14. Lou, J.-G., Lin, Q. W., Ding, R., Fu, Q., Zhang, D., and Xie, T. Software Analytics for Incident Management of Online Services: An Experience Report. In ASE'13: Proceedings of the Internation Conference on Automated Software Engineering (2013).
15. Menzies, T., Bird, C., Zimmermann, T., Schulte, W., and Kocaganeli, E. The Inductive Software Engineering Manifesto: Principles for Industrial Data Mining. In MALETS'11: Proceedings International Workshop on Machine Learning Technologies in Software Engineering (2011).
16. Zhang, D. and Xie, T. Software analytics: achievements and challenges. In ICSE'13: Proceedings of the 2013 International Conference on Software Engineering (2013), 1487-1487.
17. Zhang, D. and Xie, T. Software Analytics in Practice. In ICSE'12: Proceedings of the International Conference on Software Engineering. (2012), 997.
18. Zhang, D., Han, S., Dang, Y., Lou, J.-G., Zhang, H., and Xie, T. Software Analytics in Practice. IEEE Software, 30, 5 (September 2013), 30-37.
19. Buse, R. P. L. and Zimmermann, T. Information needs for software development analytics. In ICSE'12: Proceedings of 34th International Conference on Software Engineering (2012), 987-996.
20. Sillito, J., Murphy, G. C., and Volder, K. D. Asking and Answering Questions during a Programming Change Task. IEEE Trans. Software Eng., 34, 4 (2008), 434-451.
21. Phillips, S., Ruhe, G., and Sillito, J. Information needs for integration decisions in the release process of large-scale parallel development. In CSCW'12: Proceedings of Computer Supported Cooperative Work (2012), 1371-1380.
22. Ko, A. J., DeLine, R., and Venolia, G. Information Needs in Collocated Software Development Teams. In ICSE'07: Proceedings of International Conference on Software Engineering (2007), 344-353.
23. Fritz, T. and Murphy, G. C. Using information fragments to answer the questions developers ask. In ICSE'10: Proceedings of the International Conference on Software Engineering (2010), 175-184.
24. Begel, A., Khoo, Y. P., and Zimmermann, T. Codebook: Discovering and exploiting relationships in software repositories. In ICSE'10: Proceedings of International Conference on Software Engineering (2010), 125-134.
25. Breu, S., Premraj, R., Sillito, J., and Zimmermann, T. Information needs in bug reports: improving cooperation between developers and users. In CSCW'10: Proceedings of Computer Supported Cooperative Work (2010), 301-310.
26. Roehm, T., Tiarks, R., Koschke, R., and Maalej, W. How do professional developers comprehend software? In ICSE'12: Pro. of Intl. Conf. on Software Engineering (2012), 255-265.
27. VanGeest, J. B., Johnson, T. P., and Welch, V. L. Methodologies for improving response rates in surveys of physicians: a systematic review. Evaluation and the Health Professions, 30, 4 (December 2007), 303-321.
28. Smith, E., Loftin, R., Murphy-Hill, E., Bird, C., and Zimmermann, T. Improving Developer Participation Rates in Surveys. In CHASE'13: Proceedings of Workshop on Cooperative and Human Aspects of Software Engineering (2013).
29. Hudson, W. Card Sorting. In Soegaard, M. and Dam, R. F., eds., Encyclopedia of Human-Computer Interaction, 2nd Ed. The Interaction Design Foundation, 2013.
30. Chudoba, B. Does Adding One More Question Impact Survey Completion Rate? http: //blog. surveymonkey. com/blog/2010/12/08/surveyqu estions-andcompletion-rates/, SurveyMonkey. com, 2010.
31. Design, A. S. Q. S. Trivellore E. Raghunathan and James E. Grizzle. Journal of the American Statistical Association, 90, 429 (March 1995), 54-63.
32. Kano, N., Seraku, N., Takahashi, F., and Tsuji, S. Attractive quality and must-be quality. Journal of the Japanese Society for Quality Control (in Japanese), 14, 2 (April 1984), 39-48.
33. Kitchenham, B. and Pfleeger, S. Personal opinion surveys. In Guide to Advanced Empirical Software Engineering. Springer, 2007.
34. Basili, V. R., Shull, F., and Lanubile, F. Building knowledge through families of experiments. IEEE Transactions on Software Engineering, 25, 4 (July/August 1995), 456-473.
35. Flyvbjerg, B. Five misunderstandings about case-study research. Qualitative inquiry, 12, 2 (2006), 219-245.
36. Kuper, A. and Kuper, J. The Social Science Encyclopedia. Routledge, 1985.
37. Umarji, M. and Seaman, C. Gauging acceptance of software metrics: Comparing perspectives of managers and developers. In ESEM'09: Proceedings of the International Symposium on Empirical Software Engineering and Measurement (2009), 236-247.
38. McCamant, S. and Ernst, M. D. Predicting problems caused by component upgrades. In ESEC/FSE'03: Proceedings of the European Software Engineering Conference / ACM SIGSOFT International Symposium on Foundations of Software Engineering (2003), 287-296.
39. Gorschek, T., Wohlin, C., Carre, P., and Larsson, S. A Model for Technology Transfer in Practice. IEEE Software, 23, 6 (2006), 88-95.
40. Jeffery, R. and Scott, L. Has twenty-five years of empirical software engineering made a difference? In APSEC'02: Proceedings of the Ninth Asia-Pacific Software Engineering Conference (2002), 539-546.
41. Li, P. L., Kivett, R., Zhan, Z., Jeon, S.-E., Nagappan, N., Murphy, B., and Ko, A. J. Characterizing the differences between pre-and post-release versions of software. In ICSE'11: Proceedings of the 33rd International Conference on Software Engineering (2011), 716-725.
42. Liblit, B., Begel, A., and Sweetser, E. Cognitive Perspectives on the Role of Naming in Computer Programs. In Proceedings of the 18th Annual Psychology of Programming Interest Group Workshop (2006).
43. Mockus, A. Organizational volatility and its effects on software defects. In FSE'10: Proceedings of the ACM SIGSOFT International Symposium on Foundations of Software Engineering (2010), 117-126.
44. Allamanis, M. and Sutton, C. Mining source code repositories at massive scale using language modeling. In MSR'13: Proceedings of the 10th Working Conference on Mining Software Repositories (2013), 207-216.
45. Hewner, M. Undergraduate conceptions of the field of computer science. In ICER'13: Proceedings of the international ACM conference on International computing education research (2013), 107-114.
46. Sudol, L. A. and Jaspan, C. Analyzing the strength of undergraduate misconceptions about software engineering. In ICER'10: Proceedings of the international workshop on Computing education research (2010), 31-40.
47. Begel, A. and Simon, B. Novice software developers, all over again. In ICER'08: Proceedings of the International Workshop on Computing Education Research (2008), 3-14.
48. Dagenais, B., Ossher, H., Bellamy, R. K. E., Robillard, M. P., and Vries, J. P. d. Moving into a new software project landscape. In ICSE'10: Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering (2010), 275-284.
49. Radermacher, A. and Walia, G. Gaps between industry expectations and the abilities of graduates. In SIGCSE'13: Proceeding of the 44th ACM technical symposium on Computer science education (2013), 525-530.
50. Brechner, E. Things they would not teach me of in college: what Microsoft developers learn later. In OOPSLA'03: Companion of the ACM SIGPLAN conference on Objectoriented programming, systems, languages, and applications (2003), 134-136.
51. Abelson, H., Sussman, G. J., and Sussman, J. Structure and interpretation of computer programs. MIT Press, 1985.
52. Punter, T., Ciolkowski, M., Freimut, B. G., and John, I. Conducting on-line surveys in software engineering. In ISESE'03: Proceedings of the International Symposium on Empirical Software Engineering (2003), 80-88.