Characterizing the differences between pre- and post- release versions of software

Proceedings - International Conference on Software Engineering

Volumn , Issue , 2011, Pages 716-725

  Li, Paul Luo ^a,c   Kivett, Ryan ^a   Zhan, Zhiyuan ^a   Jeon, Sung Eok ^a   Nagappan, Nachiappan ^b   Murphy, Brendan ^b   Ko, Andrew J ^c  

^a MICROSOFT   (United States)

^b MICROSOFT RESEARCH   (United States)

^c UNIVERSITY OF WASHINGTON   (United States)

Author keywords

beta; customer experience improvement program; reliability analysis component (rac); usage; windows; windows error reporting (wer)

Indexed keywords

BETA; CUSTOMER EXPERIENCE; FIELD QUALITY; ORIGINAL EQUIPMENT MANUFACTURERS; SUB-POPULATIONS; USAGE; USAGE SCENARIOS;

FORECASTING; POPULATION STATISTICS; SOFTWARE ENGINEERING;

RELIABILITY ANALYSIS;

EID: 79959914473     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1985793.1985894     Document Type: Conference Paper

References (22)

1. V. Augustine, A. Podgurski, Corroborating User Assessments of Software Behavior to Facilitate Operational Testing. ISSRE, pp. 61-70, 2007.
2. R. C. Cheung, A User-Oriented Software Reliability Model. IEEE Trans. Software Engineering, Vol. SE-6, No.2, pp.118-125, March 1980
3. M. Diep, M. Cohen, S. Elbaum, Probe Distribution Techniques to Profile Events in Deployed Software. ISSRE, pp. 331-342, 2006.
4. S. Elbaum, M. Diep, Profiling Deployed Software: Assessing Strategies and Testing Opportunities, IEEE Trans. Software Engineering, Vol. 31, No. 8, Aug. 2005.
5. A. Ganapathi, V. Ganapathi, D. Patterson, Windows XP Kernel Crash Analysis. Large Installation System Administration Conference, pp. 149-159, 2006.
6. K. Glerum, K. Kinshumann, S. Greenberg, G. Aul, V. Orgovan, G. Nichols, D. Grant, G. Loihle, G. Hunt, Debugging in the (Very) Large: Ten Years of Implementation and Experience. SOSP, pp. 103-116, 2009.
7. A. E. Hassan, D. J. Martin, P. Flora, P. Mansfield, D. Dietz, An Industrial Case Study of Customizing Operational Profiles Using Log Compression. ICSE, pp. 713-723, 2008.
8. H. Le Guen, R. Marie, T. Thelin, Reliability Estimation for Statistical Usage Testing using Markov Chains. ISSRE, pp. 54-65, 2004.
9. K-Means Clustering in WEKA http://maya.cs.depaul.edu/classes/ect584/WEKA/ k-means.html retrieved on 2011-02-01
10. P. L. Li, J. Herbsleb, M. Shaw, B. Robinson, Experiences and Results from Initiating Field Defect Prediction and Product Test Prioritization Efforts at ABB Inc. ICSE, pp. 413-422, 2006.
11. P.L. Li, M. Ni, S. Xue, JP. Mullally, M. Garzia, M. Khambatti, Reliability Assessment of Mass-Market Software: Insights from Windows Vista. ISSRE pp. 265-270, 2008.
12. Microsoft Corp: http://www.microsoft.com/products/ceip/ENUS/default.mspx, retrieved on 2001-02-01
13. Microsoft Corp.: Introducing Windows Error Reporting. http://msdn2.microsoft.com/en-us/isv/bb190483.asp.
14. A. Mockus, P. Zhang, P.L. Li, Predictors of Customer Perceived Software Quality. ICSE, pp. 225-233, 2005.
15. J. C. Munson, S. Elbaum, Software Reliability as a Function of User Execution Patterns. International Conference on System Sciences, 1999
16. B. Murphy, Automating software failure reporting, ACM Queue. Vol 2, No 8,pp. 42-48, Nov. 2004.
17. J.D. Musa, A. Iannino, K. Okumoto, Software reliability: measurement, prediction, application, McGraw-Hill, 1987.
18. National Institute of Standards and Technology. The economic impacts of inadequate infrastructure for software testing. Planning Report 02-3, Jun. 2002
19. R Project for Statistical Computing, http://www.r-project.org/, retrieved on 2011-02-01
20. W. Wang, M. Tang, User-Oriented Reliability Modelling for a Web System. ISSRE, pp. 293-306, 2003.
21. K. Weyns, M. Host, Sensitivity of Website Reliability to Usage Profile Change. ISSRE, pp.3-8, 2007.
22. S. Xue, P.L. Li, J.P. Mullally, M. Ni, G. Nichols, S. Heddaya, B. Murphy, Predicting the Reliability of Mass-Market Software in the Marketplace Based on Beta Usage: a Study of Windows Vista and Windows 7. MSR Tech Report, MSR-TR-2011-2, 2011