Evaluating the internal consistency of ISO/IEC TR 15504 process capability measures

Software Process Improvement and Practice

Volumn 8, Issue 1, 2003, Pages 5-26

  Jung, Ho Won ^a  

^a Korea University   (South Korea)

Author keywords

Cronbach alpha; Dimensionality; Internal consistency; Measurement; Reliability; Software process assessments; SPICE

Indexed keywords

PARAMETER ESTIMATION; QUALITY CONTROL; RANDOM ERRORS; RELIABILITY; SOFTWARE ENGINEERING;

CRONBACH ALPHA; DIMENSIONALITY; INTERNAL CONSISTENCY; SOFTWARE PROCESS ASSESSMENTS;

STANDARDS;

EID: 14344260553     PISSN: 10774866     EISSN: None     Source Type: Journal    
DOI: 10.1002/spip.166     Document Type: Review

References (55)

1. Armor DJ. 1974. Theta reliability and factor scaling. In Sociological Methodology, Costner HL (ed.). Jossey-Bass: San Francisco; 17-50.
2. Balch GI. 1974. Multiple indicators in survey research: the concept 'sense of political efficacy'. Political Methodology 1: 1-44.
3. Blalock HM. 1968. The measurement problem: A gap between the languages of theory and research. In Methodology in Social Research, Blalock HM and Blalock AB (eds). McGraw-Hill: New York; 5-27.
4. Briand L, El-EmamK, Moraska S. 1996. On the application of measurement theory in software engineering. Empirical Software Engineering: An International Journal 1(1): 61-88.
5. Carmines EG, Zeller RA. 1979. Reliability and Validity Assessment, Sage University Paper Series on Quantitative Applications in Social Sciences. Sage: Newbury Park.
6. Cattell RB. 1966. The screen test for the number of factors. Multivariate Behavioral Research 1: 245-276.
7. Cliff NR. 1988. The eigenvalues-greater-than-one rule and reliability of components. Psychological Bulletin 103(2): 276-279.
8. Cohen J. 1988. Statistical Power and Analysis of Observational Sciences. Lawrence Erlbaum. Associates, Inc., Hillsdale, New Jersey.
9. Comrey A. 1973. A First Course on Factor Analysis. Academic Press: London.
10. Cronbach L. 1951. Coefficient alpha and the internal structure of tests. Psychometrika 16(3): 297-334.
11. El-Emam K. 1998. The internal consistency of the ISO/IEC 15504 software process capability scale. Proceedings of the 5th International Symposium on Software Metrics, 72-81.
12. El-Emam K. 1999. Benchmarking Kappa: interrater agreement in software process assessments. Empirical Software Engineering: An International Journal 4(2): 113-133.
13. El-Emam K, Birk A. 2000a. Validating the ISO/IEC measure of software development process capability. Journal of Systems and Software 51(2): 119-149.
14. El-Emam K, Birk A. 2000b. Validating the ISO/IEC measure of software requirement analysis process capability. IEEE Transactions on Software Engineering 26(6): 541-566.
15. El-Emam K, Goldenson D. 2000. An empirical review of software process assessments. Advances in Computers 53: 319-423.
16. El-Emam K, Jung H-W. 2001. An evaluation of the ISO/IEC 15504 assessment model. Journal of Systems and Software 59(1): 23-41.
17. El-Emam K, Marshall P. 1998. Interrater agreement in assessment ratings. In SPICE: The Theory and Practice of Software Process Improvement and Capability Determination, El-Emam K, Drouin J-N, Melo W (eds.). IEEE CS Press, California, CA; 357-362.
18. El-Emam K, Madhavji NH. 1995. The reliability of measuring organizational maturity. Software Process Improvement and Practice 1(1): 3-25.
19. El-Emam K, Goldenson D, Briand L, Marshall P. 1996a. Interrater agreement in SPICE based assessments: some preliminary results. Proceedings of the Fourth International Conference on the Software Process, 149-156.
20. El-Emam K, Briand L, Smith R. 1996b. Assessor agreement in rating SPICE processes. Software Process Improvement and Practice 2(4): 291-306.
21. El-Emam K, Simon J-M, Rousseau S, Jacquet E. 1998. Cost implications of interrater agreement for software process assessment. Proceedings of the 5th International Symposium on Software Metrics, 38-51.
22. Fusaro P, El-Emam K, Smith B. 1997. The internal consistencies of the 1987 SEI maturity questionnaire and the SPICE capability dimension. Empirical Software Engineering: An International Journal 3(2): 179-201.
23. Gardner P. 1975. Scales and statistics. Review of Educational Research 45(1): 43-57.
24. Heise DR, Bohrnstedt GW. 1970. Validity, invalidity, and reliability. In Sociological Methodology, Borgatta EF, Bohrnstedt GW (eds). Jossey-Bass: San Francisco; 104-129.
25. ISO/IEC Guide 21. 1981. An Adoption of International Standards in National Standards. ISO: Geneva, Switzerland.
26. ISO/IEC JTC1 Directive. 1999. Procedures for the Technical Work of ISO/IEC JTC1. ISO/IEC JTC1. ISO: Geneva, Switzerland, http://www.jtc1.org/ directives/toc.htm.
27. ISO/IEC TR2 15504. 1998. Information Technology - Software Process Assessment: Part 1 - Part 9 (Part 5 was published in 1999). ISO: Geneva, Switzerland.
28. Jung H-W. 2003. Evaluating the interrater agreement in SPICE-based software process assessments. Computer Standards and Interfaces 25(5): 477-499.
29. Jung H-W, Hunter R. 2001. The Relationship between ISO/IEC 15504 process capability levels, ISO 9001 certification, and organizational size: an empirical study. Journal of Systems and Software 59(1): 43-55.
30. Jung H-W, Hunter R. 2002. An evaluation of the SPICE rating scale with regard to the internal consistency of capability measurement. Proceedings of SPICE2002.
31. Jung H-W, Hunter R, Goldenson D, El-Emam K. 2001. Findings from phase 2 of the SPICE trials. Software Process Improvement and Practice 6(2): 205-242.
32. Kaiser HF. 1970. A second generation Little Jiffy. Psychometrika 35: 401-417.
33. Kaiser HF, Rice J. 1974. Little Jiffy Mark IV. Educational and psychological Measurement 34: 111-117.
34. KSPICE. 2002. A Guideline for KSPICE Assessment Procedure. KSPICE: Seoul, Korea.
35. Kuder GF, Richardson MW. 1937. The theory of the estimation of test reliability. Psychometrics 2: 151-160.
36. Lee H-Y, Jung H-W, Chung C-S, Lee J-M, Lee K-W, Jeong H-J. 2001. Analysis of interrater agreement in ISO/IEC 15504-based software process assessment. Proceedings of the 2nd Asia-Pacific Conference on Quality Software, 341-348.
37. Likert R, Roslow S. 1934. The Effects Upon the Reliability of Attitude Scales of Using Three, Five, Seven Alternatives. Working paper, New York University.
38. Lissitz RW, Green SB. 1975. Effects of the number of scale points on reliability: a Monte Carlo approach. Journal of Applied Psychology 60: 10-13.
39. McIver JP, Carmines EG. 1981. Unidimensional Scaling, Sage University Paper Series on Quantitative Applications in Social Sciences. Sage: Newbury Park.
40. Nunnally JC, Bernstein IH. 1994. Psychometric Theory. McGraw-Hill: New York.
41. Novick M, Lewis G. 1967. Coefficient alpha and the reliability of composite measurements. Psychometrika 32: 1-13.
42. Sanders M (Ed.). 1998. The SPIRE Handbook: Better, Faster, Cheaper Software Development in Small Organizations. The SPIRE Project Team: ESSI Project 23873.
43. SEI. 2000a. Assessment Requirements for CMMI (ACE), Version 1.0. CMU/SEI-2000-TR-011. Software Engineering Institute, Carnegie Mellon University: Pittsburgh, PA.
44. SEI. 2000b. Standard CMMI Appraisal Method for Process Improvement (SCAMPI), Version 1.1: Method Definition Document. CMU/SEI-HB-2001. Software Engineering Institute, Carnegie Mellon University: Pittsburgh, PA.
45. Sharma S. 1996. Applied Multivariate Techniques. John Wiley & Sons: New York.
46. Spector PF. 1980. Ratings of equal and unequal response choice intervals. Journal of Social Psychology 112: 115-119.
47. Spector PF. 1992. Summated Rating Scale Construction: An introduction. Sage University Paper Series on Quantitative Applications in Social Sciences, Sage: Newbury Park.
48. SPICE Trials. 1998. Phase 2 SPICE Trials Interim Report, Version 1.00, ISO/IEC JTC1/SC7/WG10.
49. SPICE Trials. 1999. Phase 2 SPICE Trials Final Report, Vol. 1, ISO/IEC JTC1/SC7/WG10.
50. Stevens S. 1951. Mathematics, measurement, and psychophysics. In Handbook of Experimental Psychology, Stevens S (eds.). John Wiley & Son: New York; 849-856.
51. Trochim W. 2001. The Research Methods Knowledge Base, 2nd edn, atomicdogpublishing.com.
52. Van De Ven AH, Ferry DL. 1980. Measuring and Assessing Organizations. John Wiley & Son: New York.
53. Velleman P, Wilkinson L. 1993. Normal, ordinal, interval, and ratio typologies are misleading. The American Statistician 47: 65-72.
54. WG10.2001. SPICE Network, ISO/IEC JTC1/SC7/WG10.
55. Zeller RA, Carmines EG. 1980. Measurement in the Social Sciences: The Link between Theory and Data. Cambridge University Press: Cambridge, MA.