The importance of dealing with uncertainty in the evaluation of software engineering methods and tools

ACM International Conference Proceeding Series

Volumn 27, Issue , 2002, Pages 691-698

  Canfora, Gerardo ^a   Troiano, Luigi ^a  

^a UNIVERSITY OF SANNIO   (Italy)

Author keywords

aggregation; decision making; decision support systems; evaluation; fuzzy logic

Indexed keywords

AGGREGATION; CRITICAL SUCCESS FACTOR; EVALUATING SOFTWARE; FUZZY EVALUATION METHOD; MARKET LEADERSHIP; ORDERED FUZZY NUMBER; SOFTWARE ENGINEERING METHODS; SOFTWARE TOOL; TECHNOLOGY ADOPTION; WEIGHTED AVERAGING;

COMPUTER SOFTWARE SELECTION AND EVALUATION; DECISION SUPPORT SYSTEMS; DECISION THEORY; ENGINEERING; FUZZY LOGIC; FUZZY SETS; RISK PERCEPTION; SOFTWARE ENGINEERING;

KNOWLEDGE ENGINEERING;

EID: 77953767451     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/568760.568880     Document Type: Conference Paper

References (45)

1. Troiano, L., "Valutazione di Strumenti e Metodi per l'Ingegneria del Software mediante la Matematica Fuzzy," T.L. in Ingegneria Informatica, Università degli Studi Federico II, Napoli, a.a. 1998-99.
2. Canfora G., L. Troiano, "An Extended Model for Ordered Weighted Averaging Applied to Decision Making," submitted to Fuzzy Sets and Systems, 2001.
3. Canfora G., L. Troiano, "An Extensive Comparison between OWA and OFNWA Aggregation," VIII Sigef Congress, Naples - Italy, July 2001.
4. ISO/IEC, "Information Technology - Software Product Evaluation", ISO/IEC 9126, 1991.
5. Bergmann, W. B., " Buying Commercial and Nondevelopmental Items: A Handbook," Office of the Under Secretary of Defense for Acquisition and Technology, 1996.
6. Boehm, B., B. Clark, E. Horowitz, C. Westland, R. Madachy, R. Selby, "Cost models for future software life cycle processes: COCOMO 2.0," Annals of Software Engineering, vol.1, Baltzer, Amsterdam, 1995, pp. 57-94.
7. Boehm, B., B. Clark, E. Horowitz, C. Westland, R. Madachy, R. Selby, "The COCOMO 2.0 software cost estimation model. A status report," American Programmer, vol.9, no.7, 1996, pp. 2-17.
8. Center for Software Engineering, "COCOMO II Model Definition Manual," Computer Science Department, Univ. Southern Cal., 1998.
9. Loral Federal Systems, "COTS Product Identification and Evaluation Process," 1995.
10. Maiden, N. A., C. Ncube, "Acquiring COTS software selection requirements," IEEE Software, vol.15, no.2, 1998, pp. 46-56.
11. Robertson, J., S. Robertson, "Volere Requirements Specification Template, Edition 4," Atlantic Systems Guild, 1997.
12. Herschel, D., "Techniques for selecting a start-up vendor," Gartner Group, #TG-06-0532, 1998.
13. Miller, J. R., R. Jeffries, "Usability Evaluation: Science of Trade-offs," IEEE Software Real-Time Realities, 1992, pp. 97-102.
14. Wikenheiser, D. A., G. Tyrl, "NSIPS/Oracle HR Fit Analysis Report," 1996.
15. Anderson, E., "A Heuristic for Software Evaluation and Selection," Software Practice and Experience, Vol. 19, No. 8, 1989, pp. 707-717.
16. Morisio, M., A. Tsoukiàs, "IusWare: a methodology for the evaluation and selection of software products," IEEE Proceedings of Software Engineering, Vol. 144, No. 3, 1997, pp. 162-174.
17. Roy, B., D. Bouyssou Lamsade, "Comparison of a Multi-Attribute Utility and an Outranking Model Applied to a Nuclear Power Plant Siting Example," Proceedings of Decision Making with Multiple Objectives, Cleveland, Ohio, 1984
18. Roy, B., "The Outranking Approach and the Foundations of ELECTRE Methods," Theory and Decision, Vol. 31, Kluwer Academic Publishers, Netherlands, 1991, pp. 49-73.
19. Yoon, K., C. Hwang, "Multiple Attribute Decision Making: an Introduction, " Sage Publications, 1995.
20. Saaty, T., "The Analytic Hierarchy Process," McGraw-Hill, New York, 1990.
21. Belton, V., "A Comparison of the analytic hierarchy process and a simple multi-attribute value function," European Journal of Operational Research, Vol. 26, No. 1, 1986, pp. 7-21.
22. Dyer, J., "Remarks on the Analytic Hierarchy Process," Management Science, Vol. 36, No. 3, 1990, pp. 249-275.
23. Saaty, T., "An Exposition of the AHP In Reply to the Paper 'Remarks on the Analytic Hierarchy Process'," Management Science, Vol. 36, No. 3, 1990.
24. Harker, P. and Vargas, L., "Reply to 'Remarks on the Analytic Hierarchy Process'," Management Science, Vol. 36, No. 3, 1990.
25. Edwards, W., J. R. Newman, "Multi-attribute Evaluation: Series on Quantitative Applications in the Social Sciences," Sage Publications, Beverly Hills, 1982.
26. Finnie, G., G. Wittig, D. Petkov, "Prioritizing Software Development Productivity Factors Using Analytic Hierarchy Process," Journal of Systems and Software, Vol. 22, No. 3, 1993, pp. 129-139.
27. Forman, E., "Facts and Fictions about the Analytic Hierarchy Process," Mathematical Computer Modeling, Vol. 17, No. 4/5, Pergamon Press Ltd., Great Britain, 1993, pp. 19-26.
28. Hong, S., R. Nigam, "Analytic Hierarchy Process Applied to Evaluation of Financial Modeling Software," Proceedings of the 1st International Conference on Decision Support Systems, Atlanta, GA, 1981.
29. Hwang, C.L., K. Yoon, "Multiple attribute decision making: methods and applications : a state-of-the-art survey, " #186, Springer-Verlag, Berlin, 1981.
30. Jeanrenaud, A., P. Romanizzi, "Software Product Evaluation Metrics: Methodological Approach," Software Quality Management II. Building Quality into Software 2, 1995, 776, pp. 59-69.
31. Kitchenham, B., S. Linkman, D. Law, "DESMET: a methodology for evaluating software engineering methods and tools," Computing & Control Engineering Journal, vol.8, no.3, 1997, pp. 120-126. (Pubitemid 127671649)
32. Kitchenham, B. A., S. G. Linkman, D. T. Law, "Critical Review of Quantitative Assessment," Software Engineering Journal, vol.9, no.2, 1994, pp. 43-53.
33. Kitchenham, B., L. Pickard, S. L. Pfleeger, "Case Studies for Method and Tool Evaluation," IEEE Software Features, 12, 1995, pp. 52-62.
34. Mayrand, J., F. Coallier, "System Acquisition Based on Software Product Assessment," Proceedings of the 18th International Conference on Software Engineering, 1996, pp. 210-219.
35. Min, H., "Selection of Software: The Analytic Hierarchy Process," International Journal of Physical Distribution and Logistics Management, Vol. 22, No. 1, 1992, pp. 42-52.
36. Rivett, P., "Multi-dimension scaling for multi-objective policies," OMEGA, Int'l J of Mgmt Sci., V. 5, no. 4, Pergamon Press, 1997, pp. 367-378.
37. Tversky, A., D. Kahneman, "Advances in prospect theory: Cumulative representation of uncertainty," Journal of Risk and Uncertainty, 5, 1992, pp. 297-323.
38. Knight, F.H., "Risk, uncertainty and profit," Houghton Mifflin, Boston, 1921.
39. Yager, R.R., "On ordered weighted averaging aggregation operators in multi-criteria decision making," IEEE Trans. on Systems, Man, and Cybernetics, 18(1), 1988, pp.183-190.
40. Bellman, R.E., Zadeh, L.A. "Decision making in a fuzzy environment," Management Science, 17(4), 1970, pp. 141-164.
41. Zadeh, L. A., "A fuzzy-set-theoretic interpretation of linguistic hedges," Journal of Cybernatics 2:2, 1972, pp. 4-34.
42. Zadeh, L. A., "Outline of a new approach to the analysis of complex systems and decision processes," IEEE Trans. Systems, Man, and Cybernetics, SMC-3, 1973.
43. Chen, S.J., Hwang, C.L., "Fuzzy Multiple Attribute Decision Making: Methods and Applications.", Springer-Verlag, New York, 1992.
44. Yager, R. R., "On the Issue of Importance Qualification in Fuzzy Multi-Criteria Decision Making," Machine Intelligence Institute, Iona College, New Rochelle, NY.
45. Sugeno, M., Takagi, T., "A new approach to design of fuzzy controllers," In Advances in Fuzzy Sets, Possibility Theory and Applications, Wang, P. P. (Ed.), Plenum Press: New York, 1983, pp.325-334.