Ameliorating mental mistakes in tradeoff studies

Systems Engineering

Volumn 10, Issue 3, 2007, Pages 222-240

  Smith, Eric D ^a,b   Young, Jun Son ^b   Plattelli Palmarinl, Massimo ^c   Bahill, A Terry ^b  

^a Architectural and Environmental Engineering

^b University of Arizona

^c University of Arizona

Author keywords

Alternative solutions; Cognitive biases; Combining functions; Decision analysis; Evaluation criteria; Evaluation data; Preferred alternatives; Problem statement; Scores; Scoring functions; Trade studies; Tradeoff studies; Weights of importance

Indexed keywords

DECISION MAKING; ERROR ANALYSIS; NUMERICAL METHODS; SENSORY PERCEPTION; SYSTEMS ENGINEERING;

COGNITIVE BIASES; COMBINING FUNCTIONS; EVALUATION CRITERIA; EVALUATION DATA; PREFERRED ALTERNATIVES; PROBLEM STATEMENT; SCORING FUNCTIONS; TRADEOFF STUDIES;

DECISION THEORY;

EID: 34548460261     PISSN: 10981241     EISSN: 15206858     Source Type: Journal    
DOI: 10.1002/sys.20072     Document Type: Article

References (76)

1. G. Ainslie, Breakdown of will, Cambridge University Press, New York, 2001.
2. H.R. Arkes, Impediments to accurate clinical judgment and possible ways to minimize their impact, J Consult Social Psychol 49 (1981), 323-330.
3. A.T. Bahill, Mathematical summary of multicriterion decision-making methods, p. 24, http:/www.sie.arizona.edu/sysengr/slides/tradeoffMath.doc, retrieved May 2007.
4. A.T. Bahill and W. L. Chapman, A tutorial on quality function deployment, Engr Man J, 5(3) (1993) 24-35.
5. A.T. Bahill and C. Briggs, The systems engineering started in the middle process: A consensus of system engineers and project managers, Syst Eng, 4(2) (2001) 156-167.
6. A.T. Bahill and F.F. Dean, "Discovering system requirements," Handbook of systems engineering and management, A.P. Sage and W.B. Rouse (Editors), Wiley, New York, 1999, pp. 175-220.
7. A.T. Bahill and W.J. Karnavas, Risk analysis of a pinewood derby: A case study, Syst Eng 3(3) (2000), 143-155.
8. A.T. Bahill, R. Botta, and J. Daniels, The Zachman framework populated with baseball models, J Enterprise Architecture 2(4) (2006), 50-68.
9. L.R. Beach and T. Connolly, The psychology of decision making: People in organizations, Sage, Thousand Oaks, CA, 2005.
10. D. Bradstreet, Patterns of success in managing a business, Dun & Bradstreet, New York, 1967.
11. D.M. Buede, The engineering design of systems: Models and methods, Wiley, New York, 2000.
12. D.G. Cacuci, Sensitivity and uncertainty analysis, Chapman & Hall/CRC Press, Boca Raton, FL, 2005.
13. W.L. Chapman, A.T. Bahill, and A.W. Wymore, Engineering modeling and design, CRC Press, Boca Raton, FL, 1992.
14. W.G. Chase and H.A. Simon, Perception in chess, Cognitive Psychol 4 (1973), 55-81.
15. CMMI, Capability Maturity Model Integration, Software Engineering Institute, Pittsburgh, PA, 2006, http://www.sei.cmu.edu/cmmi/, retrieved March 2006.
16. A.C. Cooper, C.Y. Woo, and W.C Dunkelberg, Entrepreneurs' perceived chances for success, J Bus Venturing 3 (1988), 97-108.
17. J. Daniels and A.T. Bahill, The hybrid process that combines traditional requirements and use cases, Syst Eng 7(4) (2004), 303-319.
18. J. Daniels, P.W. Werner, and A.T. Bahill, Quantitative methods for tradeoff analyses, Syst Eng 4(3) (2001), 190-212.
19. DAR, DAR basics: Applying decision analysis and resolution in the real world, Software Engineering Institute, Pittsburgh, PA, 2004, http://www.sei.cmu.edu/cmmi/presentations/sepg04.presentations/dar.pdf, retrieved March 2006.
20. W. Edwards, How to use multiattribute utility analysis for social decision making, IEEE Trans Syst Man Cybernet SMC-7 (1977), 326-340.
21. B.R. Forer, The fallacy of personal validation: A classroom demonstration of gullibility, J Abnormal Psychol 44 (1949), 118-121.
22. G. Gigerenzer, How to make cognitive illusions disappear: Beyond "heuristics and biases," Eur Rev Social Psychol 2(4) (1991), 83-115.
23. M. Gladwell, Blink: The power of thinking without thinking, Little Brown, New York, 2005.
24. D. Griffin and A. Tversky, The weighting of evidence and the determinants of confidence, Cognitive Psychol 24 (1992), 411-435.
25. Y.Y. Haimes, Risk modeling, assessment, and management, Wiley, Hoboken, NJ, 2004.
26. J.S. Hammond, R.L. Keeney, and H. Raiffa, The hidden traps in decision making, HBR Classic, Harvard Bus Rev 184(1) (2006), 118-132.
27. I.F. Hooks and K.A. Farry, Customer-centered products: Creating successful products through smart requirements management, AMACOM, New York, 2001.
28. C.K. Hsee, G. Loewenstein, S. Blount, and M. Bazerman, Preference reversals between joint and separate evaluations of options: A theoretical analysis, Psychol Bull 125(5) (1999), 576-590.
29. E. Hull, K. Jackson, and J. Dick, Requirements engineering, Springer, London, 2005.
30. INCOSE, INCOSE systems engineering handbook v2a, Seattle, 2004, Xhttp://www.incose.org/ProductsPubs/incosestore.aspx, retrieved March 2006.
31. D. Kahneman, A perspective on judgment and choice: Mapping bounded rationality, Amer Psychol 58(9) (2003), 697-720.
32. D. Kahneman and S. Frederick, "Representativeness revisited: Attribute substitution in intuitive judgment," Heuristics and biases, T. Gilovich, D. Griffin, and D. Kahneman (Editors), Cambridge University Press, New York, 2002, pp. 49-81.
33. D. Kahneman and I. Ritov, Determinants of stated willingness to pay for public goods: A study in the headline method, J Risk Uncertainty 9 (1994), 5-38.
34. D. Kahneman and A. Tversky, Prospect theory: An analysis of decision under risk, Econometrica 46(2) (1979), 171-185.
35. D. Kahneman, P. Slovic, and A. Tversky (Editors), Judgment under uncertainty: Heuristics and Biases, Cambridge University Press, Cambridge, MA, 1982.
36. W.J. Karnavas, P.J, Sanchez, and A.T. Bahill, Sensitivity analyses of continuous and discrete systems in the time and frequency domains, IEEE Trans Syst Man Cybernet SMC-23 (1993), 488-501.
37. R.L. Keeney, Value-focused thinking: A path to creative decisionmaking, Harvard University Press, Cambridge, MA, 1992.
38. R. L. Keeney, Common mistakes in making value trade-offs, Oper Res 50(6) (2002), 935-945.
39. R.L. Keeney and H. Raiffa, Decisions with multiple objectives: Preferences and value tradeoffs, Wiley, New York, 1976.
40. C.W. Kirkwood, "Decision analysis," Handbook of systems engineering and management, A.P. Sage and W.B. Rouse (Editors), Wiley, Hoboken, NJ, 1999, pp. 1119-1145.
41. G. Klein, Sources of power: How people make decisions, MIT Press, Cambridge, MA, 1998.
42. R.M. Koriat, S. Lichtenstein, and B. Fischhoff, Reasons for confidence, J Exper Psychol Hum Learn Memory 6 (1980), 107-118.
43. N.G. Leveson, System safety engineering: back to the future, http://sunnyday.mit.edu/book2.html, retrieved May 2007.
44. S. Lichtenstein, and P. Slovic, Reversals of preferences between bids and choices in gambling decisions, J Exper Psychol 89 (1971), 46-55.
45. K.R. MacCrimmon, "An overview of multiple objective decision making," Multiple criteria decision making, J.L. Cochrane, and M. Zelany (Editors), University of South Carolina Press, Columbia, SC, 1973, pp. 18-43.
46. B. Martino De, D. Kumaran, B. Seymour, and R.J. Dolan, Frames, biases, and rational decision-making in the human brain, Science 313(5787) (2006), 684-687.
47. G.A. Miller, The magic number seven, plus or minus two: Some limits on our capacity for processing information, Psychol Rev 63 (1956), 81-87.
48. R.S. Nickerson, Confirmation bias: A ubiquitous phenomenon in many guises, Rev Gen Psychol 2 (1998), 175-220.
49. C.W. Park, D.L. Mothersbaugh, and L. Feick, Consumer knowledge assessment, J Consumer Res 21 (1994), 71-82.
50. H. Petroski, Framing hypotheses: A cautionary tale, Amer Scientist 91(2) (2003), 18-22.
51. M. Piattelli-Palmarini, Inevitable illusions: How mistakes of reason rule our minds, Wiley, New York, 1994.
52. Pinewood, Pinewood Derby tradeoff study, Tucson, AZ, 2006, http://www.sie.arizona.edu/sysengr/pinewood/pinewood.pdf.
53. D. Redelmeier and E. Shafir, Medical decision making in situations that offer multiple alternatives, JAMA 273(4) (1995), 302-305.
54. RSAS,"Press release: Nobel Prize in Economics 2002, The Royal Swedish Academy of Sciences, Stockholm, 2002, http://nobelprize.org/nobeLprizes/ economics/laureates/2002/press.html, retrieved September 2002.
55. T. Saaty, The analytic hierarchy process: Planning, priority setting, resource allocation, McGraw-Hill, New York, 1980.
56. A.P. Sage (Editor), Concise encyclopedia of information processing in systems & organizations, Pergamon Press, Oxford, UK, 1990.
57. A. Saltelli, S. Tarantola, F. Campolongo, and M. Ratto, Sensitivity analysis in practice: A guide to assessing scientific models, Wiley, Hoboken, NJ, 2004.
58. D.L. Schacter, Feeling of knowledge in episodic memory, J Exper Psychol Learn Memory Cognition 9 (January 1983), 39-54.
59. E. Shafir (Editor), Preferences, belief and similarity: Selected writings, The MIT Press, Cambridge, MA, 2004.
60. H.A. Simon, A behavioral model of rational choice, Quart J Econ 59 (1955), 99-118.
61. H.A. Simon, Models of man: Social and rational, Wiley, New York, 1957.
62. P. Slovic and B. Fischhoff, On the psychology of experimental surprises, J Exper Psychol Hum Perceptions Performance 3 (1977), 544-551.
63. E.D. Smith, Tradeoff studies and cognitive biases, Ph.D. dissertation, Systems and Industrial Engineering, University of Arizona, Tucson, AZ, 2006.
64. E.D. Smith, F. Szidarovszky, W.J. Karnavas, and A.T. Bahill, Sensitivity analysis, a powerful system validation tool, University of Arizona, Tucson, AZ, 2005.
65. F. Strack, L.L. Martin, and N. Schwarz, Priming and communication: The social determinants of information use in judgements of life-satisfaction, Eur J Social Psychol 18 (1988), 429-442.
66. A. Tversky and D. Kahneman, Judgment under uncertainty: Heuristics and biases, Science 185 (1974), 1124-1131.
67. A. Tversky and D. Kahneman, The framing of decisions and the psychology of choice, Science 211 (1981), 453-458.
68. A. Tversky and D. Kahneman, Advances in prospect theory: Cumulative representation of uncertainty, J Risk Uncertainty 5 (1992), 297-323.
69. A. Tversky and D. Kahneman, "Advances in prospect theory: Cumulative representation of uncertainty," in Choices, Values and Frames, A. Tversky and D. Kahneman (Editors), Cambridge University Press / Russell Sage Foundation, New York and Cambridge UK, 2000, pp 44-65.
70. A. Tversky and E. Shafir, The disjunction effect in choice under uncertainty, Psychol Sci 3(5) (1992), 305-309.
71. A. Tversky, S. Sattath, and P. Slovic, Contingent weighting in judgment and choice, Psychol Rev 95(3) (1988), 371-384.
72. D.G. Ullman and B. Spiegel, Trade studies with uncertain information, 16th Annu Int Symp INCOSE, paper 9.3.1 C.D ROM, 2006.
73. M. Weber and K. Borcherding, Behavioral influences on weight judgments in multiattribute decision making, Eur J Oper Res 26 (1993), 35-41.
74. W.A. Wickelgren, How to solve problems: Elements of a theory of problems and problem solving, Freeman, San Francisco, 1974.
75. A.W. Wymore, Model-based systems engineering, CRC Press, Boca Raton, FL, 1993.
76. A.W. Wymore, The nature of research in systems engineering, USC Conf Syst Eng Res, April 15-16, 2004, Los Angeles, CA, paper 119, CD ROM, 2004.