When 90% confidence intervals are 50% certain: On the credibility of credible intervals

Applied Cognitive Psychology

Volumn 19, Issue 4, 2005, Pages 455-475

  Teigen, Karl Halvor ^a   Jørgensen, Magne ^b  

^a UNIVERSITY OF OSLO   (Norway)

^b SIMULA RESEARCH LABORATORY   (Norway)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ADULT; ANALYSIS OF VARIANCE; ARTICLE; CALCULATION; CALIBRATION; CONFIDENCE INTERVAL; CONTROLLED STUDY; DECISION MAKING; FEEDBACK SYSTEM; FEMALE; HUMAN; HUMAN EXPERIMENT; INTERMETHOD COMPARISON; MALE; NONVERBAL COMMUNICATION; NORWAY; PRIORITY JOURNAL; PROBABILITY; QUESTIONNAIRE; RELIABILITY; TASK PERFORMANCE; VERBAL COMMUNICATION;

EID: 19144365104     PISSN: 08884080     EISSN: None     Source Type: Journal    
DOI: 10.1002/acp.1085     Document Type: Article

References (38)

1. Alpert, M., & Raiffa, H. (1982). A progress report on the training of probability advisors. In D. Kahneman, P. Slovic, & A. Tversky (Eds.), Judgment under uncertainty: Heuristics and biases (pp. 294-305). Cambridge: Cambridge University Press.
2. Arkes, H. R. (2001). Overconfidence in judgmental forecasting. In J. S. Armstrong (Ed.), Principles of forecasting (pp. 495-515). Boston: Kluwer Academic Publishers.
3. Bazerman, M. H. (1994). Judgment in managerial decision making, 3rd ed. New York: Wiley.
4. Budescu, D. V., & Wallsten, T. S. (1995), Processing linguistic probabilities: general principles and empirical evidence. The Psychology of Learning and Motivation, 32, 275-318.
5. Buehler, R., Griffin, D., & Ross, M. (1994). Exploring the 'planning fallacy': why people under-estimate their task completion time. Journal of Personality and Social Psychology, 67, 366-381.
6. Connolly, T., & Dean, D. (1997). Decomposed versus holistic estimates of effort required for software writing tasks. Management Science, 43, 1029-1045.
7. Erev, I., Wallsten, T. S., & Budescu, D. V. (1994). Simultaneous over- and under-confidence: the role of error in judgment processes. Psychological Review, 101, 519-527.
8. Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1991). Probabilistic mental models: A Brunswikian theory of confidence. Psychological Review, 106, 180-209.
9. Grice, H. P. (1975). Logic and conversation. In P. Cole, & J. L. Morgan (Eds.), Syntax and semantics 3: Speech acts. New York: Academic Press.
10. Hoffrage, U. (2004). Overconfidence. In R. F. Pohl (Ed.), Cognitive illusions: Fallacies and biases in thinking, judgment, and memory, pp. 235-254. Hove: Psychology Press.
11. Jørgensen, M. (2004). Increasing realism in assessment of effort estimation uncertainty: it matters how you ask. IEEE Transactions on Software Engineering, 30, 209-217.
12. Jørgensen, M., & Teigen, K. H. (2002). Uncertainty intervals versus interval uncertainty: an alternative method for eliciting effort prediction intervals in software development projects. Proceedings of International Conference on Project Management (pp. 343-352). Singapore: ProMAC-2002.
13. Jørgensen, M., Teigen, K. H., & Moløkken, K. (2004). Better sure than safe? Overconfidence in judgment based software development effort prediction intervals. Journal of Systems and Software, 70, 79-93.
14. Juslin, P., & Persson, M. (2002). PROBabilities from Exemplars (PROBEX): a 'lazy' algorithm for probabilistic inference from generic knowledge. Cognitive Science, 26, 563-607.
15. Juslin, P., Wennerholm, P., & Olsson, H. (1999). Format dependence in subjective probability calibration. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25, 1038-1052.
16. Kahneman, D. (2003). A perspective on judgment and choice: mapping bounded rationality. American Psychologist, 58, 697-720.
17. Kahneman, D., & Tversky, A. (1982). Variants of uncertainty. Cognition, 11, 143-157.
18. Keren, G. (1991). Calibration and probability judgments: conceptual and methodological issues. Acta Psychologica, 77, 217-273.
19. Kerzner, H. (2001). Project management: A systems approach to planning, scheduling, and controlling. New York: Wiley.
20. Klayman, J., Soll, J. B., Gonzáles-Vallejo, C., & Barlas, S. (1999).Overconfidence: it depends on how, what, and whom you ask. Organizational Behavior and Human Decision Processes, 79, 216-247.
21. Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980). Reasons for confidence. Journal of Experimental Psychology: Human Learning and Memory, 6, 107-118.
22. Liberman, V. (2004). Local and global judgments of confidence. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 729-732.
23. Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982). Calibration of probabilities: The state of the art to 1980. In D. Kahneman, P. Slovic, & A. Tversky (Eds.), Judgment under uncertainty: Heuristics and biases (pp. 306-334). Cambridge: Cambridge University Press.
24. May, R. S. (1986). Inferences, subjective probability and frequency of correct answers: a cognitive approach to the overconfidence phenomenon. In B. Brehmer, H. Jungermann, P. Lourens, & G. Sevon (Eds.), New directions in research on decision making. Amsterdam: North Holland.
25. McClelland, A. G. R., & Bolger, F. (1994). The calibration of subjective probabilities: theories and models 1980-94. In G. Wright, & P. Ayton (Eds.), Subjective probability (pp. 453-482). Chichester: John Wiley.
26. Moder, J. J., Phillips, C. R., & Davis, E. W. (1995). Project management with CPM, PERT and precedence diagramming. Wisconsin: Blitz Publishing Company.
27. Mussweiler, T., & Strack, F. (2000). Comparing is believing: a selective accessibility model of judgmental anchoring. In W. Stroebe, & M. Hewstone (Eds.), European Review of Social Psychology, 10 (pp. 135-167). Chichester, UK: Wiley.
28. NASA. (1990). Manager's handbook for software development. Greenbelt, MD: Goddard Space Flight Center.
29. One world - Nations online. (n.d.). Capitals and states of the world - Europe. Retrieved September 9, 2002, from http://www.nationsonline.org/oneworld/capitals_europe.htp.
30. Russo, J. E., & Schoemaker, P. J. H. (1989). Decision traps: Ten barriers to brilliant decision making and how to overcome them. New York: Simon and Schuster.
31. Seaver, D. A., Winterfeldt, D. v., & Edwards, W. (1978). Eliciting subjective probability distributions on continuous variables. Organizational Behavior and Human Performance, 21, 352-379.
32. Sniezek, J. A., & Buckley, T. (1991). Confidence depends on level of aggregation. Journal of Behavioral Decision Making, 4, 263-272.
33. Soll, J. B. (1996). Determinants of overconfidence and miscalibration: the roles of random error and ecological structure. Organizational Behavior and Human Decision Processes, 65, 117-137.
34. Soll, J. B., & Klayman, J. (2004). Overconfidence in interval estimates. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 299-314.
35. Teigen, K. H., & Brun, W. (2003). Verbal expressions of probability and uncertainty. In D. Hardman, & L. Macchi (Eds.), Thinking: Psychological perspectives on reasoning, judgment, and decision making (pp. 125-145). Chichester: Wiley.
36. Yaniv, I., & Foster, D. P. (1995). Graininess of judgment under uncertainty: an informativenes-accuracy tradeoff. Journal of Experimental Psychology: General, 124, 424-432.
37. Yaniv, I., & Foster, D. P. (1997). Precision and accuracy of judgmental estimation. Journal of Behavioral Decision Making, 10, 21-32.
38. Yaniv, I., & Schul, Y. (1997). Elimination and inclusion procedures in judgment. Journal of Behavioral Decision Making, 10, 211-220.