Determinants of Linear Judgment: A Meta-Analysis of Lens Model Studies

Psychological Bulletin

Volumn 134, Issue 3, 2008, Pages 404-426

  Karelaia, Natalia ^a   Hogarth, Robin M ^b,c  

^a UNIVERSITY OF LAUSANNE   (Switzerland)

^b INSTITUCIÓ CATALANA DE RECERCA I ESTUDIS AVANÇATS ICREA   (Spain)

^c DEPARTMENT OF ECONOMICS AND BUSINESS   (Spain)

Author keywords

bootstrapping; judgmental accuracy; learning; lens model; linear models

Indexed keywords

ARTICLE; DECISION MAKING; HUMAN; LEARNING; PSYCHOLOGICAL MODEL; PSYCHOLOGY; STATISTICAL MODEL; STATISTICS;

HUMANS; JUDGMENT; LEARNING; LINEAR MODELS; MODELS, PSYCHOLOGICAL; PSYCHOLOGY;

EID: 43149107912     PISSN: 00332909     EISSN: None     Source Type: Journal    
DOI: 10.1037/0033-2909.134.3.404     Document Type: Article

References (166)

1. Adelman L. The influence of formal, substantive, and contextual task properties on the relative effectiveness of different forms of feedback in multiple-cue probability learning tasks. Organizational Behavior and Human Performance 27 (1981) 423-442
2. Ader H.J., and Mellenbergh G.J. Research methodology in the life, behavioural and social sciences (1999), Sage, London
3. Anderson N.H. Foundations of information integration theory (1981), Academic Press, New York
4. Armelius B.-A., and Armelius K. The use of redundancy in multiple-cue judgments: Data from a suppressor-variable task. American Journal of Psychology 87 (1974) 385-392
5. Ashton R.H. A descriptive study of information evaluation. Journal of Accounting Research 19 1 (1981) 42-61
6. Ashton A.H. An empirical study of budget-related predictions of corporate executives. Journal of Accounting Research 20 (1982) 440-449
7. Athanasou J.A., and Cooksey R.W. Judgment of factors influencing interest: An Australian study. Journal of Vocational Education Research 26 (2001) 77-96. http://scholar.lib.vt.edu/ejournals/JVER/v26n1/athanasou.html Retrieved from http://scholar.lib.vt.edu/ejournals/JVER/v26n1/athanasou.html
8. Balzer W.K., Doherty M.E., and O'Connor R. Effects of cognitive feedback on performance. Psychological Bulletin 3 (1989) 410-433
9. Balzer W.K., Sulsky L.M., Hammer L.B., and Sumner K.E. Task information, cognitive information, or functional validity information: Which components of cognitive feedback affect performance?. Organizational Behavior and Human Decision Processes 53 (1992) 35-54
10. Begg C.B., and Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics 50 (1994) 1088-1101
11. Bisantz A.M., Kirlik A., Gay P., Phipps D.A., Walker N., and Fisk A.D. Modeling and analysis of a dynamic judgment task using a lens model approach. IEEE Transactions on Systems, Man, and Cybernetics-Part A, Systems and Humans 30 (2000) 605-616
12. Bisantz A.M., and Pritchett A.R. Measuring the fit between human judgments and automated alerting algorithms: A study of collision detection. Human Factors 45 (2003) 266-280
13. Brehmer B. Cognitive dependence on additive and configural cue-criterion relations. American Journal of Psychology 82 (1969) 490-503
14. Brehmer B. Effects of cue validity on interpersonal learning of inference tasks with linear and non-linear cues. American Journal of Psychology 86 (1973) 29-48
15. Brehmer B. Effects of task predictability and cue validity on interpersonal learning of inference tasks involving both linear and non-linear relations. Organizational Behavior and Human Performance 10 (1973) 24-46
16. Brehmer B. The effect of cue intercorrelation on interpersonal learning of probabilistic inference tasks. Organizational Behavior and Human Performance 12 (1974) 397-412
17. Brehmer B. Note on clinical judgment and the formal characteristics of clinical tasks. Psychological Bulletin 83 (1976) 778-782
18. Brehmer B. In one word: Not from experience. Acta Psychologica 45 (1980) 223-241
19. Brehmer B. The psychology of linear judgement models. Acta Psychologica 87 (1994) 137-154
20. Brehmer B., and Hagafors R. Use of experts in complex decision making: A paradigm for the study of staff work. Organizational Behavior and Human Decision Processes 38 (1986) 181-195
21. Brehmer B., and Joyce C.R.B. Human judgment: The SJT view (1988), North-Holland, Amsterdam
22. Brehmer B., and Kuylenstierna J. Content and consistency in probabilistic inference tasks. Organizational Behavior and Human Performance 26 (1980) 54-64
23. Brunswik E. Organismic achievement and environmental probability. Psychological Review 50 (1943) 255-272
24. Brunswik E. The conceptual framework of psychology (1952), University of Chicago Press, Chicago
25. Brunswik E. Representative design and probabilistic theory in a functional psychology. Psychological Review 62 (1955) 193-217
26. Camerer, C. (1979). A general theory of judgment improvement. Unpublished manuscript, University of Chicago.
27. Camerer C.F. General conditions for the success of bootstrapping models. Organizational Behavior and Human Performance 27 (1981) 411-422
28. Camerer C.F., and Hogarth R.M. The effects of financial incentives in experiments: A review and capital-labor-production framework. Journal of Risk and Uncertainty 19 (1999) 7-42
29. Camerer C.F., and Johnson E.J. The process-performance paradox in expert judgment: How can experts know so much and predict so badly?. In: Goldstein W.M., and Hogarth R.M. (Eds). Research on judgment and decision making: Currents, connections, and controversies (1997), Cambridge University Press, Cambridge, United Kingdom 342-364
30. Castellan Jr. N.J. Comments on the "lens model" equation and the analysis of multiple-cue judgment tasks. Psychometrika 38 (1973) 87-100
31. Castellan Jr. N.J. Relations between linear models: Implications for the lens model. Organizational Behavior and Human Decision Processes 51 (1992) 364-381
32. Chasseigne G., Grau S., Mullet E., and Cama V. How well do elderly people cope with uncertainty in a learning task?. Acta Psychologica 103 (1999) 229-238
33. Chasseigne G., Mullet E., and Stewart T.R. Aging and multiple cue probability learning: The case of inverse relationships. Acta Psychologica 97 (1997) 235-252
34. Cohen L.J. Can human irrationality be experimentally demonstrated?. The Behavioral and Brain Sciences 4 (1981) 317-370
35. Connolly T., and Miklausich V.M. Some effects of feedback error in diagnostic decision tasks. Academy of Management Journal 21 (1978) 301-307
36. Cooksey R.W. Judgment analysis: Theory, methods, and applications (1996), Academic Press, New York
37. Cooksey R.W., Freebody P., and Bennett A.J. The ecology of spelling: A lens model analysis of spelling errors and student judgments of spelling difficulty. Reading Psychology: An International Quarterly 11 (1990) 293-322
38. Cooksey R.W., Freebody P., and Davidson G.R. Teachers' predictions of children's early reading achievement: An application of social judgment theory. American Educational Research Journal 23 (1986) 41-64
39. Cooksey R.W., Freebody P., and Wyatt-Smith C. Assessment as judgment-in-context: Analysing how teachers evaluate students' writing. Educational Research and Evaluation 13 (2007) 401-434
40. Cooper R.P., and Werner P.D. Predicting violence in newly admitted inmates: A lens model analysis of staff decision making. Criminal Justice and Behavior 17 (1990) 431-447
41. Dalgleish L.I. Decision making in child abuse cases: Applications of SJT and signal detection theory. In: Brehmer B., and Joyce C.R.B. (Eds). Human judgment: The SJT view (1988), North Holland, Amsterdam, Netherlands 317-360
42. Dawes R.M. A case study of graduate admissions: Applications of three principles of human decision making. American Psychologist 26 (1971) 180-188
43. Dawes R.M., and Corrigan B. Linear models in decision making. Psychological Bulletin 81 (1974) 95-106
44. Dawes R.M., Faust D., and Meehl P.E. Clinical versus actuarial judgment. Science 243 (1989) 1668-1674
45. Deane D.H., Hammond K.R., and Summers D.A. Acquisition and application of knowledge in complex inference tasks. Journal of Experimental Psychology 92 (1972) 20-26
46. DerSimonian R., and Laird N. Meta-analysis in clinical trials. Controlled Clinical Trials 7 (1986) 177-188
47. Dhami M.K., Hertwig R., and Hoffrage U. The role of representative design in an ecological approach to cognition. Psychological Bulletin 130 (2004) 959-988
48. Djamasbi S., Remus W., and O'Connor M. Does mood influence judgment accuracy?. Proceedings of the 2004 IFIP TC8/WG8.3 International Conference: Decision support in an uncertain and complex world (2004) 213-222. http://users.wpi.edu/~djamasbi/Djamasbi%20et%20al%20(DSS-Conference%2020 04).pdf Retrieved from http://users.wpi.edu/~djamasbi/Djamasbi%20et%20al%20(DSS-Conference%2020 04).pdf
49. Doherty M.E., Tweney R.D., O'Connor Jr. R.M., and Walker B. The role of data and feedback error in inference and prediction [Final report for ARI contract MDA903-85-K-0193] (1988), Bowling Green State University, Bowling Green, OH
50. Dougherty T.W., Ebert R.J., and Callender J.C. Policy capturing in the employment interview. Journal of Applied Psychology 71 (1986) 9-15
51. Dudycha L.W., and Naylor J.C. Characteristics of the human inference process in complex choice behavior situations. Organizational Behavior and Human Performance 1 (1966) 110-128
52. Dunwoody P.T., Haarbauer E., Mahan R.P., Marino C.J., and Tang C.C. Cognitive adaptation and its consequences: A test of cognitive continuum theory. Journal of Behavioral Decision Making 13 (2000) 35-54
53. Duval S., and Tweedie R. Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 56 (2000) 455-463
54. Ebert R.J., and Kruse T.E. Bootstrapping the security analyst. Journal of Applied Psychology 63 (1978) 110-119
55. Egger M., Davey Smith G., Schneider M., and Minder C. Bias in meta-analysis detected by a simple, graphical test. British Medical Journal 315 (1997) 629-634
56. Einhorn H.J. Use of non-linear, noncompensatory models as a function of task and amount of information. Organizational Behavior and Human Performance 6 (1971) 1-27
57. Einhorn H.J. Expert measurement and mechanical combination. Organizational Behavior and Human Performance 7 (1972) 86-106
58. Einhorn H.J., and Hogarth R.M. Unit weighting schemes for decision making. Organizational Behavior and Human Performance 13 (1975) 171-192
59. Einhorn H.J., Kleinmuntz D.N., and Kleinmuntz B. Linear regression and process-tracing models of judgment. Psychological Review 86 (1979) 465-485
60. Field A.P. Meta-analysis of correlation coefficients: A Monte Carlo comparison of fixed- and random-effects methods. Psychological Methods 6 (2001) 161-180
61. Gifford R. A lens-mapping framework for understanding the encoding and decoding of interpersonal dispositions in nonverbal behavior. Journal of Personality and Social Psychology 66 (1994) 398-412
62. Gigerenzer G., and Goldstein D.G. Reasoning the fast and frugal way: Models of bounded rationality. Psychological Review 103 (1996) 650-669
63. Goldberg L.R. Man versus model of man: A rationale, plus some evidence, for a method of improving on clinical inferences. Psychological Bulletin 73 (1970) 422-432
64. Goldberg L.R. Man versus model of man: Just how conflicting is that evidence?. Organizational Behavior and Human Performance 16 (1976) 13-22
65. Gorman C.D., Clover W.H., and Doherty M.E. Can we learn anything about interviewing real people from "interviews" of paper people? Two studies of the external validity of a paradigm. Organizational Behavior and Human Performance 22 (1978) 165-192
66. Gosling S.D., Ko S.J., Mannarelli T., and Morris M.E. A room with a cue: Personality judgments based on offices and bedrooms. Journal of Personality and Social Psychology 82 (2002) 379-398
67. Grebstein L.C. Relative accuracy of actuarial prediction, experienced clinicians and graduate students in a clinical judgment task. Journal of Consulting Psychology 27 (1963) 127-132
68. Hammond K.R. Probabilistic functioning and the clinical method. Psychological Review 62 (1955) 255-262
69. Hammond K.R. Human judgment and social policy: Irreducible uncertainty, inevitable error, unavoidable injustice (1996), Oxford University Press, Oxford, United Kingdom
70. Hammond K.R., Hursch C.J., and Todd F.J. Analyzing the components of clinical inference. Psychological Review 71 (1964) 438-456
71. Hammond K.R., and Summers D.A. Cognitive dependence on linear and non-linear cues. Psychological Review 72 (1965) 215-224
72. Hammond K.R., Summers D.A., and Deane D.H. Negative effects of outcome feedback in multiple-cue probability learning. Organizational Behavior and Human Performance 9 (1973) 30-34
73. Hammond K.R., Wilkins M.M., and Todd F.J. A research paradigm for the study of interpersonal learning. Psychological Bulletin 65 (1966) 221-232
74. Harvey N., and Harries C. Effects of judges' forecasting on their later combination of forecasts for the same outcomes. International Journal of Forecasting 20 (2004) 391-409
75. Hastie R., and Kameda T. The robust beauty of majority rules in group decisions. Psychological Review 112 (2005) 494-508
76. Hedges L.V., and Vevea J.L. Fixed- and random-effects models in meta-analysis. Psychological Methods 3 (1998) 486-504
77. Higgins J.P.T., and Thompson S.G. Quantifying heterogeneity in a meta-analysis. Statistics in Medicine 21 (2002) 1539-1558
78. Hirst M.K., and Luckett P.F. The relative effectiveness of different types of feedback in performance evaluation. Behavioral Research in Accounting 4 (1992) 1-22
79. Hoffman P.J. The paramorphic representation of clinical judgment. Psychological Bulletin 57 (1960) 116-131
80. Hoffman P.J., Earle T.C., and Slovic P. Multidimensional functional learning (MFL) and some new conceptions of feedback. Organizational Behavior and Human Performance 27 (1981) 75-102
81. Hogarth R.M. Educating intuition (2001), University of Chicago Press, Chicago
82. Hogarth R.M. Is confidence in decisions related to feedback? Evidence from random samples of real-world behavior. In: Fiedler K., and Juslin P. (Eds). Information sampling and adaptive cognition (2006), Cambridge University Press, Cambridge, United Kingdom 456-484
83. Hogarth R.M., and Karelaia N. Simple models for multi-attribute choice with many alternatives: When it does and does not pay to face trade-offs with binary attributes. Management Science 51 (2005) 1860-1872
84. Hogarth R.M., and Karelaia N. Heuristic and linear models of judgment: Matching rules and environments. Psychological Review 114 (2007) 733-758
85. Hogarth R.M., Portell M., and Cuxart A. What risks do people perceive in everyday life? A perspective gained from the experience sampling method (ESM). Risk Analysis 27 (2007) 1427-1439
86. Holzworth R.J., and Doherty M.E. Feedback effects in a metric multiple-cue probability learning task. Bulletin of the Psychonomic Society 8 (1976) 1-3
87. Hunter J.E., and Schmidt F.L. Methods of meta-analysis: Correcting error and bias in research findings (2004), Sage, Thousand Oaks, CA
88. Hursch C.J., Hammond K.R., and Hursch J.L. Some methodological considerations in multiple-probability studies. Psychological Review 71 (1964) 42-60
89. Jarnecke R.W., and Rudestam K.E. Effects of amounts and units of information on the judgmental process. Perceptual and Motor Skills 13 (1976) 823-829
90. Kahneman D., and Tversky A. On the reality of cognitive illusions. Psychological Review 103 (1996) 582-591
91. Kaufmann E., and Athanasou J.A. A meta-analysis of judgment achievement in the lens model equation [Working paper] (2007), University of Mannheim; Sydney, Australia: University of Technology, Mannheim, Germany
92. Kenny D.A., and Albright L. Accuracy in interpersonal perception: A social relations analysis. Psychological Bulletin 102 (1987) 390-402
93. Kessler L., and Ashton R.H. Feedback and prediction achievement in financial analysis. Journal of Accounting Research 19 (1981) 146-162
94. Kleinmuntz B. Why we still use our heads instead of formulas: Toward an integrative approach. Psychological Bulletin 107 (1990) 296-310
95. Koele P. The influence of labelled stimuli on non-linear multiple-cue probability learning. Organizational Behavior and Human Performance 26 (1980) 22-31
96. Kuo Y.-Y., and Liang K.Y. Human judgment in New York state sales and use tax forecasting. Journal of Forecasting 23 (2004) 297-314
97. LaDuca A., Engel J.D., and Chovan J.D. An exploratory study of physicians' clinical judgment: An application of social judgment theory. Evaluation and the Health Professions 11 (1988) 178-200
98. Lafon P., Chasseigne G., and Mullet E. Functional learning among children, adolescents, and young adults. Journal of Experimental Child Psychology 88 (2004) 334-347
99. Law K.S. The use of Fisher's Z in Schmidt-Hunter type meta-analyses. Journal of Educational and Behavioral Statistics 20 (1995) 287-306
100. Lee J.-W., and Yates J.F. How quantity judgment changes as the number of cues increases: An analytical framework and review. Psychological Bulletin 112 (1992) 363-377
101. Levi K. Expert systems should be more accurate than human experts: Evaluation procedures from human judgment and decision making. IEEE Transactions on Systems, Man, and Cybernetics 19 (1989) 647-657
102. Libby R. Man versus model of man: Some conflicting evidence. Organizational Behavior and Human Performance 16 (1976) 1-12
103. Lindell M.K. Cognitive and outcome feedback in multiple-cue probability learning tasks. Journal of Experimental Psychology: Human Learning and Memory 2 (1976) 739-745
104. Lindell M.K., and Stewart T.R. The effects of redundancy in multiple-cue probability learning. American Journal of Psychology 87 (1974) 393-398
105. Lipsey M.W., and Wilson D.B. Practical meta-analysis (2001), Sage, Thousand Oaks, CA
106. Luft J.L., and Shields M.D. Why does fixation persist? Experimental evidence on the judgment performance effects of expensing intangibles. The Accounting Review 76 (2001) 561-587
107. MacGregor D., and Slovic P. Graphical representation of judgmental information. Human-Computer Interaction 2 (1986) 179-200
108. Maras, M. (2007). The disposition effect in the venture capital decision-making process: An experimental approach [Working paper]. Universitat Pompeu Fabra, Barcelona, Spain.
109. Martignon L., and Hoffrage U. Why does one-reason decision making work? A case study in ecological rationality. In: Gigerenzer G., Todd P.M., and the ABC Research Group (Eds). Simple heuristics that make us smart (1999), Oxford University Press, New York 119-140
110. Martignon L., and Hoffrage U. Fast, frugal, and fit: Simple heuristics for paired comparison. Theory and Decision 52 (2002) 29-71
111. Mear R., and Firth M. Assessing the accuracy of financial analyst security return predictions. Accounting, Organizations and Society 12 (1987) 331-340
112. Mehl M.R. The lay assessment of subclinical depression in daily life. Psychological Assessment 18 (2006) 340-345
113. Mehl M.R., Gosling S.D., and Pennebaker J.W. Personality on its natural habitat: Manifestations and implicit folk theories of personality in daily life. Journal of Personality and Social Psychology 90 (2006) 862-877
114. Miklich D.R., and Gillis J.S. Interaction of age and cue validities in multiple-cue probability learning by children. Psychological Reports 37 (1975) 235-240
115. Miller P.M. Do labels mislead? A multiple cue study, within the framework of Brunswik's probabilistic functionalism. Organizational Behavior and Human Performance 6 (1971) 480-500
116. Muchinsky P.M., and Dudycha A.L. Human inference behavior in abstract and meaningful environments. Organizational Behavior and Human Performance 13 (1975) 377-391
117. Naylor J.C., and Schenk E.A. The influence of cue redundancy upon the human inference process for task of varying degrees of predictability. Organizational Behavior and Human Performance 3 (1968) 47-61
118. Newton J.R. Judgment and feedback in a quasi-clinical situation. Journal of Personality and Social Psychology 1 (1965) 336-342
119. Nystedt L., and Magnusson D. Cue relevance and feedback in a clinical prediction task. Organizational Behavior and Human Performance 9 (1973) 100-109
120. O'Connor M., Remus W., and Lim K. Improving judgmental forecasts with judgmental bootstrapping and task feedback support. Journal of Behavioral Decision Making 18 (2005) 246-260
121. Payne J.W., Bettman J.R., and Johnson E.J. The adaptive decision maker (1993), Cambridge University Press, New York
122. Pelham B.W., and Neter E. The effect of motivation on judgment depends on the difficulty of the judgment. Journal of Personality and Social Psychology 68 (1995) 581-594
123. Raudenbush S.W., and Bryk A.S. Hierarchical linear models: Applications and data analysis methods (2002), Sage, Thousand Oaks, CA
124. Reilly B.A., and Doherty M.E. The assessment of self-insight in judgment policies. Organizational Behavior and Human Decision Processes 53 (1992) 285-309
125. Remus W., O'Connor M., and Griggs K. Does feedback improve the accuracy of recurrent judgmental forecasts?. Organizational Behavior and Human Decision Processes 66 (1996) 22-30
126. Rentfrow P.J., and Gosling S.D. Message in a ballad: The role of music preferences in interpersonal perception. Psychological Science 17 (2006) 236-242
127. Roose J.E., and Doherty M.E. Judgment theory applied to the selection of life insurance salesmen. Organizational Behavior and Human Performance 16 (1976) 231-249
128. Rosenthal R., and DiMatteo M.R. Meta-analysis: Recent developments in quantitative methods for literature reviews. Annual Review of Psychology 52 (2001) 59-82
129. Rothrock L., and Kirlik A. Inferring rule-based strategies in dynamic judgment tasks: Toward a noncompensatory formulation of the lens model. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 33 (2003) 58-72
130. Rothstein H.G. The effects of time pressure on judgment in multiple cue probability learning. Organizational Behavior and Human Decision Processes 37 (1986) 83-92
131. Rudestam K.E., Sherman R.C., and Jarnecke R. Effect of lens-model and outcome feedback in a social judgment analogue. Psychological Reports 35 (1974) 1223-1233
132. Russo J.E., and Schoemaker P.J.H. Winning decisions (2002), Doubleday, New York
133. Schilling S.G., and Hogge J.H. Hierarchical linear models for the nomothetic aggregation of idiographic descriptions of judgment. In: Hammond K.R., and Stewart T.R. (Eds). The essential Brunswik: Beginnings, explications, applications (2001), Oxford University Press, New York 332-341
134. Schmitt N., Coyle B.W., and King L. Feedback and task predictability as determinant of performance in multiple cue probability learning tasks. Organizational Behavior and Human Performance 16 (1976) 388-402
135. Schmitt N., Coyle B.W., and Saari B.B. Types of task information feedback in multiple-cue probability learning. Organizational Behavior and Human Performance 18 (1977) 316-328
136. Shanteau J. Competence in experts: The role of task characteristics. Organizational Behavior and Human Decision Processes 53 (1992) 252-266
137. Shanteau J. How much information does an expert use? Is it relevant?. Acta Psychologica 81 (1992) 75-86
138. Smith L., Gilhooly K., and Walker A. Factors influencing prescribing decisions in the treatment of depression: A social judgment theory approach. Applied Cognitive Psychology 17 (2003) 51-63
139. Steinmann D.O. Transfer of lens model learning. Organizational Behavior and Human Performance 12 (1974) 1-16
140. Steinmann D.O. The effects of cognitive feedback and task complexity in multiple-cue probability learning. Organizational Behavior and Human Performance 15 (1976) 168-179
141. Steinmann D.O., and Doherty M.E. A lens model analysis of a bookbag and poker chip experiment: A methodological note. Organizational Behavior and Human Performance 8 (1972) 450-455
142. Sterne J.A.C., Bradburn M.J., and Egger M. Meta-analysis in Stata™. In: Egger M., Davey Smith G., and Altmann D.G. (Eds). Systematic reviews in health care: Meta-analysis in context (2001), British Medical Journal Publication Group, London, United Kingdom 347-369
143. Stewart T.R., Middleton P., Downton M., and Ely D. Judgments of photographs vs. field observations in studies of perception and judgment of the visual environment. Journal of Environmental Psychology 4 (1984) 283-302
144. Stewart T.R., Moninger W.R., Grassia J., Brady R.H., and Merrem F.H. Analysis of expert judgment and skill in a hail forecasting experiment. Weather and Forecasting 4 (1989) 24-34
145. Stewart T.R., Roebber P.J., and Bosart L.F. The importance of the task in analyzing expert judgment. Organizational Behavior and Human Decision Processes 69 (1997) 205-219
146. Strauss R., and Kirlik A. A systems perspective on situation awareness II: Experimental evaluation of a modeling and measurement technique [Tech. Report AHFD-03-13/NTSC-03-3] (2003) Savoy Institute of Aviation, University of Illinois, Urbana Champaign
147. Strube M.J. Averaging correlation coefficients: Influence of heterogeneity and set size. Journal of Applied Psychology 73 (1988) 559-568
148. Summers S.A., Summers R.C., and Karkau V.T. Judgments based on different functional relationships between interacting cues and a criterion. American Journal of Psychology 82 (1969) 203-211
149. Szucko J.J., and Kleinmuntz B. Statistical versus clinical lie detection. American Psychologist 36 (1981) 488-496
150. Tape T.G., Kripal J., and Wigton R.S. Comparing methods of learning clinical prediction from case simulations. Medical Decision Making 12 (1992) 213-221
151. Todd, F. J. (1954). A methodological analysis of clinical judgment. Unpublished doctoral dissertation, University of Colorado.
152. Tucker L.R. A suggested alternative formulation in the developments by Hursch, Hammond, and Hursch and by Hammond, Hursch, and Todd. Psychological Review 71 (1964) 528-530
153. Tversky A., and Kahneman D. Availability: A heuristic for judging frequency and probability. Cognitive Psychology 4 (1973) 207-232
154. Uhl C.N. Effects of multiple stimulus validity and criterion dispersion on learning of interval concepts. Journal of Experimental Psychology 77 (1966) 519-527
155. Ullman D.G., and Doherty M.E. Two determinants of the diagnosis of hyperactivity: The child and the clinician. In: Wolraich M., and Routh D.K. (Eds). Advances in behavioral pediatrics 5 (1984), JAI Press, Greenwich, CT 167-219
156. Vazire S., and Gosling S.D. E-perceptions: Personality impressions based on personal Websites. Journal of Personality and Social Psychology 87 (2004) 123-132
157. Werner P.D., Rose T.L., Murdach A.D., and Yesavage J.A. Social workers' decision making about the violent client. Social Work Research & Abstracts 25 (1989) 17-20
158. Werner P.D., Rose T.L., and Yesavage J.A. Reliability, accuracy, and decision-making strategy in clinical predictions of imminent dangerousness. Journal of Consulting and Clinical Psychology 51 (1983) 815-825
159. Wiggins, N., Gregory, S., & Diller, R. (1974). [Unpublished raw data].
160. Wiggins N., and Kohen E.S. Man versus model of man revisited: The forecasting of graduate school success. Journal of Personality and Social Psychology 19 (1971) 100-106
161. Wigton R.S., Poses R.M., Collins M., and Cebul R.D. Teaching old dogs new tricks: Using cognitive feedback to improve physicians' diagnostic judgments on simulated cases. Academic Medicine 65 (1990) S5-S6
162. Wright W.F. Financial information processing models: An empirical study. The Accounting Review 52 (1977) 676-689
163. Wright W.F. Properties of judgment models in a financial setting. Organizational Behavior and Human Performance 23 (1979) 73-85
164. Yntema D.B., and Torgerson W.S. Man-computer cooperation in decisions requiring common sense. IRE Transactions of the Professional Group on Human Factors in Electronics, HFE-2 (1961) 20-26
165. York K.M., Doherty M.E., and Kamouri J. The influence of cue unreliability in a multiple cue probability learning task. Organizational Behavior and Human Decision Processes 39 (1987) 303-317
166. Youmans R.J., and Stone E.R. To thy own self be true: Finding the utility of cognitive information feedback. Journal of Behavioral Decision Making 18 (2005) 319-341