Evaluating advisors: A policy-capturing study under conditions of complete and missing information

Journal of Behavioral Decision Making

Volumn 23, Issue 3, 2010, Pages 227-249

  Bonaccio, Silvia ^a   Dalal, Reeshad S ^b  

^a UNIVERSITY OF OTTAWA   (Canada)

^b GEORGE MASON UNIVERSITY   (United States)

Author keywords

Advice taking; Advisor; Decision making; Missing information; Policy capturing; Trust

Indexed keywords

EID: 77954278659     PISSN: 08943257     EISSN: 10990771     Source Type: Journal    
DOI: 10.1002/bdm.649     Document Type: Article

References (74)

1. Aiman-Smith, L., Scullen, S. E., & Barr, S. H. (2002). Conducting studies of decision making in organizational contexts: A tutorial for policy-capturing and other regression-based techniques. Organizational Research Methods, 5, 388-414.
2. Azen, R., & Budescu, D. V. (2003). The dominance analysis approach for comparing predictors in multiple regression. Psychological Methods, 8, 129-148.
3. Billings, R. S., & Markus, S. A. (1983). Measures of compensatory and noncompensatory models of decision behavior: Process tracing versus policy capturing. Organizational Behavior & Human Performance, 31, 331-352.
4. Bonaccio, S., & Dalal, R. S. (2006). Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences. Organizational Behavior and Human Decision Processes, 101, 127-151.
5. Budescu, D. V., & Rantilla, A. K. (2000). Confidence in aggregation of expert opinions. Acta Psychologica, 104, 371- 398.
6. Budescu, D. V., & Yu, H. T. (2006). To Bayes or not to Bayes: A comparison of two classes of models of information aggregation. Decision Analysis, 3, 145-162.
7. Budescu, D. V., & Yu, H. T. (2007). Aggregation of opinions based on correlated cues and advisors. Journal of Behavioral Decision Making, 20, 153-177.
8. Budescu, D. V., Rantilla, A. K., Yu, H., & Karelitz, T. K. (2003). The effects of asymmetry among advisors on the aggregation of their opinions. Organizational Behavior and Human Decision Processes, 90, 178-194.
9. Camerer, C., & Weber, M. (1992). Recent developments in modeling preferences: Uncertainty and ambiguity. Journal of Risk and Uncertainty, 5, 325-370.
10. Chaplin, W. F. (1997). Personality, interactive relations, and applied psychology. In R., Hogan, J. A., Johnson, & S. R. Briggs (Eds.), Handbook of personality psychology (pp. 873-890). San Diego, CA: Academic Press, Inc.
11. Choo, T. (1964).Communicator credibility and communicator discrepancy as determinants of opinion change. Journal of Social Psychology, 64, 1-20.
12. Cochran, W. G., & Cox, G. M. (1957). Experimental designs (2nd ed.) New York: Wiley.
13. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences. Manwah, NJ: Lawrence Erlbaum.
14. Cook, J., & Wall, T. (1980). New work attitude measures of trust, organizational commitment and personal need nonfulfillment. Journal of Occupational Psychology, 53, 39-52.
15. Cooksey, R. W. (1996). Judgment analysis: Theory, methods, and applications. San Diego, CA: Academic Press.
16. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.
17. Cropanzano, R., & Mitchell, M. S. (2005). Social exchange theory: An interdisciplinary review. Journal of Management, 31,874-900.
18. Curley, S. P., Yates, J. F., & Abrams, R. (1986). Psychological sources of ambiguity avoidance. Organizational Behavior and Human Decision Processes, 38, 230-256.
19. Dawes, R. M. (1988). Rational choice in an uncertain world. San Diego, CA: Harcourt Brace Jovanovich.
20. Eisenhardt, K. M. (1989). Agency theory: An assessment and review. Academy of Management Review, 14, 54-74.
21. Ellsberg, D. (1961). Risk ambiguity and the Savage axioma. Quarterly Journal of Economics, 75, 643-669.
22. Ericsson, K. A., & Smith, J. (1991). Toward a general theory of expertise: Prospects and limits. New York: Cambridge University Press.
23. Feng, B., & MacGeorge, E. L. (2006). Predicting receptiveness to advice: Characteristics of the problem, the advice-giver, and the recipient. Southern Communication Journal, 71, 67-85.
24. Fischer, I., & Budescu, D. V. (2005). When do those who know more also know more about how much they know? The development of confidence in performance and performance in decision-making. Organizational Behavior and Human Decision Processes, 98, 39-53.
25. Frisch, D., & Baron, J. (1988). Ambiguity and rationality. Journal of Behavioral Decision Making, 1, 149-157.
26. Gino, F., & Moore, D. A. (2007). Effects of task difficulty on use of advice. Journal of Behavioral Decision Making, 20, 21-35.
27. Gino, F., & Schweitzer, M. (2008). Blinded by anger or feeling the love: How emotions influence advice taking. Journal of Applied Psychology, 93, 1165-1173.
28. Gino, F., Shang, J., & Croson, R. C. (2009). The impact of information from similar or different advisors on judgment. Organizational Behavior and Human Decision Processes, 108, 287-302.
29. Goldsmith, D. J., & Fitch, K. (1997). The normative context of advice as social support. Human Communication Research, 23, 454-476.
30. Gorman, C., Clover, W., & Doherty, M. (1978). Can we learn anything about interviewing real people from ''interviews'' of paper people? Two studies of the external validity of a paradigm. Organizational Behavior and Human Performance, 22,165-192.
31. Graham, M. E., & Cable, D. A. (2001). Consideration of the incomplete block design for policy-capturing research. Organizational Research Methods, 4, 26-45.
32. Hall, J. A., & Rosenthal, R. (1991). Testing for moderator variables in meta-analysis: Issues and methods. Communication Monographs, 58, 437-448.
33. Harvey, N., & Fischer, I. (1997). Taking advice: Accepting help, improving judgment, and sharing responsibility. Organizational Behavior and Human Decision Processes, 70, 117-133.
34. Harvey, N., Harries, C., & Fischer, I. (2000). Using advice and assessing its quality. Organizational Behavior and Human Decision Processes, 81, 252-273.
35. Heath, C., & Gonzalez, R. (1995). Interaction with others increases decision confidence but not decision quality: Evidence against information collection views of interactive decision-making. Organizational Behavior and Human Decision Processes, 61, 305-326.
36. Highhouse, S., & Hause, E. (1995). Missing information in selection: An application of the Einhorn and Hogarth ambiguity model. Journal of Applied Psychology, 80, 86-93.
37. Hofmann, D. A., Griffin, M. A., & Gavin, M. B. (2000). The application of hierarchical linear modeling to organizational research. In K. J., Klein, & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations (pp. 467-511). San Francisco, CA: Jossey-Bass.
38. Hollenbeck, J. R., Ilgen, D. R., Sego, D. J., Hedlund, J., Major, D. A., & Phillips, J. (1995). Multilevel theory of team decision making: Decision performance in teams incorporating distributed expertise. Journal of Applied Psychology, 80,292-316.
39. Humphrey, S. E., Hollenbeck, J. R., Meyer, C. J., & Ilgen, D. R. (2002). Hierarchical team decision making. In G. R., Ferris, & J. J. Martocchio. (Eds.), Research in personnel and human resources management (Vol. 21, pp. 175-213).Stamford, CT: JAI Press.
40. Jaccard, J., & Wood, G. (1988). The effects of incomplete information on the formation of attitudes toward behavioral alternatives. Journal of Personality and Social Psychology, 54, 580-591.
41. Jagacinski, C. M. (1991). Personnel decision-making: The impact of missing information. Journal of Applied Psychology, 76,19-30.
42. Jagacinski, C. M. (1994). Evaluation of job candidates with missing information: Effects of attribute importance and interattribute correlation. Journal of Behavioral Decision Making, 7, 25-42.
43. Jagacinski, C. M. (1995). Distinguishing adding and averaging models in a personnel selection task: When missing information matters. Organizational Behavior and Human Decision Processes, 61, 1-15.
44. Judge, T. A., & Bono, J. A. (2001). Relationship of core self-evaluations traits-self-esteem, generalized self-efficacy, locus of control, and emotional stability-with job satisfaction and job performance: A meta-analysis. Journal of Applied Psychology, 86, 80-92.
45. Judge, T. A., Erez, A., Bono, J. A., & Thoresen, C. J. (2002). Are measures of self-esteem, neuroticism, locus of control, and generalized self-efficacy indicators of a common core construct? Journal of Personality and Social Psychology, 83, 693-710.
46. Jungermann, H. (1999). Advice-giving and taking. Proceedings of the 32nd Hawaii International Conference on System Sciences (HICSS-32) Maui, HI: Institute of Electrical and Electronics Engineers, Inc. (IEEE). [CD-ROM].
47. Jungermann, H., & Fischer, K. (2005). Using expertise and experience for giving and taking advice. In T., Betsch, & S Haberstroh. (Eds.), The routines of decision making (pp. 157-173).
48. Mahwah, NJ: Lawrence Erlbaum. Karren, R. J., & Barringer, M. W. (2002). A review and analysis of the policy-capturing methodology in organizational research: Guidelines for research and practice. Organizational Research Methods, 5, 337-361.
49. Klein, K. J., & Kozlowski, S. W. J. (Eds.), (2000). Multilevel theory, research, and methods in organizations. San Francisco, CA: Jossey-Bass.
50. Levin, I. P., Chapman, D. P., & Johnson, R. D. (1988). Confidence in judgments based on incomplete information: An investigation using both hypothetical and real gambles. Journal of Behavioral Decision Making, 1, 29-41.
51. Levin, I. P., Jasper, J. D., & Forbes, W. S. (1998). Choosing versus rejecting options at different stages of decision making. Journal of Behavioral Decision Making, 11, 193-210.
52. MacGeorge, E. L., Feng, B., Butler, G. L., & Budarz, S. K. (2004). Understanding advice in supportive interactions. Human Communication Research, 30, 42-70.
53. March, J. G. (1994). A primer on decision making. New York: Free Press.
54. Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995). An integrative model of organizational trust. Academy of Management Review, 20, 709-734.
55. Mook, D. G. (1983). In defense of external invalidity. American Psychologist, 38, 379-387.
56. Payne, J. W., Bettman, J. R., & Johnson, E. J. (1993). The adaptive decision maker. Cambridge, MA: Cambridge University Press.
57. Petty, R. E., & Cacioppo, J. T. (1979). Effects of forewarning of persuasive intent and involvement on cognitive responses and persuasion. Personality and Social Psychology Bulletin, 5, 173-176.
58. Petty, R. E., Cacioppo, J. T., & Goldman, R. (1981). Personal involvement as a determinant of argument-based persuasion. Journal of Personality and Social Psychology, 41, 847-855.
59. Phillips, J. M. (1999). Antecedents of leader utilization of staff input in decision-making teams. Organizational Behavior and Human Decision Processes, 77, 215-242.
60. Potter, R. E., & Beach, L. R. (1994). Imperfect information in pre-choice screening of options. Organizational Behavior and Human Decision Processes, 59, 313-329.
61. Price, P. C., & Stone, E. R. (2004). Intuitive evaluation of likelihood judgment producers: Evidence for a confidence heuristic. Journal of Behavioral Decision Making, 17, 39-57.
62. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage Publications.
63. Rossi, P. H., & Anderson, A. B. (1982). The factorial survey approach: An introduction. In P. H. Rossi, & S. L Nock. (Eds.), Measuring social judgments: A factorial survey approach. Beverly Hills, CA: Sage Publications.
64. Savadori, L., Van Swol, L. M., & Sniezek, J. A. (2001). Information sampling and confidence within groups and judge advisor systems. Communication Research, 28, 737-771.
65. Schrah, G. E., Dalal, R. S., & Sniezek, J. A. (2006). The adaptive decision-maker is not an island: Integrative expert advice with information search. Journal of Behavioral Decision Making, 19, 43-60.
66. Slovic, P., & Lichtenstein, S. (1971). Comparison of Bayesian and regression approaches to the study of information processing in judgment. Organizational Behavior and Human Performance, 6, 649-744.
67. Sniezek, J. A., & Buckley, T. (1995). Cueing and cognitive conflict in judge-advisor decision making. Organizational Behavior and Human Decision Processes, 62, 159-174.
68. Sniezek, J. A., & Van Swol, L. M. (2001). Trust, confidence, and expertise in a judge-advisor system. Organizational Behavior and Human Decision Processes, 84, 288-307.
69. Sniezek, J. A., Schrah, G. E., & Dalal, R. S. (2004). Improving judgment with prepaid expert advice. Journal of Behavioral Decision Making, 17, 173-190.
70. Stone, D. L., & Stone, E. F. (1987). Effects of missing application-blank information on personnel selection decisions: Do privacy protection strategies bias the outcome? Journal of Applied Psychology, 72, 452-456.
71. Van Swol, L. M., & Sniezek, J. A. (2005). Factors affecting the acceptance of expert advice. British Journal of Social Psychology, 44, 443-461.
72. Yaniv, I. (1997). Weighting and trimming: Heuristics for aggregation of judgments under uncertainty. Organizational Behavior and Human Decision Processes, 69, 237-249.
73. Yaniv, I., & Kleinberger, E. (2000). Advice taking in decision making: Egocentric discounting and reputation formation. Organizational Behavior and Human Decision Processes, 83, 260-281.
74. Yates, J. F., Jagacinski, C. M., & Faber, M. D. (1978). Evaluation of partially described multiattribute options. Organizational Behavior and Human Performance, 21, 240-251.