Belief Elicitation: A Horse Race among Truth Serums

Economic Journal

Volumn 125, Issue 589, 2015, Pages 2116-2135

  Trautmann, Stefan T ^a   van de Kuilen, Gijs ^b  

^a UNIVERSITY OF HEIDELBERG   (Germany)

^b TILBURG UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY ASSESSMENT; GAME THEORY; INCENTIVE; RISK FACTOR;

EQUIDAE;

EID: 84955210904     PISSN: 00130133     EISSN: 14680297     Source Type: Journal    
DOI: 10.1111/ecoj.12160     Document Type: Article

References (65)

1. Abdellaoui, M., Vossmann, F. and Weber, M. (2005). 'Choice-based elicitation and decomposition of decision weights for gains and losses under uncertainty', Management Science, vol. 51(9), pp. 1384-99.
2. Allen, F. (1987). 'Discovering personal probabilities when utility functions are unknown', Management Science, vol. 33(4), pp. 542-4.
3. Andersen, S., Fountain, J., Harrison, G. W. and Rutstroem, E. (2010). 'Estimating subjective probabilities', Working Paper, CEAR.
4. Armantier, O. and Treich, N. (2009). 'Subjective probabilities in games: an application to the overbidding puzzle', International Economic Review, vol. 50(4), pp. 1079-102.
5. Armantier, O. and Treich, N. (2013). 'Eliciting beliefs: proper scoring rules, incentives, stakes, and hedging', European Economic Review, vol. 62, pp. 17-40.
6. Arrow, K. J. (1951). 'Alternative approaches to the theory of choice in risk-taking situations', Econometrica, vol. 19(4), pp. 404-37.
7. Attanasio, O. (2009). 'Expectations and perceptions in developing countries: their measurement and their use', American Economic Review, vol. 99(2), pp. 87-92.
8. Bellemare, C., Kroger, S. and van Soest, A. (2008), 'Measuring inequity aversion in a heterogeneous population using experimental decisions and subjective probabilities', Econometrica, vol. 76(4), pp. 815-39.
9. Blanco, M., Engelmann, D., Koch, A. K. and Norman, H.-T. (2010). 'Belief elicitation in experiments: is there a hedging problem?', Experimental Economics, vol. 13(4), pp. 412-38.
10. Blanco, M., Engelmann, D. and Norman, H.-T. (2011). 'A within-subject analysis of other-regarding preferences', Games and Economic Behavior, vol. 72(2), pp. 321-38.
11. Bosman, R. and van Winden, F.S. (2002). 'Emotional hazard in a power-to-take experiment', Economic Journal, vol. 112(476), pp. 147-69.
12. Branch, W. A. (2004). 'The theory of rationally heterogeneous expectations: evidence from survey data on inflation expectations', Economic Journal, vol. 114(497), pp. 592-621.
13. Brier, G. W. (1950). 'Verification of forecasts expressed in terms of probability', Monthly Weather Review, vol. 78(1), pp. 1-3.
14. Cabrales, A., Miniaci, R., Piovesan, M. and Ponti, G. (2010). 'Social preferences and strategic uncertainty: an experiment on markets and contracts', American Economic Review, vol. 100(5), pp. 2261-78.
15. Cameron, L. and Shah, M. (2011). 'Risk-taking in the wake of natural disasters', Working Paper, Monash.
16. Carman, K. G. and Kooreman, P. (2010). 'Flu shots, mammogram, and the perception of probabilities', Journal of Risk and Uncertainty.
17. Costa-Gomes, M., Huck, S. and Weizsäcker, G. (2008). 'Beliefs and actions in the trust game: creating instrumental variables to estimate the causal effect', Working Paper, DIW Berlin.
18. Costa-Gomes, M. and Weizsäcker, G. (2008). 'Stated beliefs and play in normal-form games', Review of Economic Studies, vol. 75(3), pp. 729-62.
19. de Finetti, B. (1962). 'Does it make sense to speak of 'good probability appraisers'?', in (I. J. Good, ed.), The Scientist Speculates: An Anthology of Partly-baked Ideas, pp. 357-64, London: William Heinemann Ltd.
20. Delavande, A., Gine, X. and McKenzie, D. (2011a). 'Eliciting probabilistic expectations with visual aids in developing countries: how sensitive are answers to variations in elicitation design?', Journal of Applied Econometrics, vol. 26(3), pp. 479-97.
21. Delavande, A., Gine, X. and McKenzie, D. (2011b). 'Measuring subjective expectations in developing countries: a critical review and new evidence', Journal of Development Economics, vol. 94(2), pp. 151-63.
22. Echternacht, G. J. (1972). 'The use of confidence testing in objective tests', Review of Educational Research, vol. 42(2), pp. 217-36.
23. Edwards, W. (1954). 'The theory of decision making', Psychological Bulletin, vol. 51(4), pp. 380-417.
24. Engelberg, J., Manski, C. F. and Williams, J. (2011). 'Assessing the temporal variation of macroeconomic forecasts by a panel of changing composition', Journal of Applied Econometrics, vol. 26(7), pp. 1059-78.
25. Fehr, E. and Schmidt, K. (1999). 'A theory of fairness, competition and cooperation', Quarterly Journal of Economics, vol. 114(3), pp. 817-68.
26. Fehr, E. and Schmidt, K. (2003). 'Theories of fairness and reciprocity - evidence and economic applications', in (M. Dewatripont, L. Hansen and S. Turnovsky, eds.), Advances in Economics and Econometrics - 8th World Congress, Econometric Society Monographs, pp. 208-57, Cambridge: Cambridge University Press.
27. Fischbacher, U. (2007). 'Z-Tree: Zurich toolbox for ready-made economic experiments', Experimental Economics, vol. 10(2), pp. 171-8.
28. Fischbacher, U. and Gächter, S. (2010). 'Social preferences, beliefs, and the dynamics of free riding in public goods experiments', American Economic Review, vol. 100(1), pp. 541-56.
29. Friedman, D. and Massaro, D. W. (1998). 'Understanding variability in binary and continuous choice', Psychonomic Bulletin & Review, vol. 5(3), pp. 370-89.
30. Gächter, S. and Riedl, A. (2005). 'Moral property rights in bargaining with infeasible claims', Management Science, vol. 51(2), pp. 249-63.
31. Guiso, L., Jappelli, T. and Terlizzese, D. (1992). 'Earnings uncertainty and precautionary saving', Journal of Monetary Economics, vol. 30(2), pp. 307-37.
32. Guiso, L. and Parigi, G. (1999). 'Investment and demand uncertainty', Quarterly Journal of Economics, vol. 114(1), pp. 185-227.
33. Hao, L. and Houser, D. (2012). 'Belief elicitation in the presence of naive respondents: an experimental study', Journal of Risk and Uncertainty, vol. 44(2), pp. 161-80.
34. Haruvy, E., Lahav, Y. and Noussair, C. N. (2007). 'Traders' expectations in asset markets: experimental evidence', American Economic Review, vol. 97(5), pp. 1901-20.
35. Heinemann, F., Nagel, R. and Ockenfels, P. (2009). 'Measuring strategic uncertainty in coordination games', Review of Economic Studies, vol. 76(1), pp. 181-221.
36. Hennig-Schmidt, H., Li, Z.-Y. and Yang, C. (2008). 'Why people reject advantageous offers: non-monotonic strategies in ultimatum bargaining' Journal of Economic Behavior and Organization, vol. 65(2), pp. 373-84.
37. Hollard, G., Massoni, S. and Vergnaud, J.-C. (2010). 'Subjective belief formation and elicitation rules: experimental evidence', Working Paper, CES Paris.
38. Holt, C. A. (2006). Markets, games, and strategic behavior: recipes for interactive learning, Boston: Pearson Addison Wesley.
39. Hossain, T. and Okui, R. (2013). 'The binarized scoring rule', Review of Economic Studies, vol. 80(3), pp. 984-1001.
40. Huck, S. and Weizsäcker, G. (2002). 'Do players correctly estimate what others do? Evidence of conservatism in beliefs', Journal of Economic Behavior and Organization, vol. 47(1), pp. 71-85.
41. Hurd, M. D. (2009). 'Subjective probabilities in household surveys', Annual Reviews of Economics, vol. 1, pp. 543-62.
42. Hurwicz, L. (1960). 'Optimality and informational efficiency in resource allocation', in (K. J. Arrow, S. Karlin and P. Suppes, eds.), Mathematical Methods in the Social Sciences, pp. 17-46, Stanford, CA: Stanford University Press.
43. Kadane, J. B. and Winkler, R. L. (1988). 'Separating probability elicitation from utilities', Journal of the American Statistical Association, vol. 83(402), pp. 357-63.
44. Karni, E. (2009). 'A mechanism for eliciting probabilities', Econometrica, vol. 77(2), pp. 603-6.
45. Khwaja, A., Sloan, F. and Salm, M. (2006). 'Evidence on preferences and subjective beliefs of risk takers: the case of smokers', International Journal of Industrial Organization, vol. 24(4), pp. 667-82.
46. Kothiyal, A., Spinu, V. and Wakker, P. P. (2011). 'Comonotonic proper scoring rules to measure ambiguity and subjective beliefs', Journal of Multi-Criteria Decision Analysis, vol. 17(3-4), pp. 101-13.
47. Li, W. (2007). 'Changing one's mind when the facts change: incentives of experts and the design of reporting protocols', Review of Economic Studies, vol. 74(4), pp. 1175-94.
48. Machina, M. J. and Schmeidler, D. (1992). 'A more robust definition of subjective probability', Econometrica, vol. 60(4), pp. 745-80.
49. Manski, C. F. (2004). 'Measuring expectations', Econometrica, vol. 72(5), pp. 1329-76.
50. Manski, C. F. and Neri, C. (2012). 'First- and second-order subjective expectations in strategic decision-making', Games and Economic Behavior, vol. 81, pp. 232-54.
51. McKelvey, R. and Page, T. (1986). 'Common knowledge, consensus, and aggregate information', Econometrica, vol. 54(1), pp. 109-27.
52. Nyarko, Y. and Schotter, A. (2002). 'An experimental study of belief learning using elicited beliefs', Econometrica, vol. 70(3), pp. 971-1005.
53. Offerman, T., Sonnemans, J., van de Kuilen, G. and Wakker, P. P. (2009). 'A truth-serum for non-Bayesians: correcting proper scoring rules for risk attitudes', Review of Economic Studies, vol. 76(4), pp. 1461-89.
54. Oosterbeek, H., Sloof, R. and van de Kuilen, G. (2004). 'Cultural differences in ultimatum game experiments: evidence from a meta-analysis', Experimental Economics, vol. 7(2), pp. 171-88.
55. Prelec, D. (2004). 'A bayesian truth serum for subjective data', Science, vol. 306(5695), pp. 462-6.
56. Rey-Biel, P. (2009). 'Equilibrium play and best response to (stated) beliefs in normal form games', Games and Economic Behavior, vol. 65(2), pp. 572-85.
57. Roth, A. (1995). 'Bargaining experiments', in (J. Kagel and A. Roth, eds.), The Handbook of Experimental Economics. pp. 3-109, Princeton, NJ: Princeton University Press.
58. Ruthstrom, E. E. and Wilcox, N. T. (2009). 'Stated beliefs versus inferred beliefs: a methodological inquiry and experimental test', Games and Economic Behavior, vol. 67(1), pp. 616-32.
59. Savage, L. J. (1954). 'The Foundations of Statistics', New York: Wiley.
60. Shiller, R. J., Kon-Ya, F. and Tsutsui, Y. (1996). 'Why did the Nikkei crash? Expanding the scope of expectations data collection', The Review of Economics and Statistics, vol. 78(1), pp. 156-64.
61. Sonnemans, J. and Offerman, T. (2001). 'Is the quadratic scoring rule really incentive compatible?', Working Paper, University of Amsterdam.
62. Tetlock, P. E. (2005). Expert Political Judgment, Princeton, NJ: Princeton University Press.
63. Tversky, A. and Koehler, D. J. (1994). 'Support theory: a nonextensional representation of subjective probability', Psychological Review, vol. 101(4), pp. 547-67.
64. Wakker, P. P. (2004). 'On the composition of risk preference and belief', Psychological Review, vol. 111(1), pp. 236-41.
65. Zizzo, D. J. (2010). 'Experimenter demand effects in economic experiments', Experimental Economics, vol. 13(1), pp. 75-98.