A Model-Based Approach to Measuring Expertise in Ranking Tasks

Expanding the Space of Cognitive Science - Proceedings of the 33rd Annual Meeting of the Cognitive Science Society, CogSci 2011

Volumn , Issue , 2011, Pages 1304-1309

  Lee, Michael D ^a   Steyvers, Mark ^a   de Young, Mindy ^a   Miller, Brent J ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

expertise; model based measurement; ordering task; wisdom of crowds

Indexed keywords

COGNITIVE MODEL; EXPERTISE; GIVEN CRITERION; MODEL BASED APPROACH; MODEL-BASED MEASUREMENT; MODEL-BASED OPC; MODELING APPROACH; ORDERING TASK; RANK ORDERING; WISDOM OF CROWDS;

EID: 85139526175     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. Klementiev, A., Roth, D., Small, K., & Titov, I. (2009). Unsupervised rank aggregation with domain-specific expertise. IJCAI, 1101–1106.
2. Koller, D., Friedman, N., Getoor, L., & Taskar, B. (2007). Graphical models in a nutshell. In L. Getoor & B. Taskar (Eds.), Introduction to statistical relational learning. Cambridge, MA: MIT Press.
3. Lee, M. D. (2008). Three case studies in the Bayesian analysis of cognitive models. Psychonomic Bulletin & Review, 15(1), 1–15.
4. Malhotra, V., Lee, M. D., & Khurana, A. K. (2007). Domain experts influence decision quality: Towards a robust method for their identification. Journal of Petroleum Science and Engineering, 57, 181–194.
5. Merkle, E. C., & Steyvers, M. (2011). A psychological model for aggregating judgments of magnitude. Lecture Notes in Computer Science, 6589, 236–243.
6. Shanteau, J., Weiss, D. J., Thomas, R. P., & Pounds, J. C. (2002). Performance-based assessment of expertise: How to decide if someone is an expert or not. European Journal of Operations Research, 136, 253–263.
7. Shiffrin, R. M., Lee, M. D., Kim, W.-J., & Wagenmakers, E.-J. (2008). A survey of model evaluation approaches with a tutorial on hierarchical Bayesian methods. Cognitive Science, 32(8), 1248–1284.
8. Steyvers, M., Lee, M. D., Miller, B., & Hemmer, P. (2009). The wisdom of crowds in the recollection of order information. In Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, & A. Culotta (Eds.), Advances in Neural Information Processing Systems 22 (pp. 1785–1793).
9. Surowiecki, J. (2004). The Wisdom of Crowds. New York: Random House.
10. Tetlock, P. E. (2006). Expert political judgment. Princeton University Press.
11. Wright, G., & Bolderm, F. (1992). Expertise and decision support. Plenum Press.
12. Yao, G., & Böckenholt, U. (1999). Bayesian estimation of Thurstonian ranking models based on the Gibbs sampler. British Journal of Mathematical and Statistical Psychology, 52, 79–92.