A cognitive model for aggregating people's rankings

PLoS ONE

Volumn 9, Issue 5, 2014, Pages

  Lee, Michael D ^a   Steyvers, Mark ^a   Miller, Brent ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BEHAVIOR; COGNITION; DECISION MAKING; HUMAN; HUMAN EXPERIMENT; NORMAL HUMAN; TASK PERFORMANCE; BAYES THEOREM; KNOWLEDGE; PHYSIOLOGY; PSYCHOLOGICAL MODEL; PSYCHOMOTOR PERFORMANCE; YOUNG ADULT;

BAYES THEOREM; COGNITION; HUMANS; JUDGMENT; KNOWLEDGE; MODELS, PSYCHOLOGICAL; PSYCHOMOTOR PERFORMANCE; YOUNG ADULT;

EID: 84901236367     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0096431     Document Type: Article

References (29)

1. Surowiecki J (2004) The Wisdom of Crowds. New York: Random House.
2. Gordon KH (1924) Group judgments in the field of lifted weights. Journal of Experimental Psychology 7: 398-400.
3. Marden JI (1995) Analyzing and Modeling Rank Data. Chapman & Hall.
4. Fligner MA, Verducci JS (1993) Probability models and statistical analyses for ranking data. Springer-Verlag.
5. Klementiev A, Roth D, Small K, Titov I (2009) Unsupervised rank aggregation with domain-specific expertise. In: The International Joint Conference on Artificial Intelligence (IJCAI 2009).
6. Lebanon G, Lafferty J (2002) Cranking: Combining rankings using conditional models on permutations. In: Proceedings of the 19th International Conference on Machine Learning.
7. Lebanon G, Mao Y (2008) Non-parametric modeling of partially ranked data. Journal of Machine Learning Research 9: 2401-2409.
8. Huang J, Guestrin C, Guibas L (2009) Fourier theoretic probabilistic inference over permutations. Journal of Machine Learning Research 10: 997-1070.
9. Kondor R, Howard A, Jebara T (2007) Multi-object tracking with representations of the symmetric group. In: Meila M, Shen X, editors, Proceedings of the Eleventh International Conference on Artificial Intelligence and Statistics.
10. Thurstone LL (1927) A law of comparative judgement. Psychological Review 34: 273-286.
11. Luce RD (1994) Thurston and sensory scaling: Then and now. Psychological Review 101: 271-277.
12. Lee MD, Steyvers M, de Young M, Miller BJ (2011) A model-based approach to measuring expertise in ranking tasks. In: Carlson L, Hölscher C, F ST, editors, Proceedings of the 33rd Annual Conference of the Cognitive Science Society, Austin, TX: Cognitive Science Society. pp. 1304-1309.
13. Lee MD, Steyvers M, de Young M, Miller BJ (2012) Inferring expertise in knowledge and prediction ranking tasks. Topics in Cognitive Science 4: 151-163.
14. Plummer M (2003) JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling. In: Hornik K, Leisch F, Zeileis A, editors, Proceedings of the 3rd International Workshop on Distributed Statistical Computing, Vienna, Austria.
15. Johnson TR, Kuhn KM (2013) Bayesian Thurstonian models for ranking data using JAGS. Behavior Research Methods.
16. Brooks SP, Gelman A (1997) General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics 7: 434-455.
17. Kendall M (1938) A new measure of rank correlation. Biometrika 30: 81-89.
18. Steyvers M, Lee MD, Miller B, Hemmer P (2009) The wisdom of crowds in the recollection of order information. In: Bengio Y, Schuurmans D, Lafferty J, Williams CKI, Culotta A, editors, Advances in Neural Information Processing Systems 22. pp. 1785-1793.
19. Lee MD, Zhang S, Shi J (2011) The wisdom of the crowd playing the Price is Right. Memory & Cognition 39: 914-923.
20. Zhang S, Lee MD (2010) Cognitive models and the wisdom of crowds: A case study using the bandit problem. In: Catrambone R, Ohlsson S, editors, Proceedings of the 32nd Annual Conference of the Cognitive Science Society, Austin, TX: Cognitive Science Society. pp. 1118-1123.
21. Borg I, Groenen P (1997) Modern Multidimensional Scaling: Theory and Applications. New York: Springer-Verlag.
22. Romney AK, Batchelder WH, Weller SC (1987) Recent applications of cultural concensus theory. American Behavioral Scientist 31: 163-177.
23. Karabatsos G, Batchelder WH (2003) Markov chain estimation for test theory without an answer key. Psychometrika 68: 373-389. (Pubitemid 37524544)
24. Oravecz Z, Anders R, Batchelder W (2013) Hierarchical Bayesian modeling for test theory without an answer key. Psychometrika.
25. Weiss DJ, Shanteau J (2014) Who's the best? A relativistic view of expertise. Applied Cognitive Psychology.
26. De Boeck P, Wilson M (2004) A Framework for Item Response Models. New York: Springer.
27. Thompson BR (2004) Exploratory and Confirmatory Factor Analysis: Understanding Concepts and Applications. American Psychological Association.
28. Henson RNA (2001) Serial order in short term memory. The Psychologist 14: 70-73.
29. Hintze JL, Nelson RD (1998) Violin plots: A box plot-density trace synergism. The American Statistician 52: 181-184.