Crowd synthesis: Extracting categories and clusters from complex data

Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW

Volumn , Issue , 2014, Pages 989-998

  André, Paul ^a   Kittur, Aniket ^a   Dow, Steven P ^a  

^a Carnegie Mellon University   (United States)

Author keywords

Categorization; Classification; Clustering; Crowd; Synthesis

Indexed keywords

CLASSIFICATION (OF INFORMATION); INTERACTIVE COMPUTER SYSTEMS; ITERATIVE METHODS; SCAFFOLDS; SYNTHESIS (CHEMICAL);

AUTOMATED TECHNIQUES; CATEGORIZATION; CLUSTERING; CROWD; ITERATIVE CLUSTERING; LEVEL OF ABSTRACTION; LIMITED ATTENTIONS; TWO-STAGE APPROACHES;

COMPUTER SUPPORTED COOPERATIVE WORK;

EID: 84898981840     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2531602.2531653     Document Type: Conference Paper

References (41)

1. Andŕe, P., Bernstein, M., and Luther, K. Who gives a tweet?: evaluating microblog content value. In Proc. CSCW 2012, 471-474.
2. Andŕe, P., Zhang, H., Kim, J., Chilton, L. B., Dow, S., and Miller, R. Community clustering: Leveraging an academic crowd to form coherent sessions. In Proc. HCOMP 2013.
3. Baker, A., van der Hoek, A., Ossher, H., and Petre, M. Guest editors' introduction: Studying professional software design. Software, IEEE 29, 1 (2012), 28-33.
4. Blei, D., Ng, A., and Jordan, M. Latent dirichlet allocation. Journal of Machine Learning Research 3 (2003), 993-1022.
5. Blum, A. L., and Langley, P. Selection of relevant features and examples in machine learning. Artificial intelligence 97, 1 (1997).
6. Bowker, G. C., and Star, S. L. Sorting things out: Classification and its consequences. The MIT Press, 2000.
7. Chaney, A. J., and Blei, D. M. Visualizing topic models. In Proc. ICWSM 2012.
8. Chi, M. T., Feltovich, P. J., and Glaser, R. Categorization and representation of physics problems by experts and novices. Cognitive science 5, 2 (1981), 121-152.
9. Chilton, L. B., Little, G., Edge, D., Weld, D., and Landay, J. Cascade: Crowdsourcing taxonomy creation. In Proc. CHI 2013.
10. Chuang, J., Manning, C. D., and Heer, J. Termite: Visualization techniques for assessing textual topic models. In Proc. AVI 2012.
11. Chuang, J., Ramage, D., Manning, C., and Heer, J. Interpretation and trust: Designing model-driven visualizations for text analysis. In Proc. CHI 2012, 443-452.
12. Clapper, J. P., and Bower, G. H. Learning and applying category knowledge in unsupervised domains. Psychology of Learning and Motivation 27 (1991), 65-108.
13. Endert, A., Fiaux, P., and North, C. Semantic interaction for visual text analytics. In Proc. CHI 2012, 473-482.
14. Ferńandez, A., and Ǵomez, S. Solving non-uniqueness in agglomerative hierarchical clustering using multidendrograms. Journal of Classification 25, 1 (2008), 43-65.
15. Fried, L., and Holyoak, K. Induction of category distributions: A framework for classification learning. J Exp Psychol Learn Mem Cogn. 10, 2 (1984), 234.
16. Gick, M., and Holyoak, K. Schema induction and analogical transfer. Cognitive psychology 15, 1 (1983), 1-38.
17. Gomes, R., Welinder, P., Krause, A., and Perona, P. Crowdclustering. In Advances in Neural Information Processing Systems (NIPS 2011).
18. Kolbe, R., and Burnett, M. Content-analysis research: An examination of applications with directives for improving research reliability and objectivity. Journal of consumer research (1991), 243-250.
19. Kriplean, T., Beschastnikh, I., and McDonald, D. Articulations of wikiwork: uncovering valued work in wikipedia through barnstars. In Proc. CSCW 2008, 47-56.
20. Lassaline, M., and Murphy, G. Induction and category coherence. Psychonomic Bulletin &Review 3, 1 (1996), 95-99.
21. Law, E., Settles, B., Snook, A., Surana, H., von Ahn, L., and Mitchell, T. Human computation for attribute and attribute value acquisition. In Proc. FGVC 2011.
22. Law, E., Von Ahn, L., Dannenberg, R., and Crawford, M. Tagatune: A game for music and sound annotation. In Proc. ISMIR 2007.
23. Marr, D. Vision. W. H. Freeman and Company, San Francisco, 1982.
24. Medin, D., and Bettger, J. Presentation order and recognition of categorically related examples. Psychonomic Bulletin &Review 1, 2 (1994), 250-254.
25. Medin, D. L., and Schaffer, M. M. Context theory of classification learning. Psychological review 85, 3 (1978), 207.
26. Robertson, S., Vojnovic, M., and Weber, I. Rethinking the esp game. In Proc. CHI'09 EA, ACM, 3937-3942.
27. Rosch, E., Mervis, C. B., Gray, W. D., Johnson, D. M., and Boyes-Braem, P. Basic objects in natural categories. Cognitive psychology 8, 3 (1976), 382-439.
28. Russell, D., Stefik, M., Pirolli, P., and Card, S. The cost structure of sensemaking. In Proc. InterCHI 1993, 269-276.
29. Shafto, P., and Coley, J. D. Development of categorization and reasoning in the natural world: Novices to experts, naive similarity to ecological knowledge. J Exp Psychol Learn Mem Cogn. 29, 4 (2003).
30. Snow, R., O'Connor, B., Jurafsky, D., and Ng, A. Cheap and fast-but is it good?: evaluating non-expert annotations for natural language tasks. In Proc. EMNLP 2008, 254-263.
31. Sorokin, A., and Forsyth, D. Utility data annotation with amazon mechanical turk. In Proc. CVPR Workshops 2008, 1-8.
32. Strehl, A., and Ghosh, J. Cluster ensembles-A knowledge reuse framework for combining multiple partitions. J. Mach. Learn. Res. 3 (2003), 583-617.
33. Suchman, L. Do categories have politics? the language/action perspective reconsidered. In Proc. ECSCW 1993, 1-14.
34. Tamuz, O., Liu, C., Belongie, S., Shamir, O., and Kalai, A. Adaptively learning the crowd kernel. In Proc. ICML 2011.
35. Tanaka, J. W., and Taylor, M. Object categories and expertise: Is the basic level in the eye of the beholder? Cognitive psychology 23, 3 (1991), 457-482.
36. Thompson, B. Planned versus unplanned and orthogonal versus nonorthogonal contrasts: The neo-classical perspective. In Advances in Social Science Methodology, B. Thompson, Ed. JAI Press, 1994.
37. Treisman, A., and Gelade, G. A feature-integration theory of attention. Cognitive psychology 12, 1 (1980), 97-136.
38. Von Ahn, L., and Dabbish, L. Labeling images with a computer game. In Proc. CHI 2004, 319-326.
39. Wang, Y.-C., Burke, M., and Kraut, R. E. Gender, topic, and audience response: an analysis of user-generated content on facebook. In Proc. CHI 2013, 31-34.
40. Willett, W., Heer, J., and Agrawala, M. Strategies for crowdsourcing social data analysis. In Proc. CHI 2012, 227-236.
41. Yi, J., Jin, R., Jain, A., and Jain, S. Crowdclustering with sparse pairwise labels: A matrix completion approach. In Proc. HCOMP 2012.