Answering enumeration queries with the crowd

Communications of the ACM

Volumn 59, Issue 1, 2016, Pages 118-127

  Trushkowsky, Beth ^a   Kraska, Tim ^b   Franklin, Michael J ^c   Sarkar, Purnamrita ^d  

^a HARVEY MUDD COLLEGE   (United States)

^b Brown Univerity   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DIGITAL STORAGE; QUERY LANGUAGES; QUERY PROCESSING; SEMANTICS; STATISTICAL MECHANICS;

CLOSED WORLD ASSUMPTION; CROWDSOURCING; CROWDSOURCING PLATFORMS; NON-UNIFORMITIES; QUERY COMPLETENESS; QUERY EXECUTION; RELATIONAL QUERIES; STATISTICAL TOOLS;

SEARCH ENGINES;

EID: 84952360850     PISSN: 00010782     EISSN: 15577317     Source Type: Journal    
DOI: 10.1145/2845644     Document Type: Article

References (23)

1. Bar-Yossef, Z., Gurevich, M. Efficient search engine measurements. ACM Trans. Web 5, 4 (Oct. 2011), 18:1-18:48.
2. Broder, A., Fontura, M., Josifovski, V., Kumar, R., Motwani, R., Nabar, S., Panigrahy, R., Tomkins, A., Xu, Y. Estimating corpus size via queries. In Proceedings of CIKM (2006).
3. Bunge, J., Fitzpatrick, M. Estimating the number of species: A review. J. Am. Stat. Assoc. 88, 421 (1993), 364-373.
4. Bunge, J., et al. Comparison of three estimators of the number of species. J. Appl. Stat. 22, 1 (1995), 45-59.
5. Burnham, K.P., Overton, W.S. Estimation of the size of a closed population when capture probabilities vary among animals. Biometrika 65, 3 (1978), 625-633.
6. Chao, A. Species estimation and applications. In Encyclopedia of Statistical Sciences, 2nd edn. N. Balakrishnan, C.B. Read, and B. Vidakovic, eds. Wiley, New York, 2005, 7907-7916.
7. Chao, A., Lee, S. Estimating the number of classes via sample coverage. J. Am. Stat. Assoc. 87, 417 (1992), 210-217.
8. Charikar, M., et al. Towards estimation error guarantees for distinct values. In Proceedings of the PODS (2000).
9. Colwell, R.K., Coddington, J.A. Estimating terrestrial biodiversity through extrapolation. Philos. Trans. Biol. Sci. 345, 1311 (1994), 101-118.
10. Doan, A., et al. Crowdsourcing applications and platforms: A data management perspective. PVLDB 4, 12 (2011), 1508-1509.
11. Franklin, M.J., et al. CrowdDB: Answering queries with crowdsourcing. In Proceedings of the SIGMOD (2011).
12. Good, I.J. The population frequencies of species and the estimation of population parameters. Biometrika 40, 3/4 (1953), 237-264.
13. Gray, J., et al. Quickly generating billion-record synthetic databases. In Proceedings of the SIGMOD (1994).
14. Haas, P.J., et al. Sampling-based estimation of the number of distinct values of an attribute. In Proceedings of the VLDB (1995).
15. Heer, J., et al. Crowdsourcing graphical perception: Using mechanical turk to assess visualization design. In Proceedings of the CHI (2010).
16. Ipeirotis, P.G., Provost, F., Wang, J. Quality management on Amazon mechanical turk. In Proceedings of the HCOMP (2010).
17. Liu, K.-L., Yu, C., Meng, W. Discovering the representative of a search engine. In Proceedings of the CIKM (2002).
18. Lu, J., Li, D. Estimating deep web data source size by capture- recapture method. Inf. Retr. 13, 1 (Feb. 2010), 70-95.
19. Marcus, A., Wu, E., Madden, S., Miller, R. Crowdsourced databases: Query processing with people. In Proceedings of the CIDR (2011).
20. Parameswaran, A., Polyzotis, N. Answering queries using humans, algorithms and databases. In Proceedings of the CIDR (2011).
21. Shen, T., et al. Predicting the number of new species in further taxonomic sampling. Ecology 84, 3 (2003).
22. Trushkowsky, B., Kraska, T., Franklin, M.J., Sarkar, P. Crowdsourced enumeration queries. In Proceedings of the ICDE (2013).
23. Wang, J., et al. A sample-and-clean framework for fast and accurate query processing on dirty data. In Proceedings of the SIGMOD (2014), 469-480.