Quality assurance for human-based electronic services: A decision matrix for choosing the right approach

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6385 LNCS, Issue , 2010, Pages 421-424

  Kern, Robert ^a   Thies, Hans ^a   Bauer, Cordula ^a   Satzger, Gerhard ^a  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CROWDSOURCING; DECISION MATRICES; ELECTRONIC SERVICES; HUMAN INTELLIGENCE;

QUALITY ASSURANCE; QUALITY CONTROL;

TECHNICAL PRESENTATIONS; QUALITY MANAGEMENT;

EID: 78649890126     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-16985-4_39     Document Type: Conference Paper

References (7)

1. Barr, J., Cabrera, L.F.: AI gets a brain. ACM Queue 4(4), 24-29 (2006)
2. Kern, R., Bauer, C., Thies, H., Satzger, G.: Validating results of human-based electronic services leveraging multiple reviewers. In: Proceedings of the 16th Americas Conference on Information Systems (AMCIS), Lima, Peru (2010) (forthcoming)
3. Kern, R., Zirpins, C., Agarwal, S.: Managing quality of Human-Based eServices. In: Feuerlicht, G., Lamersdorf, W. (eds.) Service-Oriented Computing - ICSOC 2008 Workshops. LNCS, vol. 5472, pp. 304-309. Springer, Heidelberg (2008)
4. Rowe, G., Wright, G.: The delphi technique as a forecasting tool: issues and analysis. International journal of forecasting 15(4), 353-375 (1999)
5. Snow, R., OConnor, B., Jurafsky, D., Ng, A.Y.: Cheap and fastbut is it good? evaluating non-expert annotations for natural language tasks. In: EMNLP 2008: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 254-263. ACL, Stroudsburg (2008)
6. Sorokin, A., Forsyth, D.: Utility data annotation with amazon mechanical turk. In: CVPRW 2008: Proceedings of the Conference on Computer Vision and Pattern Recognition Workshops, pp. 1-8. IEEE Computer Society, Washington (June 2008)
7. Surowiecki, J.: The Wisdom of Crowds, 1st edn. Doubleday, New York (2004)