Leveraging wisdom of the crowd for decision support

Proceedings of the 30th International BCS Human Computer Interaction Conference, HCI 2016

Volumn 2016-July, Issue , 2016, Pages

  Hosio, Simo ^a   Goncalves, Jorge ^a   Anagnostopoulos, Theodoros ^a   Kostakos, Vassilis ^a  

^a UNIVERSITY OF OULU   (Finland)

Author keywords

Crowdsourcing; Decision Support Systems; Evaluation; Wisdom of the crowd

Indexed keywords

ARTIFICIAL INTELLIGENCE; CROWDSOURCING; DECISION SUPPORT SYSTEMS; KNOWLEDGE MANAGEMENT;

DECISION SUPPORT SYSTEM (DSS); DECISION SUPPORTS; EVALUATION; KNOWLEDGE BASIS; LABORATORY STUDIES; ON THE FLIES; USER PERCEPTIONS; WISDOM OF THE CROWDS;

HUMAN COMPUTER INTERACTION;

EID: 85046552315     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.14236/ewic/HCI2016.38     Document Type: Conference Paper

References (50)

1. Alter, S., 1982, Decision support systems: Current practice and continuing challenges. Reading, Massachusetts: Addison-Wesley Publishing Co., 1980, 316 pp, Behavioral Science, 27(1), pp. 91-2.
2. De Angeli, A., Sutcliffe, A. & Hartmann, J. (2006) Interaction, Usability and Aesthetics: What Influences Users’ Preferences? Proceedings of the 6th Conference on Designing Interactive Systems, ACM, pp. 271-80.
3. Arnott, D., Pervan, G., 2005, A critical analysis of decision support systems research, Journal of information technology, 20(2), pp. 67-87.
4. Ask Dan! about DSS - How does sensitivity analysis differ from “What if?” analysis?. Retrieved May 21, 2015, from http://dssresources.com/faq/index.php?action=artikel&id=121
5. Bangor, A., Kortum, P.T., Miller, J.T., 2008, An Empirical Evaluation of the System Usability Scale, Intl. Journal of Human–Computer Interaction, 24(6), pp. 574-94.
6. Barnett, G.O., Cimino, J.J., Hupp, J.A., Hoffer, E.P., 1987, DXplain. An evolving diagnostic decision-support system, JAMA, 258(1), pp. 67-74.
7. Bernstein, M.S. et al (2010) Soylent: A Word Processor with a Crowd Inside. Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology, ACM, pp. 313-22.
8. Chiu, C., Liang, T., Turban, E., 2014, What can crowdsourcing do for decision support? Decision Support Systems, 65, pp. 40-9.
9. Downs, J.S., Holbrook, M.B., Sheng, S. & Cranor, L.F. (2010) Are Your Participants Gaming the System?: Screening Mechanical Turk Workers. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, pp. 2399-402.
10. Druzdzel, M.J. & Flynn, R.R., 1999, Decision support systems. Encyclopedia of library and information science, Marcel Dekker, Inc. Last Login,.
11. Er, M.C., 1988, Decision Support Systems: A Summary, Problems, and Future Trends, Decis. Support Syst., 4(3), pp. 355-63.
12. Finlay, P.N., 1994, Introducing decision support systems, NCC Blackwell; Cambridge, Mass., USA: Blackwell Publishers, Oxford, UK.
13. Galton, F., 1907, Vox populi (the wisdom of crowds), Nature, 75, pp. 450-1.
14. Geurts, M.D., (1994) Data problems in decision support systems. Hawaii International Conference on System Sciences, IEEE, pp. 155-8.
15. Goncalves, J., Hosio, S., Ferreira, D. & Kostakos, V. (2014a) Game of Words: Tagging Places through Crowdsourcing on Public Displays. Designing Interactive Systems, Vancouver, BC, Canada, pp. 705-14.
16. Goncalves, J., Hosio, S., Liu, Y., Kostakos, V., 2014b, Eliciting Situated Feedback: A Comparison of Paper, Web Forms and Public Displays, Displays, 35(1), pp. 27-37.
17. Goncalves, J. et al (2013) Crowdsourcing on the spot: altruistic use of public displays, feasibility, performance, and behaviours. International Joint Conference on Pervasive and Ubiquitous Computing, ACM, pp. 753-62.
18. Hosio, S., Goncalves, J., Kostakos, V. & Riekki, J. 2014, Exploring Civic Engagement on Public Displays, in S Saeed (ed), User-Centric Technology Design for Nonprofit and Civic Engagements, Springer International Publishing, pp. 91-111.
19. Hosio, S., Goncalves, J., Kostakos, V., Riekki, J., 2015, Crowdsourcing Public Opinion using Urban Pervasive Technologies: Lessons from Real-Life Experiments in Oulu, Policy & Internet, 7(2), pp. 203-22.
20. Hosio, S. et al (2012) From school food to skate parks in a few clicks: using public displays to bootstrap civic engagement of the young. International Conference on Pervasive Computing, Springer, pp. 425-42.
21. Hosio, S. et al (2014) Situated Crowdsourcing Using a Market Model. User Interface Software and Technology, ACM, pp. 55-64.
22. Huffaker, D., 2010, Dimensions of Leadership and Social Influence in Online Communities, Human Communication Research, 36(4), pp. 593-617.
23. Ipeirotis, P.G. & Gabrilovich, E. (2014) Quizz: Targeted crowdsourcing with a billion (potential) users. Proceedings of the 23rd international conference on World wide web, pp. 143-54.
24. Jannach, D., Zanker, M., Ge, M. & Gröning, M. 2012, Recommender Systems in Computer Science and Information Systems – A Landscape of Research, in E-Commerce and Web Technologies, Springer Berlin Heidelberg, pp. 76-87.
25. Järvelin, K. & Kekäläinen, J. (2000) IR Evaluation Methods for Retrieving Highly Relevant Documents. Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, pp. 41-8.
26. Kaufmann, N., Schulze, T. & Veit, D. (2011) More than fun and money. Worker Motivation in Crowdsourcing-A Study on Mechanical Turk. AMCIS, .
27. Keen, P.G.W., 1981, Value Analysis: Justifying Decision Support Systems, MIS Q., 5(1), pp. 1-15.
28. Kittur, A. et al (2013) The future of crowd work. Proceedings of the 2013 conference on Computer supported cooperative work, ACM, pp. 1301-18.
29. Kostakos, V., (2009) Is the Crowd’s Wisdom Biased? A Quantitative Analysis of Three Online Communities. Computational Science and Engineering, pp. 251-5.
30. Landwehr, N., Hall, M., Frank, E., 2005, Logistic Model Trees, Machine Learning, 59(1-2), pp. 161-205.
31. Lorenz, J., Rauhut, H., Schweitzer, F., Helbing, D., 2011, How social influence can undermine the wisdom of crowd effect, Proceedings of the National Academy of Sciences, 108(22), pp. 9020-5.
32. McCarney, R., Warner, J., Iliffe, S., van Haselen, R., Griffin, M., Fisher, P., 2007, The Hawthorne Effect: a randomised, controlled trial, BMC medical research methodology, 7, p. 30.
33. Nonnecke, B. & Preece, J. (2000) Lurker demographics: counting the silent. Proceedings of the SIGCHI conference on Human Factors in Computing Systems, ACM, pp. 73-80.
34. Noronha, J., Hysen, E., Zhang, H. & Gajos, K.Z. (2011) Platemate: crowdsourcing nutritional analysis from food photographs. Proceedings of the 24th annual ACM symposium on User interface software and technology, pp. 1-12.
35. Page, S.E., 2008, The difference: how the power of diversity creates better groups, firms, schools, and societies, Princeton University Press, Princeton, N.J.; Woodstock.
36. Poetz, M.K., Schreier, M., 2012, The Value of Crowdsourcing: Can Users Really Compete with Professionals in Generating New Product Ideas? Journal of Product Innovation Management, 29(2), pp. 245-56.
37. Power, D.J., 2002, Decision support systems: concepts and resources for managers, Quorum Books, Westport, Conn..
38. Power, D.J., Sharda, R., 2007, Model-driven decision support systems: Concepts and research directions, Decision Support Systems, 43(3), pp. 1044-61.
39. Preece, J., Nonnecke, B., Andrews, D., 2004, The top five reasons for lurking: improving community experiences for everyone, Computers in Human Behavior, 20(2), pp. 201 - 223.
40. Resnick, P., Varian, H.R., 1997, Recommender Systems, Commun. ACM, 40(3), pp. 56-8.
41. Ricci, F., Rokach, L. & Shapira, B. 2011, Introduction to Recommender Systems Handbook, in Recommender Systems Handbook, Springer US, pp. 1-35.
42. Rogstadius, J. et al (2011) An Assessment of Intrinsic and Extrinsic Motivation on Task Performance in Crowdsourcing Markets. International AAAI Conference on Web and Social Media, Barcelona, Spain, pp. 321-8.
43. Salganik, MJ, Dodds PS & Watts DJ 2006, Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market, Science,February 2006, pp. 854-6.
44. Sauro, JMeasuring U, Retrieved September 28, 2014, from http://www.measuringu.com/sus.php
45. Shambaugh, N. 2009, Personalized Decision Support Systems, in JR Rabunal, J Dorado & A Pazos Sierra (eds), Encyclopedia of artificial intelligence, Information Science Reference, Hershey, PA,.
46. Shim, J.P., Warkentin, M., Courtney, J.F., Power, D.J., Sharda, R., Carlsson, C., 2002, Past, present, and future of decision support technology, Decision Support Systems, 33(2), pp. 111-26.
47. Surowiecki, J., 2005, The Wisdom of Crowds: Why the Many Are Smarter Than the Few and How Collective Wisdom Shapes Business, Economies, Societies and Nations, 1st ed. Anchor, New York.
48. VotingAid, VotingAid. Retrieved September 16, 2015, from http://zef.fi/votingaid/en/home/
49. Wang, Y., Wang, Y., Patel, S., Patel, D., 2006, A layered reference model of the brain (LRMB), Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, 36(2), pp. 124-33.
50. Yaniv, I., Milyavsky, M., 2007, Using advice from multiple sources to revise and improve judgments, Organizational Behavior and Human Decision Processes, 103(1), pp. 104-20.