A systematic literature review of crowdsourcing research from a human resource management perspective

Proceedings of the Annual Hawaii International Conference on System Sciences

Volumn 2015-March, Issue , 2015, Pages 4609-4618

  Buettner, Ricardo ^a  

^a FOM UNIVERSITY OF APPLIED SCIENCES   (Germany)

Author keywords

Coordination problem; Crowdsourcing; Human resource management perspective; Literature review; Research framework

Indexed keywords

CROWDSOURCING; NATURAL RESOURCES MANAGEMENT; RESOURCE ALLOCATION;

COORDINATION PROBLEMS; DESIGN-ORIENTED RESEARCHES; LITERATURE REVIEWS; RESEARCH FRAMEWORKS; SYSTEMATIC LITERATURE REVIEW;

HUMAN RESOURCE MANAGEMENT;

EID: 84944219878     PISSN: 15301605     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HICSS.2015.549     Document Type: Conference Paper

References (98)

1. H. Aguinis and S. O. Lawal, "eLancing: A review and research agenda for bridging the science-practice gap," Human Resource Management Review, vol. 23, no. 1, pp. 6-17, 2013.
2. J. Howe, "The Rise of Crowdsourcing," Wired Magazine, June 2006.
3. G. D. Saxton, O. Oh, and R. Kishore, "Rules of Crowdsourcing: Models, Issues, and Systems of Control," Inform Syst Manage, vol. 30, no. 1, pp. 2-20, 2013.
4. O. Alonso, "Implementing crowdsourcing-based relevance experimentation: an industrial perspective," Inform Retrieval, vol. 16, no. 2, pp. 101-120, 2013.
5. N. Archak and A. Sundararajan, "Optimal Design of Crowdsourcing Contests," in ICIS '09 Proc., 2009.
6. R. Morris, M. Dontcheva, and E. Gerber, "Priming for Better Performance in Microtask Crowdsourcing Environments," IEEE Internet Comput., vol. 16, no. 5, pp. 13-19, 2012.
7. O. Alonso and S. Mizzaro, "Using crowdsourcing for TREC relevance assessment," Inform Process Manag, vol. 48, no. 6, pp. 1053-1066, 2012.
8. D. C. Brabham, "The Myth of Amateur Crowds," Inform Commun Soc, vol. 15, no. 3, pp. 394-410, 2012.
9. J. Leimeister, M. Huber, U. Bretschneider, and H. Krcmar, "Leveraging Crowdsourcing: Activation-Supporting Components for IT-Based Ideas Competition," JMIS, vol. 26, no. 1, pp. 197-224, 2009.
10. J. J. Horton, "The condition of the Turking class: Are online employers fair and honest" Economics Letters, vol. 111, no. 1, pp. 10-12, 2011.
11. B. Satzger, H. Psaier, D. Schall, and S. Dustdar, "Auction-based crowdsourcing supporting skill management," Inform Syst, vol. 38, no. 4, pp. 547-560, 2013.
12. A. Doan, R. Ramakrishnan, and A. Y. Halevy, "Crowdsourcing Systems on the World-Wide Web," CACM, vol. 54, no. 4, pp. 86-96, 2011.
13. D. C. Brabham, "Crowdsourcing as a Model for Problem Solving: An Introduction and Cases," Convergence, vol. 14, no. 1, pp. 75-90, 2008.
14. Y. Huang, P. Singh, and K. Srinivasan, "Crowdsourcing "Blockbuster" ideas: A dynamic structural model of ideation," in ICIS '11 Proc., 2011.
15. Y. Huang, P. Singh, and T. Mukhopadhyay, "Crowdsourcing Contests: A Dynamic Structural Model of the Impact of Incentive Structure on Solution Quality," in ICIS '12 Proc., 2012.
16. K. Hutter, J. Hautz, J. Füller, J. Mueller, and K. Matzler, "Communitition: The Tension between Competition and Collaboration in Community-Based Design Contests," Creativity and Innovation Management, vol. 20, no. 1, pp. 3-21, 2011.
17. R. Jain, J. Simon, and R. Poston, "Mitigating Vendor Silence in Offshore Outsourcing: An Empirical Investigation," JMIS, vol. 27, no. 4, pp. 261-298, 2011.
18. W. Mason and S. Suri, "Conducting behavioral research on Amazons Mechanical Turk," Behav Res Methods, vol. 44, no. 1, pp. 1-23, 2012.
19. L. Mortara, S. J. Ford, and M. Jaeger, "Idea Competitions under scrutiny: Acquisition, intelligence or public relations mechanism" Technol Forecast Soc, vol. 80, no. 8, pp. 1563-1578, 2013.
20. R. Munro, "Crowdsourcing and the crisis-affected community," Inform Retrieval, 2012.
21. D. Rotman, K. Procita, D. Hansen, C. Sims Parr, and J. Preece, "Supporting content curation communities: The case of the Encyclopedia of Life," JASIST, vol. 63, no. 6, pp. 1092-1107, 2012.
22. T. Schulze, S. Seedorf, D. Geiger, N. Kaufmann, and M. Schader, "Exploring task properties in crowdsourcing-an empirical study on mechanical turk," in ECIS '11 Proc., 2011.
23. B. Shao, L. Shi, B. Xu, and L. Liu, "Factors affecting participation of solvers in crowdsourcing: an empirical study from China," Electr Markets, vol. 22, no. 2, pp. 73-82, 2012.
24. Y. Sun, N. Wang, C. Yin, and T. Che, "Investigating the Non-Linear Relationships in the Expectancy Theory: The Case of Crowdsourcing Marketplace," in AMCIS '12 Proc., 2012.
25. O. Tokarchuk, R. Cuel, and M. Zamarian, "Analyzing Crowd Labor and Designing Incentives for Humans in the Loop," IEEE Internet Comput., vol. 16, no. 5, pp. 45-51, 2012.
26. Y. Yang, P.-y. Chen, and R. Banker, "Winner Determination of Open Innovation Contests in Online Markets," in ICIS '11 Proc., 2011.
27. H. Zheng, D. Li, and W. Hou, "Task Design, Motivation, and Participation in Crowdsourcing Contests," Int J Electron Comm, vol. 15, no. 4, pp. 57-88, 2011.
28. I. Blohm, C. Riedl, J. Leimeister, and H. Krcmar, "Idea Evaluation Mechanisms for Collective Intelligence in Open Innovation Communities: Do Traders outperform Raters" in ICIS '11 Proc., 2011.
29. N. Franke, P. Keinz, and K. Klausberger, ""Does This Sound Like a Fair Deal": Antecedents and Consequences of Fairness Expectations in the Individual's Decision to Participate in Firm Innovation," Organ Sci, vol. 24, no. 5, pp. 1495-1516, 2013.
30. G. Kazai, J. Kamps, and N. Milic-Frayling, "An analysis of human factors and label accuracy in crowdsourcing relevance judgments," Inform Retrieval, vol. 16, no. 2, pp. 138-178, 2013.
31. R. Müller, K. Thoring, and R. Oostinga, "Crowdsourcing with Semantic Differentials: A Game to Investigate the Meaning of Form," in AMCIS '10 Proc., 2010.
32. D. Rudmark, E. Arnestrand, and M. Avital, "Crowdpushing: The flip side of crowdsourcing," in ECIS '12 Proc., 2012.
33. S. M. Wolfson and M. Lease, "Look before you leap: Legal pitfalls of crowdsourcing," ASIST Proc, vol. 48, no. 1, pp. 1-10, 2011.
34. D. Govindaraj, N. K. V. M., A. Nandi, G. Narlikar, and V. Poosala, "MoneyBee: Towards enabling a ubiquitous, efficient, and easy-to-use mobile crowdsourcing service in the emerging market," Bell Syst Tech J, vol. 15, no. 4, pp. 79-92, 2011.
35. A. Kulkarni, P. Gutheim, P. Narula, D. Rolnitzky, T. Parikh, and B. Hartmann, "MobileWorks: Designing for Quality in a Managed Crowdsourcing Architecture," IEEE Internet Comput., vol. 16, no. 5, pp. 28-35, 2012.
36. H. Ryu and M. Lease, "Crowdworker filtering with support vector machine," ASIST Proc., vol. 48, no. 1, pp. 1-4, 2011.
37. D. Schall, "Expertise ranking using activity and contextual link measures," DKE, vol. 71, no. 1, pp. 92-113, 2012.
38. D. Schall, B. Satzger, and H. Psaier, "Crowdsourcing tasks to social networks in BPEL4People," World Wide Web, vol. 17, no. 1, pp. 1-32, 2014.
39. D. Schall, F. Skopik, and S. Dustdar, "Expert Discovery and Interactions in Mixed Service-Oriented Systems," IEEE TSC, vol. 5, no. 2, pp. 233-245, 2012.
40. F. Skopik, D. Schall, and S. Dustdar, "Modeling and mining of dynamic trust in complex service-oriented systems," Inform Syst, vol. 35, no. 7, pp. 735-757, 2010.
41. J. Vuurens and A. de Vries, "Obtaining High-Quality Relevance Judgments Using Crowdsourcing," IEEE Internet Comput., vol. 16, no. 5, pp. 20-27, 2012.
42. Q. Xu, Q. Huang, T. Jiang, B. Yan, W. Lin, and Y. Yao, "HodgeRank on Random Graphs for Subjective Video Quality Assessment," IEEE Trans. Multimedia, vol. 14, no. 3, pp. 844-857, 2012.
43. D. Nevo, J. Kotlarsky, and S. Nevo, "New Capabilities: Can IT Service Providers Leverage Crowdsourcing" in ICIS '12 Proc, 2012.
44. D. C. Brabham, "Moving the Crowd at Threadless," Inform Commun Soc, vol. 13, no. 8, pp. 1122-1145, 2010.
45. K. Frey, C. Lüthje, and S. Haag, "Whom Should Firms Attract to Open Innovation Platforms? The Role of Knowledge Diversity and Motivation," Long Range Plann, vol. 44, no. 5-6, pp. 397-420, 2011.
46. Y. Zhao and Q. Zhu, "Evaluation on crowdsourcing research: Current status and future direction," ISF, vol. 16, no. 3, pp. 417-434, 2014.
47. Y. Hong and P. Pavlou, "An Empirical Investigation on Provider Pricing in Online Crowdsourcing Markets for IT Services," in ICIS '12 Proc., 2012.
48. J. Pedersen, D. Kocsis, A. Tripathi, A. Tarrell, A. Weerakoon, N. Tahmasbi, J. Xiong, W. Deng, O. Oh, and G.-J. De Vreede, "Conceptual Foundations of Crowdsourcing: A Review of IS Research," in HICSS '13 Proc., 2013, pp. 579-588.
49. C. I. Barnard, The Functions of the Executive. Cambridge, MA: HUP, 1938.
50. P. R. Milgrom and J. Roberts, Economic, Organization and Management. Englewood Cliffs, NJ: PH, 1992.
51. J. H. Dulebohn and S. E. Werling, "Compensation research past, present, and future," HRMR, vol. 17, no. 2, pp. 191-207, 2007.
52. T. W. Malone, "Modeling Coordination in Organizations and Markets," Manage Sci, vol. 33, no. 10, pp. 1317-1332, 1987.
53. G. Baker, M. Gibbs, and B. Holmstrom, "The Internal Economics of the Firm: Evidence from Personnel Data," Q J Econ, vol. 109, no. 4, pp. 881-919, November 1994.
54. J. Ochs, "The Coordination Problem in Decentralized Markets: An Experiment," Q J Econ, vol. 105, no. 2, pp. 545-559, 1990.
55. B. J. Avolio, S. Kahai, and G. E. Dodge, "E-Leadership: Implications for theory, research, and practice," Leadersh Q, vol. 11, no. 4, pp. 615-668, 2000.
56. J. Webster and R. T. Watson, "Analyzing the past to prepare for the future: Writing a literature review," MISQ, vol. 26, no. 2, pp. xiii-xxiii, 2002.
57. M. Hirth, T. Hoßfeld, and P. Tran-Gia, "Analyzing costs and accuracy of validation mechanisms for crowdsourcing platforms," Math Comp Model, vol. 57, no. 11-12, pp. 2918-2932, 2012.
58. B. L. Bayus, "Crowdsourcing New Product Ideas over Time: An Analysis of the Dell IdeaStorm Community," Manage Sci, vol. 59, no. 1, pp. 226-244, 2013.
59. M. d. Besten, "Using social media to sample ideas: lessons from a Slate-Twitter contest," JOSIT, vol. 14, no. 2, pp. 123-130, 2012.
60. M. S. Bernstein, "Crowd-powered systems," KI Künstliche Intelligenz, vol. 27, no. 1, pp. 69-73, 2013.
61. D. P. Casal, "Crowdsourcing the Corpus: Using Collective Intelligence as a Method for Composition," Leonardo Music J, vol. 21, pp. 25-28, 2011.
62. G. Geisler, G. Willard, and C. Ovalle, "A crowdsourcing framework for the production and use of film and television data," NRHM, vol. 17, no. 1, pp. 73-97, 2011.
63. H. Mintzberg, The Structuring of Organizations: A Synthesis of the Research. Englewood Cliffs, NJ: PH, 1979.
64. T. W. Malone and K. Crowston, "The Interdisciplinary Study of Coordination," ACM Comput Surv, vol. 26, no. 1, pp. 87-119, 1994.
65. M. Bogers and J. West, "Managing Distributed Innovation: Strategic Utilization of Open and User Innovation," Creativity Innov Manag, vol. 21, no. 1, pp. 61-75, 2012.
66. H. Simula and M. Vuori, "Benefits and barriers of crowdsourcing in b2b firms: Generating ideas with internal and external crowds," IJIM, vol. 16, no. 6, pp. 1 240 011-1-1 240 011-19, 2012.
67. S. Dalal, D. Khodyakov, R. Srinivasan, S. Straus, and J. Adams, "ExpertLens: A system for eliciting opinions from a large pool of non-collocated experts with diverse knowledge," Technol Forecast Soc, vol. 78, no. 8, pp. 1426-1444, 2011.
68. E. R. Alexander, "Dilemmas in Evaluating Planning, or Back to Basics: What Is Planning For" Planning Theory & Practice, vol. 10, no. 2, pp. 233-244, 2009.
69. R. Buettner, "A Framework for Recommender Systems in Online Social Network Recruiting," in HICSS '14 Proc., 2014, pp. 1415-1424.
70. A. L. Kristof, "Person-organization fit: An integrative review of its conceptualizations, measurement, and implications," Pers Psych, vol. 49, no. 1, pp. 1-49, 1996.
71. T. Sekiguchi and V. L. Huber, "The use of personorganization fit and person-job fit information in making selection decisions," Organ Behav Hum Dec, vol. 116, no. 2, pp. 203-216, 2011.
72. P. J. A? gerfalk and B. Fitzgerald, "Outsourcing to an Unknown Workforce: Exploring Opensourcing as a Global Sourcing Strategy," MISQ, vol. 32, no. 2, pp. 385-409, 2008.
73. J. Malinowski, T. Weitzel, and T. Keim, "Decision support for team staffing: An automated relational recommendation approach," DSS, vol. 45, no. 3, pp. 429-447, 2008.
74. J. R. Edwards, Person-job fit: A conceptual integration, literature review, and methodological critique. International review of industrial and organizational psychology. Oxford: John Wiley & Sons, 1991, vol. 6, pp. 283-357.
75. T. S. Behrend, D. J. Sharek, A. W. Meade, and E. N. Wiebe, "The viability of crowdsourcing for survey research," Behav Res Methods, vol. 43, no. 3, pp. 800-813, 2011.
76. G. H. Hofstede, Culture's Consequences: International Differences in Work-Related Values. Beverly Hills, CA: Sage, 1984.
77. T. Schulze, S. Krug, and M. Schader, "Workers Task Choice in Crowdsourcing and Human Computation Markets," in ICIS '12 Proc., 2012.
78. L. Erickson, I. Petrick, and E. Trauth, "Hanging with the right crowd: Matching crowdsourcing need to crowd characteristics," in AMCIS '12 Proc., 2012.
79. C. Biemann, "Creating a system for lexical substitutions from scratch using crowdsourcing," Lang Resour Eval, vol. 47, no. 1, pp. 97-122, 2013.
80. T. P. Walter and A. Back, "A Text Mining Approach to Evaluate Submissions to Crowdsourcing Contests," in HICSS '13 Proc., 2013, pp. 3109-3118.
81. C. Eickhoff and A. P. Vries, "Increasing cheat robustness of crowdsourcing tasks," Inform Retrieval, vol. 16, no. 2, pp. 121-137, 2012.
82. G. Sutherlin, "A voice in the crowd: Broader implications for crowdsourcing translation during crisis," J Inf Sci, vol. 39, no. 3, pp. 397-409, 2013.
83. G. Barbier, R. Zafarani, H. Gao, G. Fung, and H. Liu, "Maximizing benefits from crowdsourced data," Comput Math Organ Th, vol. 18, no. 3, pp. 257-279, 2012.
84. N. Bojin, C. D. Shaw, and M. Toner, "Designing and deploying a 'compact' crowdsourcing infrastructure: A case study," Bus Inf Rev, vol. 28, no. 1, pp. 41-48, 2011.
85. J. Bao, Y. Sakamoto, and J. V. Nickerson, "Evaluating Design Solutions Using Crowds," in AMCIS '11 Proc., 2011.
86. J. H. Dulebohn and R. D. Johnson, "Human resource metrics and decision support: A classification framework," HRMR, vol. 23, no. 1, pp. 71-83, 2013.
87. L. Erickson, E. Trauth, and I. Petrick, "Getting Inside Your Employees Heads: Navigating Barriers to Internal-Crowdsourcing for Product and Service Innovation," in ICIS '12 Proc., 2012.
88. N. Gupta, S. A. Conroy, and J. E. Delery, "The many faces of pay variation," HRMR, vol. 22, no. 2, pp. 100-115, 2012.
89. J. Wang, A. Ghose, and P. Ipeirotis, "Bonus, Disclosure, and Choice: What Motivates the Creation of High-Quality Paid Reviews" in ICIS '12 Proc., 2012.
90. Y. Zhao and Q. Zhu, "Exploring the Motivation of Participants in Crowdsourcing Contest," in ICIS '12 Proc., 2012.
91. B. A. Huberman, D. M. Romero, and F. Wu, "Crowdsourcing, attention and productivity," J Inf Sci, vol. 35, no. 6, pp. 758-765, 2009.
92. M. Swan, "Scaling crowdsourced health studies: The emergence of a new form of contract research organization," Pers Med, vol. 9, no. 2, pp. 223-234, 2012.
93. H. Simula, "The Rise and Fall of Crowdsourcing" in HICSS '13 Proc., 2013, pp. 2783-2791.
94. G. A. Akerlof, "The Market for 'Lemons': Quality Uncertainty and the Market Mechanism," Q J Econ, vol. 84, no. 3, pp. 488-500, 1970.
95. A. M. Spence, "Job Market Signaling," Q J Econ, vol. 87, no. 3, pp. 355-374, 1973.
96. R. J. Lewicki, B. Barry, and D. M. Saunders, Negotiation, 6th ed. Boston: MCGraw-Hill, 2010.
97. F. Lopes, M. Wooldridge, and A. Q. Novais, "Negotiation among autonomous computational agents: principles, analysis and challenges," Artif Intell Rev, vol. 29, no. 1, pp. 1-44, 2008.
98. R. Buettner, "Crowdsourcing of a Human Resource Management Perspective: State of the Art, Challenges & Future Need for Research," Presentation at VHB '14 Conference, unpublished.