When does more money work? Examining the role of perceived fairness in pay on the performance quality of crowdworkers

Proceedings of the 11th International Conference on Web and Social Media, ICWSM 2017

Volumn , Issue , 2017, Pages 327-336

  Ye, Teng ^a   You, Sangseok ^a   Robert, Lionel P ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FIELD EXPERIMENT; PERFORMANCE QUALITY;

SOCIAL NETWORKING (ONLINE);

EID: 85029418102     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (50)

1. Adams, J. S. 1965. "Inequity In Social Exchange." In Advances in Experimental Social Psychology, edited by Leonard Berkowitz, 2:267-99. Academic Press.
2. Baron, R. M. and Kenny, D. A. 1986. "The Moderator- mediator Variable Distinction in Social Psychological Research: Conceptual, Strategic, and Statistical Considerations." Journal of Personality and Social Psychology 51 (6): 1173.
3. Buhrmester, M.; Kwang, T.; and Gosling, S. D. 2011. "Amazon's Mechanical Turk a New Source of Inexpensive, yet High-Quality, Data?" Perspectives on Psychological Science 6 (1): 3-5.
4. Camerer C.; Babcock L.; Loewenstein G.; and Thaler R. 1997. "Labor Supply of New York City Cabdrivers: One Day at a Time." The Quarterly Journal of Economics 112 (2): 407-441.
5. Colquitt, J. A. 2001. "On the Dimensionality of Organizational Justice: A Construct Validation of a Measure." Journal of Applied Psychology 86 (3): 386.
6. Colquitt, J. A.; Scott, B. A.; and LePine, J. A. 2007. "Trust, Trustworthiness, and Trust Propensity: A Meta-Analytic Test of Their Unique Relationships with Risk Taking and Job Performance." Journal of Applied Psychology 92 (4): 909.
7. Colquitt, J. A.; Scott, B. A.; Rodell, J. B.; Long, D. M.; Zapata, C. P.; Conlon, D. E.; and Wesson, M. J. 2013. "Justice at the Millennium, a Decade Later: A Meta- Analytic Test of Social Exchange and Affect-Based Perspectives." Journal of Applied Psychology 98 (2): 199.
8. Dennis, A. R.; Aronson, J. E.; Heninger, W. G.; and Walker, E. D. 1999. "Structuring Time and Task in Electronic Brainstorming." MIS Quarterly, 95-108. "Fair Payment." 2016. http://wiki.wearedynamo.org/index.php?title=Fair-paymen t#What-is-ethical-pay-for-Turkers-in-studies.3F.
9. Folger, R. 1977. "Distributive and Procedural Justice: Combined Impact of Voice and Improvement on Experienced Inequity." Journal of Personality and Social Psychology 35 (2): 108.
10. Folger, R.; and Konovsky, M. A. 1989. "Effects of Procedural and Distributive Justice on Reactions to Pay Raise Decisions." Academy of Management Journal 32 (1): 115-30.
11. Frøkjær, E.; Hertzum, M. and Hornbæk, K. 2000. "Measuring Usability: Are Effectiveness, Efficiency, and Satisfaction Really Correlated?" In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 345-352. ACM.
12. Gilliland, S. W. 1993. "The Perceived Fairness of Selection Systems: An Organizational Justice Perspective." Academy of Management Review 18 (4): 694-734.
13. Goodman, J. K.; Cryder, C. E.; and Cheema, A. 2013. "Data Collection in a Flat World: The Strengths and Weaknesses of Mechanical Turk Samples." Journal of Behavioral Decision Making 26 (3): 213-224.
14. Greenberg, J.; and Colquitt, J. A. eds. 2013. Handbook of Organizational Justice. Psychology Press.
15. Hayes, A. F. 2009. "Beyond Baron and Kenny: Statistical Mediation Analysis in the New Millennium." Communication Monographs 76 (4): 408-420.
16. Ho, C.J., Slivkins, A., Suri, S. and Vaughan, J.W., 2015, May. Incentivizing high quality crowdwork. In Proceedings of the 24th International Conference on World Wide Web, 419-429. ACM.
17. Hopkins, S. M.; and Weathington, B. L. 2006. "The Relationships Between Justice Perceptions, Trust, and Employee Attitudes in a Downsized Organization." The Journal of Psychology 140 (5): 477-98.
18. Horton, J. J.; and Chilton, L. B. 2010. "The Labor Economics of Paid Crowdsourcing." In Proceedings of the 11th ACM Conference on Electronic Commerce, 209-218. EC'10. New York, NY, USA: ACM.
19. Horton, J. J.; Rand, D. G.; and Zeckhauser, R. J. 2011. "The Online Laboratory: Conducting Experiments in a Real Labor Market." Experimental Economics 14 (3): 399-425.
20. Irani, L. C.; and Silberman, M. Six. 2013. "Turkopticon: Interrupting Worker Invisibility in Amazon Mechanical Turk." In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 611-620. CHI'13. New York, NY, USA: ACM.
21. Janssen, O. 2001. "Fairness Perceptions as a Moderator in the Curvilinear Relationships Between Job Demands, and Job Performance and Job Satisfaction." Academy of Management Journal 44 (5): 1039-50.
22. Jarvenpaa, S. L.; Knoll, K.; and Leidner, D. E. 1998. "Is Anybody out There? Antecedents of Trust in Global Virtual Teams." Journal of Management Information Systems 14 (4): 29-64.
23. Jirjahn, U. 2016. "Performance Pay and Productivity: A Note on the Moderating Role of a High-Wage Policy." Managerial and Decision Economics.
24. Kahneman, D. 2003. "Maps of Bounded Rationality: Psychology for Behavioral Economics." The American Economic Review 93 (5): 1449-1475.
25. Karriker, J. H.; and Williams, M. L. 2007. "Organizational Justice and Organizational Citizenship Behavior: A Mediated Multifoci Model." Journal of Management.
26. Kittur, A.; Jeffrey V. N.; Bernstein, M.; Gerber, E.; Shaw, A.; Zimmerman, J.; Lease, M.; and Horton, J. 2013. "The Future of Crowd Work." In Proceedings of the 2013 Conference on Computer Supported Cooperative Work, 1301-1318. CSCW'13. New York, NY, USA: ACM.
27. Mao, A.; Kamar, E.; Chen, Y.; Horvitz, E.; Schwamb, M. E.; Lintott, C. J.; and Smith A. M. 2013. "Volunteering versus Work for Pay: Incentives and Tradeoffs in Crowdsourcing." In First AAAI Conference on Human Computation and Crowdsourcing.
28. Martin, D.; Hanrahan, B. V.; O'Neill, J.; and Gupta N. 2014. "Being a Turker." In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing, 224-235. CSCW'14. New York, NY, USA: ACM.
29. Mason, W.; and Watts, D. J. 2009. "Financial Incentives and the'Performance of Crowds.'" In Proceedings of the ACM SIGKDD Workshop on Human Computation, 77-85. HCOMP'09. New York, NY, USA: ACM.
30. Mayer, R. C.; Davis, J. H.; and Schoorman, F. D. 1995. "An Integrative Model of Organizational Trust." Academy of Management Review 20 (3): 709-734.
31. McFarlin, D. B.; and Sweeney, P. D. 1992. "Research Notes. Distributive and Procedural Justice as Predictors of Satisfaction with Personal and Organizational Outcomes." Academy of Management Journal 35 (3): 626-37.
32. Newell, E.; and Ruths, D. 2016. "How One Microtask Affects Another." In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 3155-3166. CHI'16. New York, NY, USA: ACM.
33. Nguyen, D. T.; Dabbish, L. A.; and Kiesler, S. 2015. "The Perverse Effects of Social Transparency on Online Advice Taking." In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, 207-217. CSCW'15. New York, NY, USA: ACM.
34. Oppenheimer, D. M.; Meyvis, T.; and Davidenko, N. 2009. "Instructional Manipulation Checks: Detecting Satisficing to Increase Statistical Power." Journal of Experimental Social Psychology 45 (4): 867-872.
35. Robert, L. P.; Denis, A. R.; and Hung, Y. C. 2009. "Individual Swift Trust and Knowledge-Based Trust in Face-to- Face and Virtual Team Members." Journal of Management Information Systems 26 (2): 241-279.
36. Robert, L., and You S. 2013. "Are You Satisfied yet? Shared Leadership, Trust and Individual Satisfaction in Virtual Teams." In iConference 2013 Proceedings, 461-466.
37. Rogstadius, J.; Kostakos, V.; Kittur, A.; Smus, B.; Laredo, J.; and Vukovic, M. 2011. "An Assessment of Intrinsic and Extrinsic Motivation on Task Performance in Crowdsourcing Markets." ICWSM 11: 17-21.
38. Saunders, M. N. K.; and Thornhill, A. 2003. "Organisational Justice, Trust and the Management of Change: An Exploration." Personnel Review 32 (3): 360-75.
39. Schoorman, F. D.; Mayer, R. C.; and Davis, J. H. 1996. "Empowerment in Veterinary Clinics: The Role of Trust in Delegation." In 11th Annual Meeting of the Society for Industrial and Organizational Psychology, San Diego, CA.
40. Shaw, A. D.; Horton, J. J.; and Chen, D. L. 2011. "Designing Incentives for Inexpert Human Raters." In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, 275-284. CSCW'11. New York, NY, USA: ACM.
41. Shrout, P. E.; and Bolger, N. 2002. "Mediation in Experimental and Nonexperimental Studies: New Procedures and Recommendations." Psychological Methods 7 (4): 422.
42. Skarlicki, D. P.; and Folger, R. 1997. "Retaliation in the Workplace: The Roles of Distributive, Procedural, and Interactional Justice." Journal of Applied Psychology 82 (3): 434-43.
43. Sobel, M. E. 1982. "Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models." Sociological Methodology 13 (1982): 290-312.
44. Srinivasan, S.; Maruping L. M.; and Robert L. P. 2010. "Mechanisms Underlying Social Loafing in Technology Teams: An Empirical Analysis." In AIS.
45. Srinivasan, S.; Maruping L. M.; and Robert L. P. 2012. "Idea Generation in Technology-Supported Teams: A Multilevel Motivational Perspective." In System Science (HICSS), 2012 45th Hawaii International Conference on, 247-256. IEEE.
46. Tekleab, A. G.; Bartol, K. M.; and Liu, W. 2005. "Is It Pay Levels or Pay Raises That Matter to Fairness and Turnover?" Journal of Organizational Behavior 26 (8): 899-921.
47. Tversky, A.; and Kahneman D. 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty." Journal of Risk and Uncertainty 5 (4): 297-323.
48. Witt, L. A.; and Nye, L. G. 1992. "Gender and the Relationship between Perceived Fairness of Pay or Promotion and Job Satisfaction." Journal of Applied Psychology 77 (6): 910.
49. Yin, M.; and Chen, Y. 2016. "Predicting Crowd Work Quality under Monetary Interventions."
50. Yin, M.; Chen, Y.; and Sun, Y. 2013. "The Effects of Performance- Contingent Financial Incentives in Online Labor Markets."