Reputation transferability in online labor markets

Management Science

Volumn 62, Issue 6, 2016, Pages 1687-1706

  Kokkodis, Marios ^a   Ipeirotis, Panagiotis G ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

Bayesian modeling; Linear dynamical systems; Online labor markets; Reputation

Indexed keywords

BAYESIAN NETWORKS; COLLABORATIVE FILTERING; CONTRACTORS; DISTRIBUTED COMPUTER SYSTEMS; DYNAMICAL SYSTEMS; ELECTRONIC COMMERCE; EMPLOYMENT; LINEAR CONTROL SYSTEMS;

AMAZON MECHANICAL TURKS; BAYESIAN MODEL; LABOR MARKETS; LINEAR DYNAMIC SYSTEM; LINEAR DYNAMICAL SYSTEMS; ON-LINE MARKETPLACES; REPUTATION; REPUTATION MECHANISM;

ONLINE SYSTEMS;

EID: 84975127347     PISSN: 00251909     EISSN: 15265501     Source Type: Journal    
DOI: 10.1287/mnsc.2015.2217     Document Type: Article

References (55)

1. Adamic LA, Zhang J, Bakshy E, Ackerman MS (2008) Knowledge sharing and Yahoo answers: Everyone knows something. Proc. 17th Internat. Conf. World Wide Web (Association for Computing Machinery, New York), 665-674.
2. Agichtein E, Castillo C, Donato D, Gionis A, Mishne G (2008) Finding high-quality content in social media. Proc. 2008 Internat. Conf. Web Search and Data Mining (Association for Computing Machinery, New York), 183-194.
3. Agrawal A, Horton J, Lacetera N, Lyons E (2013) Digitization and the Contract Labor Market: A Research Agenda (University of Chicago Press, Chicago).
4. Aperjis C, Johari R (2010) Optimal windows for aggregating ratings in electronic marketplaces. Management Sci. 56(5):864-880.
5. Bakos Y, Dellarocas C (2011) Cooperation without enforcement? A comparative analysis of litigation and online reputation as quality assurance mechanisms. Management Sci. 57(11):1944-1962.
6. Berinsky AJ, Huber GA, Lenz GS (2012) Evaluating online labor markets for experimental research: Amazon.com's Mechanical Turk. Political Anal. 20(3):351-368.
7. Bian J, Liu Y, Zhou D, Agichtein E, Zha H (2009) Learning to recognize reliable users and content in social media with coupled mutual reinforcement. Proc. 18th Internat. Conf. World Wide Web (Association for Computing Machinery, New York), 51-60.
8. Bishop CM, et al (2006) Pattern Recognition and Machine Learning, Vol. 4 (Springer, New York).
9. Bolton GE, Katok E, Ockenfels A (2004) How effective are electronic reputation mechanisms? An experimental investigation. Management Sci. 50(11):1587-1602.
10. Borda M (2011) Fundamentals in Information Theory and Coding (Springer, Berlin).
11. Brynjolfsson E, Smith MD (2000) Frictionless commerce? A comparison of Internet and conventional retailers. Management Sci. 46(4):563-585.
12. Chandler D, Horton J (2011) Labor allocation in paid crowdsourcing: Experimental evidence on positioning, nudges and prices. Proc. 3rd Human Comput. Workshop, Vol. 11 (Association for the Advancement of Artificial Intelligence, San Francisco), 14-19.
13. Clemen RT, Winkler RL (1990) Unanimity and compromise among probability forecasts. Management Sci. 36(7):767-779.
14. Danescu-Niculescu-Mizil C, Kossinets G, Kleinberg J, Lee L (2009) How opinions are received by online communities: A case study on Amazon.com helpfulness votes. Proc. 18th Internat. Conf. World Wide Web (Association for Computing Machinery, New York), 141-150.
15. Dellarocas C (2003) The digitization of word of mouth: Promise and challenges of online feedback mechanisms. Management Sci. 49(10):1407-1424.
16. Dellarocas C (2006) Reputation mechanisms. Hendershott T, ed. Economics and Information Systems, Handbooks in Information Systems, Vol. 1 (Emerald Group Publishing, Bingley, UK), 629-660.
17. Ekstrand MD, Riedl JT, Konstan JA (2011a) Collaborative filtering recommender systems. Foundations Trends Human-Comput. Interaction 4(2):81-173.
18. Ekstrand MD, Ludwig M, Konstan JA, Riedl JT (2011b) Rethinking the recommender research ecosystem: Reproducibility, openness, and LensKit. Proc. Fifth ACM Conf. Recommender Systems (Association for Computing Machinery, New York), 133-140.
19. Gelman A, Carlin JB, Stern HS, Rubin DB (2004) Bayesian Data Analysis (Chapman & Hall/CRC, Boca Raton, FL).
20. Ghose A, Ipeirotis PG (2011) Estimating the helpfulness and economic impact of product reviews: Mining text and reviewer characteristics. IEEE Trans. Knowledge and Data Engrg. 23(10):1498-1512.
21. Greene WH (2007) Econometric Analysis (Prentice Hall, Upper Saddle River, NJ).
22. Hambleton RK (1991) Fundamentals of Item Response Theory (Sage Publications, Thousand Oaks, CA).
23. Horton JJ (2010) Online Labor Markets (Springer, Berlin).
24. Horton JJ, Chilton LB (2010) The labor economics of paid crowdsourcing. Proc. 11th ACM Conf. Electronic Commerce (Association for Computing Machinery, New York), 209-218.
25. Horton JJ, Rand DG, Zeckhauser RJ (2011) The online laboratory: Conducting experiments in a real labor market. Experiment. Econom. 14(3):399-425.
26. Hu N, Zhang J, Pavlou PA (2009) Overcoming the J -shaped distribution of product reviews. Commun. ACM 52(10):144-147.
27. Ipeirotis PG, Provost F, Wang J (2010) Quality management on Amazon Mechanical Turk. Proc. ACM SIGKDD Workshop on Human Comput. (Association for Computing Machinery, New York), 64-67.
28. Jeon J, Croft WB, Lee JH, Park S (2006) A framework to predict the quality of answers with non-textual features. Proc. 29th Ann. Internat. ACM SIGIR Conf. Res. and Development in Inform. Retrieval (Association for Computing Machinery, New York), 228-235.
29. Jerath K, Fader PS, Hardie BGS (2011) New perspectives on customer "death" using a generalization of the Pareto/NBD model. Marketing Sci. 30(5):866-880.
30. Kim S-M, Pantel P, Chklovski T, Pennacchiotti M (2006) Automatically assessing review helpfulness. Proc. 2006 Conf. Empirical Methods in Natural Language Processing (EMNLP) (Association for Computational Linquistics, Stroudsburg, PA), 423-430.
31. Kokkodis M (2012) Learning from positive and unlabeled Amazon reviews: Towards identifying trustworthy reviewers. Proc. 21st Internat. Conf. Companion on World Wide Web (Association for Computing Machinery, New York), 545-546.
32. Kokkodis M, Ipeirotis PG (2013) Have you done anything like that?: Predicting performance using inter-category reputation. Proc. Sixth ACM Internat. Conf. Web Search and Data Mining (Association for Computing Machinery, New York), 435-444.
33. Kokkodis M, Ipeirotis P (2014) The utility of skills in online labor markets. Proc. Internat. Conf. Inform. Systems, Auckland, New Zealand.
34. Kokkodis M, Papadimitriou P, Ipeirotis PG (2014) Hiring behavior models for online labor markets. Proc. Seventh Internat. Conf. Web Search and Data Mining (Association for Computing Machinery, New York).
35. Lappas T, Gunopoulos D (2010) Efficient confident search in large review corpora. Proc. 2010 Eur. Conf. Machine Learning and Knowledge Discovery in Databases: Part II (Springer, Berlin), 195-210.
36. Liu Y, Bian J, Agichtein E (2008a) Predicting information seeker satisfaction in community question answering. Proc. 31st Ann. Internat. ACM SIGIR Conf. Res. and Development in Inform. Retrieval (Association for Computing Machinery, New York), 483-490.
37. Liu Y, Huang X, An A, Yu X (2008b) Modeling and predicting the helpfulness of online reviews. Proc. Eighth IEEE Internat. Conf. Data Mining (Institute of Electrical and Electronics Engineers, Piscataway, NJ), 443-452.
38. Lu Y, Tsaparas P, Ntoulas A, Polanyi L (2010) Exploiting social context for review quality prediction. Proc. 19th Internat. Conf. World Wide Web (Association for Computing Machinery, New York), 691-700.
39. Mason W, Watts DJ (2009) Financial incentives and the performance of crowds. ACM SigKDD Explorations Newsletter 11(2):100-108.
40. Nelson P (1970) Information and consumer behavior. J. Political Econom. 78(2):311-329.
41. O'Mahony MP, Smyth B (2010) Using readability tests to predict helpful product reviews. Proc. RIAO 10 Adaptivity, Personalization and Fusion of Heterogeneous Information (Le Centre de Hautes Etudes Internationales D'Informatique Documentaire, Paris), 164-167.
42. Otterbacher J, Arbor A (2009) Helpfulness in online communities: A measure of message quality. Proc. SIGCHI Conf. Human Factors in Computing Systems (Association for Computing Machinery, New York), 955-964.
43. Pallais A (2014) Inefficient hiring in entry-level labor markets. Amer. Econom. Rev. 104(11):3565-3599.
44. Provost F, Fawcett T (2001) Robust classification for imprecise environments. Machine Learn. 42(3):203-231.
45. Rand DG (2012) The promise of Mechanical Turk: How online labor markets can help theorists run behavioral experiments. J. Theoret. Biol. 299:172-179.
46. Resnick P, Zeckhauser R, Swanson J, Lockwood K (2006) The value of reputation on eBay: A controlled experiment. Experiment. Econom. 9(2):79-101.
47. Shah C, Pomerantz J (2010) Evaluating and predicting answer quality in community QA. Proc. 33rd Internat. ACM SIGIR Conf. Res. and Development in Inform. Retrieval (Association for Computing Machinery, New York), 411-418.
48. Shapira B (2011) Recommender Systems Handbook (Springer, New York).
49. Sharara H, Rand W, Getoor L (2011) Differential adaptive diffusion: Understanding diversity and learning whom to trust in viral marketing. Proc. Internat. Conf. Weblogs and Social Media (Barcelona, Spain).
50. Shaw AD, Horton JJ, Chen DL (2011) Designing incentives for inexpert human raters. Proc. ACM 2011 Conf. Comput. Supported Cooperative Work (Association for Computing Machinery, New York), 275-284.
51. Sheng VS, Provost F, Ipeirotis PG (2008) Get another label? Improving data quality and data mining using multiple, noisy labelers. Proc. 14th ACM SIGKDD Internat. Conf. Knowledge Discovery and Data Mining (Association for Computing Machinery, New York), 614-622.
52. Snir EM, Hitt LM (2003) Costly bidding in online markets for IT services. Management Sci. 49(11):1504-1520.
53. Standifird SS (2001) Reputation and e-commerce: eBay auctions and the asymmetrical impact of positive and negative ratings. J. Management 27(3):279-295.
54. Suryanto MA, Lim E-P, Chiang AS (2009) Quality-aware collaborative question answering: Methods and evaluation. Proc. Second ACM Internat. Conf. Web Search and Data Mining (Association for Computing Machinery, New York), 142-151.
55. Tsaparas P, Ntoulas A, Terzi E (2011) Selecting a comprehensive set of reviews. Proc. 17th ACM SIGKDD Internat. Conf. Knowledge Discovery and Data Mining (Association for Computing Machinery, New York), 168-176.