What Online Reviewer Behaviors Really Matter? Effects of Verbal and Nonverbal Behaviors on Detection of Fake Online Reviews

Journal of Management Information Systems

Volumn 33, Issue 2, 2016, Pages 456-481

  Zhang, Dongsong ^a   Zhou, Lina ^a   Kehoe, Juan Luo ^a   Kilic, Isil Yakut ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIORAL RESEARCH; SENSITIVITY ANALYSIS;

BEHAVIORAL FEATURES; EMPIRICAL EVALUATIONS; FAKE REVIEW DETECTIONS; MODEL PRUNING; NON-VERBAL FEATURES; NONVERBAL BEHAVIOR; ONLINE CONSUMER REVIEWS; ONLINE REVIEWS;

FEATURE EXTRACTION;

EID: 84990985759     PISSN: 07421222     EISSN: 1557928X     Source Type: Journal    
DOI: 10.1080/07421222.2016.1205907     Document Type: Article

References (69)

1. E.Alpaydin, Introduction to Machine Learning. Cambridge, MA:MIT Press, 2009.
2. S.Banerjee, and A.Y.K.Chua, A study of manipulative and authentic negative reviews. In Proceedings of the Eighth International Conference on Ubiquitous Information Management and Communication. Cambodia, January 9–11, 2014.Article No. 76.
3. L.Breiman, Random forests. Machine Learning, 45, 1 (2001), 5–32.
4. D.B.Buller, and J.K.Burgoon, Interpersonal deception theory. Communication Theory, 6, 3 (1996), 203–242.
5. L.S.Chen, and J.Y.Lin, A study on review manipulation classification using decision tree. Proceedings of the Tenth IEEE International Conference on Service Systems and Service Management (ICSSSM). Hong Kong, July 17–19, 2013, pp. 680–685.
6. Y.Chen, and H.Chen, Opinion spam detection in web forum:A real case study. Proceedings of WWW, May 18–22, 2015, Florence, Italy, pp. 173–183.
7. C.Chen, ; K.Wu, ; V.Srinivasan, ; and X.Zhang, Battling the Internet water army:Detection of hidden paid posters. Proceedings of the 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining. Niagara Falls, Canada, August 25–28, pp. 116–120.
8. Cone Research. Game changer:Corn survey finds 4-out-of-5 consumers reverse purchase decisions based on negative online reviews. 2011. www.conecomm.com/contentmgr/showdetails.php/id/4008 (accessed on September 15, 2015).
9. G.Cui, ; H.-K.Lui, ; and X.Guo, The effect of online consumer product reviews on new product sales. International Journal of Electronic Commerce, 17, 1 (2012), 39–58.
10. K.Dave, ; S.Lawrence, ; and D.M.Pennock, Mining the peanut gallery:Opinion extraction and semantic classification of product reviews. Proceedings of the Twelfth International Conference on World Wide Web, Budapest, May 20–24, 2003, pp. 519–528.
11. A.R.Dennis, ; R.M.FullerRobert M.; and J.S.Valacich, Media, tasks, and communication processes:A theory of media synchronicity. MIS Quarterly, 32, 3 (2008), 575–600.
12. H.Duan, and C.Zirn, Can we identify manipulative behavior and the corresponding suspects on review websites using supervised learning? Lecture Notes in Computer Science, 7617 (2012), pp. 215–230.
13. G.Fei, ; A.Mukherjee, ; B.Liu, ; M.Hsu, ; M.Castellanos, ; and R.Ghosh, Exploiting burstiness in reviews for review spammer detection. Proceedings of the International AAAI Conference on Weblogs and Social Media (ICWSM-2013), Boston, MA, July 8–10, 2013, pp. 175–184.
14. S.Feng, R.Banerjee, and Y.Choi, Syntactic stylometry for deception detection. Proceedings of the Fiftieth Annual Meeting of the Association for Computational Linguistics. Jeju, Republic of Korea, July 8–14, 2012, pp. 171–175.
15. S.Feng, ; L.Xing, ; A.Gogar, ; and Y.Choi, Distributional footprints of deceptive product reviews. Proceedings of the Sixth International AAAI Conference on Weblogs and Social Media. June 4–8, 2012, Dublin. pp. 98–105.
16. 2 from contingency tables, and the calculation of P. Journal of the Royal Statistical Society, 85, 1 (1922), 87–94.
17. C.M.Fuller, ; D.P.Biros, ; J.Burgoon, ; and J.Nunamaker, An examination and validation of linguistic constructs for studying high-stakes deception. Group Decision and Negotiation, 22, 1 (2013), 117–134.
18. C.M.Fuller, ; D.P.Biros, ; and D.Delen, An investigation of data and text mining methods for real world deception detection. Expert Systems with Applications, 38, 7 (2011), 8392–8398.
19. A.Ghose, and P.Ipeirotis, Estimating the helpfulness and economic impact of product reviews:Mining text and reviewer characteristics. IEEE Transactions on Knowledge and Data Engineering, 23, 10 (2011), 1498–1512.
20. S.Gokhman, ; J.Hancock, ; P.Prabhu, ; M.Ott, ; and C.Cardie, In search of a gold standard in studies of deception. Proceedings of the Workshop on Computational Approaches to Deception Detection, Stroudsburg, PA, April 23, 2012, pp. 23–30.
21. D.L.Gupta, ; A.Malviya, ; and S.Singh, Performance analysis of classification tree learning algorithms. International Journal of Computer Applications, 55, 6 (2012), 39–44.
22. J.E.Hocking, and D.G.Leathers, Nonverbal indicators of deception:A new theoretical perspective. Communication Monographs, 47, 2 (1980), 119–131.
23. M.Hu, and B.Liu, Mining and summarizing customer reviews. Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge discovery and Data Mining, Seattle, WA, August 22–25, 2004, pp. 168–177.
24. L.Huang, ; C.H.Tan, ; W.Ke, ; and K.K.Wei, Comprehension and assessment of product reviews:A review-product congruity proposition. Journal of Management Information Systems, 30, 3 (2013), 311–343.
25. S.L.Humpherys, ; K.C.Moffitt, ; M.B.Burns, ; J.K.Burgoon, ; and W.F.Felix, Identification of fraudulent financial statements using linguistic credibility analysis. Decision Support Systems, 50, 3 (2011), 585–594.
26. K.M.Hunt, Gaming the system:Fake online reviews v. consumer law. Computer Law and Security Review, 31, 1 (2015), 3–25.
27. M.L.Jensen, ; J.M.Averbeck, ; Z.Zhang, ; and K.B.Wright, Credibility of anonymous online product reviews:A language expectancy perspective. Journal of Management Information Systems, 30, 1 (2013), 293–324.
28. N.Jindal, and B.Liu, Opinion spam and analysis. First ACM International Conference on Web Search and Data Mining (WSDM-2008), Stanford, CA, February 11–12, 2008, pp. 219–230.
29. N.Jindal, and B.Liu, Review spam detection. Proceedings of WWW-2007, Banff, Canada, May 8–12, 2007, pp. 1189–1190.
30. D.Kamerer, Understanding the Yelp review filter:An exploratory study. First Monday, 19, 9 (2014). http://firstmonday.org/article/view/5436/4111.
31. T.Lappas, Fake reviews:the malicious perspective. Proceedings of the Seventeenth international Conference on Applications of Natural Language Processing and Information Systems. Groningen, June 26–28, 2012, pp. 23–34.
32. R.Y.K.Lau, ; S.Y.Liao, ; R.C.-W.Kwok, ; K.Xu, ; Y.Xia, ; and Y.Li, Text mining and probabilistic language modeling for online review spam detection. ACM Transactions on Management Information Systems, 2, 4 (2011), 1–30.
33. H.Li, ; Z.Chen, ; B.Liu, ; X.Wei, ; and J.Shao, Spotting fake reviews via collective positive-unlabeled learning. IEEE International Conference on Data Mining (ICDM). Shenzhen, December 14–17, 2014, pp. 899–904.
34. F.Li, ; M.Huang, ; Y.Yang, ; and X.Zhu, Learning to identify review spam. Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence. Barcelona, July 16–22, 2011, pp. 2488–2493.
35. J.Li, ; M.Ott, ; C.Cardie, ; and E.Hovy, Towards a general rule for identifying deceptive opinion spam. Proceedings of the Fifty-Second Annual Meeting of the Association for Computational Linguistics. Baltimore, June 23–25, 2014, pp. 1566–1576.
36. E.-P.Lim, ; V.-A.Nguyen, ; N.Jindal, ; B.Liu, ; and H.Lauw, Detecting product review spammers using rating behaviors. Proceedings of the Nineteenth ACM International Conference on Information and Knowledge Management (CIKM-2010), Toronto, Canada, October 26–30, 2010, pp. 939–948.
37. M.Luca, and G.Zervas, Fake it till you make it:Reputation, competition, and Yelp review fraud. Management Science, published online on January 28, 2016. http://dx.doi.org/10.1287/mnsc.2015.2304
38. X.Ma, ; L.Khansa, ; Y.Deng, ; and S.Kim, Impact of prior reviews on the subsequent review process in reputation systems. Journal of Management Information Systems, 30, 3 (2013), 279–310.
39. S.McCornack, Information manipulation theory. Communication Monographs, 59, 1 (1992), 1–16.
40. R.Mihalcea, and C.Strapparava, The lie detector:Explorations in the automatic recognition of deceptive language. Proceedings of the ACLIJCNLP 2009 Conference, Singapore, August 2–7, 2009, pp. 309–312.
41. T.M.Mitchell, Machine Learning. Burr Ridge, IL:McGraw-Hill, 1997.
42. A.Mukherjee, ; B.Kumar, ; B.Liu, ; J.Wang, ; M.Hsu, ; M.Castellanos, ; and R.Ghosh, Spotting opinion spammers using behavioral footprints. Proceedings of the SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2013), Chicago, IL, August 11–14, 2013, pp. 632–640.
43. A.Mukherjee, & B.Liu, Modeling review comments. Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics. 1 (2011), pp. 320–329
44. A.Mukherjee, ; B.Liu, ; and N.Glance, Spotting fake reviewer groups in consumer reviews. Proceedings of the International World Wide Web Conference (WWW-2012), Lyon, France, April 16–20, 2012, pp. 191–200.
45. A.Mukherjee, ; B.Liu, ; J.Wang, ; N.Glance, ; and N.Jindal, Detecting group review spam. Proceedings of WWW 2011, Hyderabad, India, March 28–April 1, 2011, pp. 93–94.
46. A.Mukherjee, ; V.Venkataraman, ; B.Liu, ; and N.Glance, Fake review detection:Classification and analysis of real and pseudo reviews Technical report. University of Illinois at Chicago, 2013.
47. A.Mukherjee, ; V.Venkataraman, ; B.Liu, ; and N.Glance, What Yelp fake review filter might be doing. Proceedings of the International AAAI Conference on Weblogs and Social Media (ICWSM-2013), Boston, MA, July 8–10, 2013.
48. M.Ott, ; C.Cardie, ; and J.Hancock, Estimating the prevalence of deception in online review communities. Proceedings of WWW 2012, Lyon, France, April 16–20, 2012, pp. 201–210.
49. M.Ott, ; Y.Choi, ; C.Cardie, ; and J.Hancock, Finding deceptive opinion spam by any stretch of the imagination. Proceedings of the Forty-Ninth Annual Meeting of the Association for Computational Linguistics:Human Language Technologies, Portland, OR, June 19–24, 2011, pp. 309–319.
50. M.S.Patil, and A.Bagade, Online review spam detection using language model and feature selection. International Journal of Computer Applications, 59, 7 (2012), 33–36.
51. M.Rahman, ; B.Carbunar, ; J.Ballesteros, ; G.Burri, ; and D.H.P.Chau, Turning the tide:Curbing deceptive Yelp behaviors. Proceedings of SIAM Data Mining Conference (SDM). Philadelphia, April 24–26, 2014, pp. 244–252.
52. I.Rish, ; J.Hellerstein, ; and J.Thathachar, An analysis of data characteristics that affect Naïve Bayes performance. Proceedings of the Eighteenth Conference on Machine Learning–ICML 2001, Williamstown, MA, June 28–July 1, 2001, pp. 30–37.
53. K.Sharma, and K.Lin, Review spam detector with rating consistency check. Proceedings of ACMSE’13, Savannah, GA, April 4–6, 2013, pp. 30–37, Article No. 34.
54. S.Shojaee, ; M.A.A.Murad, ; A.B.Azman, ; N.M.Sharef, ; and S.Nadali, Detecting deceptive reviews using lexical and syntactic features. Proceedings of the Thirteenth International Conference on Intelligent Systems Design and Applications (ISDA), Banji, December 8–10, 2013, pp. 53–58.
55. N.Spirin, and J.Han, Survey on web spam detection:principles and algorithms. ACM SIGKDD Explorations Newsletter, 13, 2 (2012), 50–64.
56. H.Sun, ; A.Morales, ; and X.Yan, Synthetic review spamming and defense. Proceedings of SIGKDD 2013. Chicago, August 11–14, 2013, pp. 1088–1096.
57. Y.Tsuruoka, and J.Tsujii, Training a naive Bayes classifier via the EM algorithm with a class distribution constraint. Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL, Edmonton, Canada, May 31–June 1, 2003, pp. 127–134.
58. S.Wakade, ; K.J.Liszka, ; and C.C.Chan, Application of learning algorithms to image spam evolution. In Ramanna, S., Jain, L.C., and Howlett, R.J. (ed.) Emerging Paradigms in Machine Learning, Berlin:Springer, 2013, pp. 471–495.
59. G.Wang, ; S.Xie, ; B.Liu, ; and P.S.Yu, Review graph based online store review spammer detection. Proceedings of ICDM-2011, Vancouver, Canada, December 11–14, 2011, pp. 1242–1247.
60. G.Wang, ; S.Xie, ; B.Liu, ; and P.S.Yu, Identify online store review spammers via social review graph. ACM Transactions on Intelligent Systems and Technology, 3, 4 (2011), 1–21.
61. G.Wu, ; D.Greene, ; B.Smyth, ; and P.Cunningham, Distortion as a validation criterion in the identification of suspicious reviews. Proceedings of the First Workshop on Social Media Analytics. Washington, DC, July 25, 2010, pp.10–13.
62. C.Xu, Detecting collusive spammers in online review communities. Proceedings of the Sixth Workshop on Ph.D. Students in Information and Knowledge Management, San Francisco, CA, October 27–November 1, 2013, pp. 33–40.
63. K.Yoon, and U.Gretzel, Comparison of deceptive and truthful travel reviews. International Conference on Information and Communication Technologies in Tourism, Amsterdam, 2009, pp. 37–47.
64. L.Zhou, An empirical investigation of deception behavior in Instant Messaging. IEEE Transactions on Professional Communication, 48, 2 (2005), 147–160.
65. L.Zhou, ; Y.Shi, ; and D.Zhang, Catch deceptive messages online. Proceedings of the Fourteenth Workshop on Information Technology and Systems (WITS 2004). Washington, DC, 2004, pp. 230–235.
66. L.Zhou, ; J.K.Burgoon, ; J.F.Nunamaker, ; and D.Twitchell, Automated linguistics based cues for detecting deception in text-based asynchronous computer-mediated communication:An empirical investigation. Group Decision and Negotiation, 13, 1 (2004), 81–106.
67. L.Zhou, ; Y.Sung, ; and D.Zhang, Deception performance in online group negotiation and decision making:The effects of deception experience and deception skill. Group Decision and Negotiation, 22 (2013), 153–172.
68. L.Zhou, and D.Zhang, Following linguistic footprints:Automatic deception detection in online communication. Communications of the ACM (CACM), 51, 9 (2008), 119–122.
69. F.Zhu, and X.Zhang, Impact of online consumer reviews on sales:The moderating role of product and consumer characteristics. Journal of Marketing, 74, 2 (2010), 133–148.