So fast so good: An analysis of answer quality and answer speed in community Question-answering sites

Journal of the American Society for Information Science and Technology

Volumn 64, Issue 10, 2013, Pages 2058-2068

  Chua, Alton Y K ^a   Banerjee, Snehasish ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

information resources management

Indexed keywords

INFORMATION RESOURCES MANAGEMENT; QUESTION ANSWERING; QUESTION TYPE; RESEARCH QUESTIONS;

ARTIFICIAL INTELLIGENCE; SOFTWARE ENGINEERING;

SPEED;

EID: 84883866321     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.22902     Document Type: Article

References (55)

1. Agichtein, E., Castillo, C., Donato, D., Gionis, A., &, Mishne, G., (2008). Finding high-quality content in social media. In Proceedings of the International Conference on Web Search and Web Data Mining (pp. 183-194). New York: ACM Press.
2. Barry, C.L., (1994). User-defined relevance criteria: An exploratory study. Journal of the American Society for Information Science, 45 (3), 149-159.
3. Berlanga, A.J., Sloep, P.B., Kester, L., Brouns, F., van, Rosmalen, P., &, Koper, R., (2008). Ad hoc transient communities: Towards fostering knowledge sharing in learning networks. International Journal of Learning Technology, 3 (4), 443-458.
4. th International Conference on Information Technology: New Generations (ITNG '10) (pp. 534-539). Palo Alto, CA: AAAI Press.
5. Blooma, M.J., Chua, A.Y.K., &, Goh, D.H.L., (2011). What makes a high-quality user-generated answer? IEEE Internet Computing, 15 (1), 66-71.
6. Christensen, L.B., Johnson, R.B., &, Turner, L.A., (2010). Research methods, design, and analysis. Upper Saddle River, NJ: Pearson Education.
7. Cohen, J., (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20 (1), 37-46.
8. th National Online Meeting (pp. 77-84). Medford, NJ: Learned Information.
9. th Text REtrieval Conference (TREC '07) (pp. 99-116). Gaithersburg, MD: National Institute of Standards and Technology.
10. Deng, S., Liu, Y., &, Qi, Y., (2011). An empirical study on determinants of web based question-answer services adoption. Online Information Review, 35 (5), 789-798.
11. Deterding, S., Dixon, D., Khaled, R., &, Nacke, L.E., (2011). Gamification: Toward a definition. In, D. Tan, &, B. Begole, (Eds.), Design, 12-15. Retrieved from http://gamification-research.org/wp-content/uploads/2011/ 04/02-Deterding-Khaled-Nacke-Dixon.pdf
12. Fichman, P., (2011). A comparative assessment of answer quality on four question answering sites. Journal of Information Science, 37 (5), 476-486.
13. Fu, J., &, Chen, J.H.F., (2011). The impact of seller expertise and a refund guarantee on auction outcome: Evidence from an online field experiment of camera lens market. International Journal of Electronic Business Management, 9 (3), 187-195.
14. Fung, T.K.F., (2008). Banking with a personalized touch: Examining the impact of website customization on commitment. Journal of Electronic Commerce Research, 9 (4), 296-309.
15. Gazan, R., (2006). Specialists and synthesists in a question answering community. Proceedings of the American Society for Information Science and Technology, 43, 1-10.
16. Goffman, E., (1959). The presentation of self in everyday life. New York: Anchor Books.
17. Harper, F.M., Raban, D., Rafaeli, S., &, Konstan, J.A., (2008). Predictors of answer quality in online Q&A sites. In Proceedings of the ACM Conference on Human Factors in Computing Systems (pp. 865-874). New York: ACM Press.
18. Harper, F.M., Weinberg, J., Logie, J.J., &, Konstan, J.A., (2010). Question types in social Q&A sites. First Monday, 15 (7). Retrieved from http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/viewArticle/ 2913/2571
19. Internet World Stats. (2012). Internet world users by language. Retrieved from http://www.internetworldstats.com/stats7.htm
20. Jansen, B.J., Zhang, M., &, Schultz, C.D., (2009). Brand and its effect on user perception of search engine performance. Journal of the American Society for Information Science and Technology, 60 (8), 1572-1595.
21. Kahn, B.K., Strong, D.M., &, Wang, R.Y., (2002). Information quality benchmarks: Product and service performance. Communications of the ACM, 45 (4), 184-192.
22. Kelly, D., Wacholder, N., Rittman, R., Sun, Y., Kantor, P., Small, S., &, Strzalkowski, T., (2007). Using interview data to identify evaluation criteria for interactive, analytical question-answering systems. Journal of the American Society for Information Science and Technology, 58 (7), 1032-1043.
23. Kim, S., Oh, J., &, Oh, S., (2007). Best-answer selection criteria in a social Q&A site from the user-oriented relevance perspective. Proceedings of the American Society for Information Science and Technology, 44, 1-15.
24. Kim, S., &, Oh, S., (2009). Users' relevance criteria for evaluating answers in a social questions and answers site. Journal of the American Society for Information Science and Technology, 60 (4), 716-727.
25. Kitzie, V., &, Shah, C., (2011). Faster, better, or both? Looking at both sides of online question answering coin. Proceedings of the American Society for Information Science and Technology, 48, 1-4.
26. Krippendorf, K., (2004). Content analysis: An introduction to its methodology. Beverly Hills, CA: Sage.
27. Laukkanen, T., Sinkkonen, S., &, Laukkanen, P., (2009). Communication strategies to overcome functional and psychological resistance to Internet banking. International Journal of Information Management, 29 (2), 111-118.
28. Lee, D., (2004). Sense of co-accomplishment in collaborative work as threshold in establishing a sense of community in an online course. (Doctoral dissertation). University of Texas at Austin.
29. Lin, J., &, Katz, B., (2006). Building a reusable test collection for question answering. Journal of the American Society for Information Science and Technology, 57 (7), 851-861.
30. Mamykina, L., Manoim, B., Mittal, M., Hripcsak, G., &, Hartmann, B., (2011). Design lessons from the fastest Q&A site in the west. In Proceedings of the ACM Conference on Human Factors in Computing Systems (pp. 2857-2866). New York: ACM Press.
31. Nam, K.K., Ackerman, M.S., &, Adamic, L.A., (2009). Questions in, Knowledge-iN?: A study of Naver's question answering community. In Proceedings of the ACM Conference on Human Factors in Computing Systems (pp. 779-788). New York: ACM Press.
32. Neuendorf, K.A., (2002). The content analysis guidebook. Beverly Hills, CA: Sage.
33. Nisbett, R.E., Peng, K., Choi, I., &, Norenzayan, A., (2001). Culture and systems of thought: Holistic versus analytic cognition. Psychological Review, 108 (2), 291-310.
34. Park, T., (1993). The nature of relevance in information retrieval: Empirical study. Library Quarterly, 63 (3), 318-351.
35. Potter, W.J., &, Levine-Donnerstein, D., (1999). Rethinking validity and reliability in content analysis. Journal of Applied Communication Research, 27 (3), 258-284.
36. Qu, B., Cong, G., Li, C., Sun, A., &, Chen, H., (2012). An evaluation of classification models for question topic categorization. Journal of the American Society for Information Science and Technology, 63 (5), 889-903.
37. Raban, D.R., &, Harper, F.M., (2008). Motivations for answering questions online. In, D. Caspi, &, T. Azran, (Eds.), New media and innovative technologies. Be'er Shiva, Israel: Burda Research Center and Ben Gurion University.
38. Roussinov, D., Fan, W., &, Robles-Flores, J., (2008). Beyond keywords: Automated question answering on the web. Communications of the ACM, 51 (9), 60-65.
39. Saracevic, T., (2007). Relevance: A review of the literature and a framework for thinking on the notion in information science. Part III: Behavior and effects of relevance. Journal of the American Society for Information Science and Technology, 58 (13), 2126-2144.
40. Schamber, L., (1994). Relevance and information behavior. Annual Review of Information Science and Technology, 29, 3-48.
41. Schau, H.J., &, Gilly, M.C., (2003). We are what we post? Self-presentation in personal web space. Journal of Consumer Research, 30 (3), 385-404.
42. Shachaf, P., (2009). The paradox of expertise: Is the Wikipedia Reference Desk as good as your library? Journal of Documentation, 65 (6), 977-996.
43. Shah, C., (2011, February 7). Effectiveness and user satisfaction in Yahoo! Answers. First Monday, 16 (2). Retrieved from http://firstmonday.org/ htbin/cgiwrap/bin/ojs/index.php/fm/article/view/3092/2769
44. Shah, C., Oh, J.S., &, Oh, S., (2008, September 1). Exploring characteristics and effects of user participation in online social Q&A sites. First Monday, 13 (9). Retrieved from http://firstmonday.org/htbin/ cgiwrap/bin/ojs/index.php/fm/article/view/2182/2028
45. Spink, A., &, Ozmutlu, H.C., (2001). What do people ask on the web and how do they ask it: Ask Jeeves query analysis. Proceedings of the American Society for Information Science and Technology, 38, 545-554.
46. Surowiecki, J., (2004). The wisdom of crowds. New York: Anchor Books.
47. Suryanto, M.A., Sun, A., Lim, E., &, Chiang, R.H.L., (2009). Quality-aware collaborative question answering: Methods and evaluation. In Proceedings of the Second ACM International Conference on Web Search and Data Mining. New York: ACM Press.
48. Tractinsky, N., &, Meyer, J., (1999). Chartjunk or goldgraph? Effects of presentation objectives and content desirability on information presentation. MIS Quarterly, 23 (3), 397-420.
49. Varnum, M.E.W., Grossmann, I., Kitayama, S., &, Nisbett, R.E., (2010). The origin of cultural differences in cognition: The social orientation hypothesis. Current Directions in Psychological Science, 10 (1), 9-13.
50. th Text REtrieval Conference (TREC '04) (pp. 54-68). Gaithersburg, MD: National Institute of Standards and Technology.
51. th Text REtrieval Conference (TREC '05) (pp. 52-62). Gaithersburg, MD: National Institute of Standards and Technology.
52. Weber, T.A., (2003). An exact relation between willingness to pay and willingness to accept. Economics Letters, 80 (3), 311-315.
53. Wu, Y.Z., Zhao, J., Duan, X., &, Xu, B., (2005). Research on question answering and evaluation: A survey. Journal of Chinese Information Processing, 19 (3), 1-13.
54. Yang, J., Morris, M.R., Teevan, J., Adamic, L., &, Ackerman, M., (2011). Culture matters: A survey study of social Q&A behavior. In Proceedings of the International Conference on Weblogs and Social Media. Palo Alto, CA: AAAI Press.
55. Zheng, X., Hu, Z., Xu, A., Chen, D., Liu, K., &, Li, B., (2012). Algorithm for recommending answer providers in community-based question answering. Journal of Information Science, 38 (1), 3-14.