Modeling dwell time to predict click-level satisfaction

WSDM 2014 - Proceedings of the 7th ACM International Conference on Web Search and Data Mining

Volumn , Issue , 2014, Pages 193-202

  Kim, Youngho ^a   Hassan, Ahmed ^b   White, Ryen W ^b   Zitouni, Imed ^b  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

^b MICROSOFT   (United States)

Author keywords

click satisfaction.; dwell time analysis; user behavior

Indexed keywords

DATA MINING; FORECASTING; INFORMATION RETRIEVAL; WEBSITES;

BASELINE METHODS; CLICK SATISFACTION; DWELL TIME; SATISFACTION MODEL; SEARCH PERFORMANCE; TIME SPENT; USER BEHAVIORS;

BEHAVIORAL RESEARCH;

EID: 84904566992     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2556195.2556220     Document Type: Conference Paper

References (46)

1. Ageev, M., Guo, Q., Lagun, D., and Agichtein, E. (2011). Find it if you can: a game for modeling different types of web search success using interaction data. Proc. SIGIR, 345-354.
2. Agichtein, E., Brill, E., and Dumais, S. (2006). Improving web search ranking by incorporating user behavior information. Proc. SIGIR, 19-26.
3. Agichtein, E., Brill, E., Dumais, S.T., and Ragno, R. (2006). Learning user interaction models for predicting web search result preferences. Proc. SIGIR, 3-10.
4. Bennett, P.N., Svore, K., and Dumais, S.T. (2010). Classification- enhanced ranking. Proc. WWW, 111-120.
5. Boldi, P., Bonchi, F., Castillo, C., Donato, D., Gionis, A., and Vigna, S. (2008). The query-flow graph: model and applications. Proc. CIKM, 609-618.
6. Buscher, G., van Elst, L., and Dengel, A. (2009). Segment-level display time as implicit feedback: a comparison to eye tracking. Proc. SIGIR, 67-74.
7. Cameron, A.C. and Trivedi, P.K. (1998). Regression Analysis of Count Data. Cambridge University Press.
8. Chang, C.-C. and Lin, C.-J. (2011). LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2(27): 1-27.
9. Choi, S.C. and Whette, R. (1969). Maximum likelihood estimation of the parameters of the gamma distribution and their bias. Technometrics, 11(4): 683-690.
10. Claypool, M., Le, P., Wased, M., and Brown, D. (2001). Implicit interest indicators. Proc. IUI, 33-40.
11. Collins-Thompson, K. and Callan, J. (2004). A language modeling approach to predicting reading difficulty. Proc. HLT, 193-200.
12. Cronen-Townsend, S., Zhou, Y., and Croft, W.B. (2002). Predicting query performance. Proc. SIGIR, 299-306.
13. Feild, H., Allan, J., and Jones, R. (2010). Predicting searcher frustration. Proc. SIGIR, 34-41.
14. Fox, S., Karnawat, K., Mydland, M., Dumais, S., and White, T. (2005). Evaluating implicit measures to improve web search. ACM TOIS, 23(2): 147-168. (Pubitemid 40786322)
15. Friedman, J.H. (2001). Greedy function approximation: a gradient boosting machine. The Annals of Statistics, 29(5): 1189-1232.
16. Guo, Q. and Agichtein, E. (2012). Beyond dwell time: estimating document relevance from cursor movements and other post-click searcher behavior. Proc. WWW, 569-578.
17. Guo, Q., White, R.W., Dumais, S.T., Wang, J., and Anderson, B. (2010). Predicting query performance using query, result, and user interaction features. Proc. RIAO, 198-201.
18. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, I.H. (2009). The WEKA data mining software: an update. SIGKDD Explorations, 11(1): 10-18.
19. Hassan, A. (2012). A semi-supervised approach to modeling web search satisfaction. Proc. SIGIR, 275-284.
20. Hassan, A., Jones, R., and Klinkner, K.L. (2010). Beyond DCG: user behavior as a predictor of a successful search. Proc. WSDM, 221-230.
21. Hassan, A., Shi, X., Craswell, N., and Ramsey, B. (2013). Beyond clicks: query reformulation as a predictor of search satisfaction. Proc. CIKM, 2019-2028.
22. Hassan, A., Song, Y., and He, L. (2011). A task level user satisfaction model and its application on improving relevance estimation. Proc. CIKM, 125-134.
23. He, B. and Ounis, I. (2006). Query performance prediction. Information System, 31(7): 585-594. (Pubitemid 44233987)
24. Hogg, R. V., McKean, J., and Craig, A.T. (2012). Introduction to Mathematical Statistics. Pearson, 7th Ed.
25. Huffman, S. and Hochster, M. (2007). How well does result relevance predict session satisfaction? Proc. SIGIR, 567-574.
26. T. Joachims. (2002). Optimizing search engines using clickthrough data. Proc. SIGKDD, 132-142.
27. Justel, A., Peña, D., and Zamar, R. (1997). A multivariate Kolmogorov-Smirnov test of goodness of fit. Statistics & Probability Letters, 35(3): 251-259. (Pubitemid 127163069)
28. Kang, I.-H. and Kim, G. (2003). Query type classification for web document retrieval. Proc. SIGIR, 64-71.
29. Kelly, D. and Teevan, J. (2003). Implicit feedback for inferring user preference: a bibliography. SIGIR Forum : 37(2).
30. Kidwell, P., Lebanon, G., and Collins-Thompson, K. (2009). Statistical estimation of word acquisition with application to readability prediction. Proc. EMNLP, 900-909.
31. Kelly, D. and Belkin, N.J. (2001). Reading time, scrolling, and interaction: exploring implicit sources of user preferences for relevance feedback. Proc. SIGIR, 408-409
32. Kelly, D. and Belkin, N.J. (2004). Display time as implicit feedback: understanding task effects. Proc. SIGIR, 377-384.
33. Kim, Y., Hassan, A., White, R.W., and Wang, Y.-M. (2013). Playing by the rules: mining query associations to predict search performance. Proc. WSDM, 133-142.
34. Leskovec, J., Dumais, S., and Horvitz, E. (2007). Web projections: learning from contextual sub graphs of the web. Proc. WWW, 471-480.
35. Liu C., White, R.W., and Dumais, S. (2010). Understanding web browsing behaviors through Weibull analysis of dwell time. Proc. SIGIR. 379-386.
36. Lloyd, S.P. (1982). Least squares quantization in PCM. IEEE Transactions on Information Theory, 28(2): 129-137.
37. Minka, T.P. (2002). Estimating a Gamma Distribution. Microsoft Research Technical Report.
38. Quinlan, J.R. (1993). C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers.
39. Radlinski, F., Kurup, M. and Joachims, T. (2008). How does clickthrough data reflect retrieval quality? Proc. CIKM, 43-52.
40. Wang, K., Thrasher, C., Viegas, E., Li, X. and Hsu, P. (2010). An overview of Microsoft web n-gram corpus and applications. NAACL HLT Demo Session, 45-48.
41. White, R.W. and Huang, J. (2010). Assessing the scenic route: measuring the value of search trails in web logs. Proc. Proc. SIGIR, 587-594.
42. White, R. W. and Kelly, D. (2006). A study on the effects of personalization and task information on implicit feedback performance. Proc. CIKM. 297-306.
43. Xue, G.-R., Xing, D., Yang, Q., and Yu, Y. (2008). Deep classification in large-scale text hierarchies. Proc. SIGIR, 619-626.
44. Yin, P., Luo, P., Lee, W.-C., and Wang, M. (2013). Silence is also evidence: interpreting dwell time for recommendation from psychological perspective. Proc. KDD, 989-997.
45. Zhou, Y., and Croft, W.B. (2006). Ranking robustness: a novel framework to predict query performance. Proc. CIKM, 567-574.
46. Zhou, Y. and Croft, W.B. (2007). Query performance prediction in web search environments. Proc. SIGIR, 543-550.