Understanding PubMed® user search behavior through log analysis

Database

Volumn 2009, Issue , 2009, Pages

  Islamaj Dogan, Rezarta ^a   Murray, G Craig ^a   Névéol, Aurélie ^a   Lu, Zhiyong ^a  

^a NATIONAL INSTITUTES OF HEALTH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84908087913     PISSN: 17580463     EISSN: None     Source Type: Journal    
DOI: 10.1093/database/bap018     Document Type: Article

References (80)

1. Hunter, L. and Cohen, K.B. (2006) Biomedical language processing: what's beyond PubMed? Mol. Cell, 21, 589-594.
2. Tenopir, C. (2008) Online databases: are e-journals good for science? Library J., 133, 24.
3. Taylor, R. (1968) Question negotiation and information seeking in libraries. College Res. Libraries, 29, 178-194.
4. Murray, G.C. and Teevan, J. (2007) Query log analysis: social and technological challenges (WWW 2007 Workshop Report). ACM SIGIR Forum, 41, 112-120.
5. Spink, A. and Jansen, B.J. (eds). (2004) Web Search: Public Searching of the Web. Kluwer, Dordrecht.
6. Craswell, N., Jones, R., Dupret, G. and Viegas, E. (eds). (2009) Proceedings of the 2009 Workshop on Web Search Click Data. ACM, Barcelona, Spain, p. 95.
7. Facca, F.M. and Lanzi, P.L. (2005) Mining interesting knowledge from weblogs: a survey. Data Knowledge Eng., 53, 225-241.
8. Makri, S., Blandford, A. and Cox, A.L. (2008) Investigating the information-seeking behaviour of academic lawyers: from Ellis's model to design. Information Processing & Management, 44, 613-634.
9. Komlodi, A., Soergel, D. and Marchionini, G. (2006) Search histories for user support in user interfaces. J. Amer. Soc. Inform. Sci. Technol., 57, 803-807.
10. Herskovic, J.R., Tanaka, L.Y., Hersh, W. and Bernstam, E.V. (2007) A day in the life of PubMed: analysis of a typical day's query log. J. Amer. Med. Inform. Assoc., 14, 212-220.
11. Bollen, J. and van de Sompel, H. (2008) Usage impact factor: the effects of sample characteristics on usage-based impact metrics. J. Amer. Soc. Inform. Sci. Technol., 59, 136-149.
12. Jones, S., Cunningham, S.J., McNab, R. and Boddie, S. (2000) A transaction log analysis of a digital library. Int. J. Digital Libraries, 3, 152-169.
13. Blandford, A., Adams, A., Attfield, S. et al. (2008) The PRET a rapporter framework: evaluating digital libraries from the perspective of information work. Inform. Process. Manage., 44, 4-21.
14. Blandford, A., Keith, S., Connell, I. and Edwards, H. (2004) Analytical usability evaluation for Digital Libraries: a case study. ACM/IEEE Joint Conf. Digital Libraries. ACM Press, New York, pp. 27-36.
15. Bolchini, D., Finkelstein, A., Perrone, V. and Nagl, S. (2008) Better bioinformatics through usability analysis. Bioinformatics, 25, 406-412.
16. Mat-Hassan, M. and Levene, M. (2005) Associating search and navigation behavior through log analysis. J. Amer. Soc. Inform. Sci. Technol., 56, 913-934.
17. Madle, G., Kostkova, P., Mani-Saada, J. and Roy, A. (2006) Lessons learned from evaluation of the use of the National electronic Library of Infection. Health Informatics J., 12, 137-151.
18. Madle, G., Kostkova, P., Mani-Saada, J., Weinberg, J. and Williams, P. (2004) Changing the public attitudes to antibiotic prescribing: can the Internet help? Informatics in Primary Care, 12, 19-26.
19. Borgman, C.L. (1986) The user's mental model of an information retrieval system: an experiment on a prototype online catalog. Int. J. Man-Machine Stud., 24, 47-64.
20. Borgman, C.L. (2006) What can studies of e-learning teach us about collaboration in e-research? Some findings from digital library studies. Comp. Support. Cooperative Work (CSCW), 15, 359-383.
21. Chidlovskii, B., Glance, N.S. and Grasso, M.A. (2000) Collaborative re-ranking of search results. In: The National Conference on Artificial Intelligence 2000 Workshop on AI for Web Search, AAAI Press, Menlo Park, CA, pp. 18-23.
22. Stelmaszewska, H. and Blandford, A. (2002) Patterns of interactions: user behaviour in response to search results. In: JCDL'09 Workshop on Usability, ACM Press, New York.
23. Stelmaszewska, H., Blandford, A. and Buchanan, G. (2005) Designing to change users' information seeking behaviour: a case study. In: Adaptable and Adaptive Hypermedia Systems, IRM Press, Hershey, PA, pp. 1-18.
24. Roy, A., Kostkova, P., Catchpole, M. and Carson, E. (2006) Web-based provision of information on infectious diseases: a systems study. Health Informatics J., 12, 274-292.
25. Lorigo, L., Haridasan, M., Brynjarsdottir, H. et al. (2008) Eye tracking and online search: Lessons learned and challenges ahead. J. Amer. Soc. Inform. Sci. Technol., 59, 1041-1052.
26. Joachims, T., Granka, L., Pan, B., Hembrooke, H., Radlinski, F. and Gay, G. (2007) Evaluating the accuracy of implicit feedback from clicks and query reformulations in Web search. ACM Trans. Information Syst., 25.
27. Rodden, K., Fu, X., Aula, A. and Spiro, I. (2008) Eye-mouse coordination patterns on web search results pages. In: Proceedings of the CHI '08 Extended Abstracts on Human Factors in Computing Systems. ACM Press, New York, pp. 2997-3002.
28. Cutrell, E. and Guan, Z. (2007) What are you looking for?: an eyetracking study of information usage in web search. In: Proceedings of the SIGCHI conference on Human Factors in Computing Systems, ACM, San Jose, California, New York, USA.
29. Radlinski, F., Kurup, M. and Joachims, T. (2008) How does clickthrough data reflect retrieval quality? In: Proceedings of the 17th ACM Conference on Information and Knowledge Management, ACM Press, New York, pp. 43-52.
30. Ruthven, I., Lalmas, M. and van Rijsbergen, C.J. (2003) Incorporating user search behavior into relevance feedback. J. Amer. Soc. Inform. Sci. Technol., 54, 529-549.
31. White, R.W. and Drucker, S.M. (2007) Investigating behavioral variability in web search. In: Proceedings of the 16th International World Wide Web Conference (WWW 2007), Banff, Canada. ACM Press, New York.
32. Bilenko, M., White, R.W., Richardson, M. and Murray, G.C. (2008) Talking the talk vs. walking the walk: salience of information needs in querying vs. browsing. In: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval. ACM Press, New York, pp. 705-706.
33. Rose, D.E. (2006) Reconciling information-seeking behavior with search user interfaces for the Web. J. Amer. Soc. Inform. Sci. Technol., 57, 797-799.
34. Grimes, C., Tang, D. and Russell, D.M. (2007) Query logs alone are not enough. In: Proceedings of the 16th International Conference on the World Wide Web, Workshop on Query Logs Analysis: Social and Technological Challenges. ACM Press, New York, paper 51, p. 7.
35. Lin, J. and Wilbur, W. (2009) Modeling actions of PubMed users with n-gram language models. Information Retrieval, 12, 487-503.
36. Jansen, B.J., Spink, A. and Saracevic, T. (2000) Real life, real users, and real needs: a study and analysis of user queries on the Web. Information Process. Manage., 36, 207-227.
37. Spink, A., Jansen, B.J. and Ozmutlu, H.C. (2000) Use of query reformulation and relevance feedback by Excite users. Internet Res., 10, 317-328.
38. Jansen, B.J., Spink, A., Blakely, C. and Koshman, S. (2007) Defining a session on Web search engines. J. Amer. Soc. Inform. Sci. Technol., 58, 862-871.
39. Murray, G.C., Lin, J. and Chowdhury, A. (2006) Identification of user sessions with hierarchical agglomerative clustering. In: Proceedings of ASIS&T 2006 Annual Meeting, Information Today, Inc., Medford, NJ, pp. 312.
40. Jones, R. and Klinkner, K.L. (2008) Beyond the session timeout: automatic hierarchical segmentation of search topics in query logs. In: Proceedings of the 17th ACM Conference on Information and Knowledge Management. ACM Press, New York, pp. 699-708.
41. Göker, A. and He, D.Q. (2000) Analysing Web search logs to determine session boundaries for user-oriented learning. In: Adaptive Hypermedia and Adaptive Web-Based Systems, International Conference Proceedings. Springer-Verlag, Berlin/Heidelberg, pp. 319-322.
42. He, D.Q., Göker, A. and Harper, D.J. (2002) Combining evidence for automatic Web session identification. Information Process. Management, 38, 727-742.
43. Arlitt, M. (2000) Characterizing Web user sessions. ACM SIGMETRICS Performance Eval. Rev., 28, 50-63.
44. Chen, H.-M. and Cooper, M.D. (2002) Stochastic modeling of usage patterns in a web-based information system. J. Amer. Soc. Informat. Sci. Technol., 57, 536-548.
45. Miller, C.S. (2005) Modeling Web navigation: methods and challenges. In: Mobasher, B. and Anand, S.S. (eds), Intelligent Techniques for Web Personalization, Springer-Verlag, Berlin/ Heidelberg, pp. 37-52.
46. Downey, D., Dumais, S. and Horvitz, E. (2007) Models of searching and browsing: languages, studies, and applications. In: Proceedings of the Twentieth International Joint Conference on Artificial Intelligence. AAAI Press, Menlo Park, CA, pp. 2740-2747.
47. Silverstein, C., Marais, H., Henzinger, M. and Moricz, M. (1999) Analysis of a very large web search engine query log. ACM SIGIR Forum, 33, 6-12.
48. Bates, M.J. (2002) The cascade of interactions in the digital library interface. Informat. Process. Management, 38(3), 381-400.
49. Bates, M.J. (1989) The design of browsing and berrypicking techniques for the online search interface. Online Rev., 13(5), 407-424.
50. Pirolli, P.L. (ed). (2007) Information Foraging: A Theory of Adaptive Interaction with Information. Oxford University Press, New York.
51. Pirolli, P.L. and Card, S.K. (1999) Information foraging. Psycholog. Rev., 106(4), 643-675.
52. Stephens, D.W. and Krebs, J.R. (1987) Foraging theory. Monographs in Behavior and Ecology. Princeton University Press, Princeton, NJ.
53. White, R.W., Dumais, S. and Teevan, J. (2008) How medical expertise influences web search interaction. In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, pp. 791-792.
54. Fu, W.-T. and Pirolli, P. SNIF-ACT: a cognitive model of user navigation on the World Wide Web. Human-Comp. Interact., 22, 355-412.
55. Chi, E.H., Rosien, A., Supattanasiri, G. et al. (2003) The Bloodhound project: automating discovery of web usability issues using the InfoScent simulator. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press, New York, pp. 505-512.
56. Bates, M.J. (1990) Where should the person stop and the information search interface start? Inform. Process. Management, 26(5), 575-591.
57. Bates, M.J. (1998) Indexing and access for digital libraries and the internet: Human, database, and domain factors. J. Amer. Soc. Inform. Sci., 49(13), 1185-1205.
58. Downey, D., Dumais, S., Liebling, D. and Horvitz, E. (2008) Understanding the relationship between searchers' queries and information goals. In: Proceedings of the 17th ACM Conference on Information and Knowledge Management. ACM Press, New York, pp. 449-458.
59. Otsuka, S., Toyoda, M., Hirai, J. and Kitsuregawa, M. (2004) Extracting ser behavior by Web communities technology on global Web logs. In: Database and Expert Systems Applications, Proceedings, Springer-Verlag, Berlin/Heidelberg, pp. 957-968.
60. Pass, G., Chowdhury, A. and Torgeson, C. (2006) A picture of search. In: Proceedings of the 1st International Conference on Scalable Information Systems. ACM Press, New York, Article No. 1, p. 7.
61. Lam, H., Russell, D.M., Tang, D. and Munzner, T. (2007) Session Viewer: a visualization tool to support visual exploratory analysis of web session logs. In: Proceedings of the IEEE Symposium on Visual Analytics Science and Technology (VAST). IEEE Computer Society, Piscataway, NJ, pp. 147-154.
62. Beitzel, S.M., Jensen, E.C., Lewis, D.D., Chowdhury, A. and Frieder, O. (2007) Automatic classification of Web queries using very large unlabeled query logs. ACM Trans. Inform. Syst., 25(2).
63. Jansen, B.J., Booth, D.L. and Spink, A. (2008) Determining the informational, navigational, and transactional intent of Web queries. Inform. Process. Management, 44, 1251-1266.
64. Jansen, B.J., Spink, A. and Narayan, B. (2007) Query modifications patterns during Web searching. In: International Conference on Information Technology (ITNG'07). IEEE Computer Society, Piscataway, NJ, pp. 439-444.
65. Bilenko, M. and White, R.W. (2008) Talking the talk vs. walking the walk: salience of information needs in querying vs. browsing. In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, pp. 51-60.
66. Broder, A.Z. (2002) A taxonomy of web search. ACM SIGIR Forum, 36(2), 3-10.
67. Rose, D.E. and Levinson, D. (2004) Understanding user goals in web search. In: Proceedings of the 13th International Conference on World Wide Web. ACM Press, New York, pp. 13-19.
68. Rieh, S.Y. and Xie, H. (2001) Patterns and sequences of multiple query reformulations in Web searching: a preliminary study. In: Proceedings of the Annual Meeting of the American Society for Information Science and Technology. Information Today, Inc., Medford, NJ, vol. 38, pp. 246-255.
69. Jansen, B.J., Booth, D.L. and Spink, A. (2008) Determining the informational, navigational, and transactional intent of Web queries. Inform. Process. Management, 44(3), 1251-1266.
70. Lu, Z., Kim, W. and Wilbur, W. (2009) Evaluation of query expansion using MeSH in PubMed. Inform. Retrieval, 12(1), 69-80.
71. Lu, Z., Kim, W. and Wilbur, W.J. (2009) Evaluating Relevance Ranking Strategies for MEDLINE Retrieval. J. Amer. Med. Informatics Assoc., 16(1), 32-36.
72. McCray, A.T., Burgun, A. and Bodenreider, O. (2001) Aggregating UMLS semantic types for reducing conceptual complexity. Medinfo, 10, 216-220.
73. Ogren, P.V. (2006) Knowtator: a protégé plug-in for annotated corpus construction. In: Proceedings of the 2006 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, Vol. Demonstrations. Association for Computational Linguistics, Morristown, NJ, USA, pp. 273-275.
74. Aronson, A.R. (2001) Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. In: Proceedings of AMIA Symposium. Hanley & Belfus, Philadelphia, PA, pp. 17-21.
75. Névéol, A., Islamaj-Dogan, R. and Lu, Z. (2009) Quality, efficiency, satisfaction: a study of semi-automatic semantic annotation of PubMed Queries. NCBI Technical Report. U. S. National Library of Medicine, Bethesda, MD.
76. Manning, C. and Schütze, H. (1999) Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, MA.
77. Joachims, T., Granka, L., Pan, B., Hembrooke, H. and Gay, G. (2005) Accurately interpreting clickthrough data as implicit feedback. In: Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, pp. 1-15.
78. Murray, G.C., Lin, J., Wilbur, J. and Lu, Z. (2009) Users' adjustments to unsuccessful queries in biomedical search. In: Proceedings of the 9th ACM/IEEE-CS Joint Conference on Digital Libraries. ACM, Austin, TX, New York, USA, p. 433.
79. Lu, Z., Wilbur, W.J., McEntyre, J.R., Iskhakov, A. and Szilagyi, L. (2009) Finding query suggestions for PubMed. Proceedings of the AMIA Annual Symposium. in press.
80. Lu, Z. and Wilbur, W.J. (2009) Improving accuracy for identifying related PubMed queries by an integrated approach. J. Biomed. Inform., 12(1), 69-80.