Effects of granularity of search results on the relevance judgment behavior of engineers: building systems for retrieval and understanding of context

Journal of the American Society for Information Science and Technology

Volumn 61, Issue 3, 2010, Pages 453-467

  Balatsoukas, Panos ^a   Demian, Peter ^a  

^a LOUGHBOROUGH UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BUILDING SYSTEMS; HIERARCHICAL QUERIES; LITTLE RESEARCH; NOVEL CONCEPT; PROTOTYPE SYSTEM; RELEVANCE JUDGMENT; SEARCH RESULTS; USER STUDY;

INFORMATION RETRIEVAL; INFORMATION RETRIEVAL SYSTEMS; INFORMATION SERVICES; RESEARCH;

HIERARCHICAL SYSTEMS;

EID: 76649140100     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.21268     Document Type: Article

References (45)

1. Allen, T. (1977). Managing the flow of technology. Cambridge, MA: MIT Press.
2. Balatsoukas, P., Morris, A., & O'Brien, A. (2009). An evaluation framework of user interaction with metadata surrogates. Journal of Information Science, 35(3), 321-339.
3. Barry, C. (1994). User-defined relevance criteria: An exploratory study. Journal of the American Society for Information Science and Technology, 45(3), 149-159.
4. Betsi, S., Lalmas, M., Tombros, A., & Tsikrika, T. (2006). User expectations from XML Element retrieval. In E.N. Efthimiadis, S.T. Dumais, D. Hawking, & K. Järvelin (Eds.), Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 611-612). New York: ACM Press.
5. Borlund, P. (2003). The IIR model: A framework for evaluation of interactive information retrieval systems. Information Research, 8(3). Retrieved June 23, 2009, from http://informationr.net/ir/8-3/paper 152.html
6. Carmel, D., Maarek, Y., Mandelbrod, M., Mass, Y., & Soffer, A. (2003). Searching XML documents via XML fragments. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 151-158). New York: ACM Press.
7. Chakrabarti, A., Feineman, S., & Fuentevilla, W. (1983). Characteristics of sources, channels and contents for scientific and technical information systems in industrial R an D. IEEE Transactions on Engineering Management, EM-30(2), 83-88. (Pubitemid 13557745)
8. Crystal, A., & Greenberg, J. (2006). Relevance criteria identified by health information users during Web searches. Journal of the American Society for Information Science and Technology, 57(10), 1368-1382. (Pubitemid 44187275)
9. Demian, P., & Fruchter, R. (2006a). An ethnographic study of design knowledge reuse in the architecture, engineering and construction industry. Research in Engineering Design, 16, 184-195.
10. Demian, P., & Fruchter, R. (2006b). Finding and understanding reusable designs from large hierarchical repositories. Information Visualisation, 5, 28-46. (Pubitemid 43835566)
11. Demian, P., & Fruchter, R. (2006c). Methodology for usability evaluation of corporate memory design reuse systems. Journal of Computing in Civil Engineering, November/December, 377-389.
12. Drori, O. (2000). Improving display of search results in information retrieval systems-Users' study. Tech. Rep. No.200034. Retrieved July 23, 2006, from www.global-report.com/drori/?l=he&a=3234
13. Duchowski, A. (2007). Eye tracking methodology. London: Springer. Eastman, C., Teicholz, P., Sacks, R., & Liston, K. (2008). BIM Handbook: A guide to building information modeling for owners, managers, designers, engineers and contractors. Hoboken, NJ: Wiley.
14. Ellis, D., & Haugan, M. (1997). Modelling the information seeking patterns of engineers and research scientists in an industrial environment. Journal of Documentation, 53(4), 384-403.
15. Fidel, R., & Green, M. (2004). The many faces of accessibility: Engineers' perception of information sources. Information Processing & Management, 40, 563-581.
16. Gerstberger, P., & Allen, T. (1968). Criteria used by development engineers in the selection of an information source. Journal of Applied Psychology, 52(4), 272-279.
17. Hammer-Aebi, B., Christensen, K., Lund, H., & Larsen, B. (2006). Users, structured documents and overlap: Interactive searching of elements and the influence of context on search behaviour. In I. Ruthven, P. Borlund, P. Ingwersen, N. Belkin, A. Tombro, & P. Vakkari (Eds.), Proceedings of the First Symposium on Information Interaction in Context (IIiX 2006) (pp. 80-94). Copenhagen, Denmark: Royal School of Library and Information Science.
18. Hearst, M. (2006). Clustering versus faceted categories for information exploration. Communications of the ACM, 49(4), 59-61.
19. Hertzum, M., & Pejtersen, A. (2000). The information seeking practices of engineers: Searching for documents as well as for people. Information Processing & Management, 36, 761-778. (Pubitemid 30861300)
20. INEX. (2009). Initiative for the evaluation of XML retrieval. Retrieved June 21, 2009, from http://inex.is.informatik.uni-duisburg.de/
21. Joho, H., & Jose, J. (2006). Comparative study of the effectiveness of search result presentation on the Web. In M. Lalmas, A. MacFarlane, S. Rüger, A. Tombros, T. Tsikrika, & A. Yavlinsky (Eds.), Advances in Information Retrieval: Proceedings of the 28th European Conference on IR Research (pp. 302-313). Berlin, Germany: Springer.
22. Joho, H., & Jose, J. (2008). Effectiveness of additional representations for the search result presentation on the Web. Information Processing & Management, 44(1), 226-241. (Pubitemid 350007897)
23. Kraaijenbrick, J. (2007). Engineers and the Web: An analysis of real life gaps in information usage. Information Processing & Management, 43, 1368-1382. (Pubitemid 46636018)
24. Kwasitsu, L. (2003). Information-seeking behaviour of design, process and manufacturing engineers. Library and Information Science Research, 25, 459-476. (Pubitemid 37378861)
25. Larsen, B., Tombros, A., & Malik, S. (2006). Is XML retrieval meaningful to users? Searcher preferences for full documents vs. elements. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 663-664). New York: ACM Press.
26. Leckie, G., Pettigrew, K., & Sylvain, C. (1996). Modeling the information seeking of professionals: A general model derived from research on engineers, health care professionals and lawyers. Library Quarterly, 66, 161-193.
27. Lehtonen, M. (2006). Designing user studies for XML retrieval. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 28-34). New York: ACM Press.
28. Malik, S., Tombros, A., & Larsen, B. (2006). The interactive track at INEX. ACM SIGIR Forum, 41(1), 67-74.
29. Manning, C., Raghavan, P., & Schutze, H. (2008). Introduction to information retrieval. New York: Cambridge University Press.
30. Nielsen, J. (1999). User interface directions for the Web. Communications of the ACM, 42(1), 65-72.
31. Pehcevski, J. (2006). Relevance in XML retrieval: The user perspective. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 35-42). New York: ACM Press.
32. Pharo, N. (2008). The effect of granularity and order in XML element retrieval. Information Processing & Management, 44, 1732-1740.
33. Pinelli, T., Bishop, A., Barclay, R., & Kennedy, J. (1993). The information seeking behavior of engineers. InA. Kent & C. Hall (Eds.), Encyclopadeia of library and information science (Vol. 52, pp. 167-201). New York: Marcel Dekker.
34. Pirolli, P. (2007). Information foraging theory: Adaptive interaction with information. Oxford, England: Oxford University Press.
35. Pirolli, P., Card, S., & Wege, M. (2003). The effects of information scent on visual search in the Hyperbolic Tree browser. ACM Transactions on Computer-Human Interaction, 10(1), 20-53.
36. Ramirez, G., & de Vries, A. (2006). Relevant contextual features in XML retrieval. In Proceedings of the First International Conference on Information Interaction in Context (pp. 56-65). New York: ACM Press.
37. Rele, R., & Duchowski, A. (2005). Using eye tracking to evaluate alternative search results interfaces. In Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomics Society. Orlando, FL: HFES.
38. Reusable Learning. (2004). Glossary. Retrieved June 2, 2006, from http://www.reusablelearning.org/
39. Rubin, J., & Chisnell, D. (2008). Handbook of usability testing. New York: Wiley.
40. Salton, G., Yang, C., & Yu, C. (1975). A theory of term importance in automatic text analysis. Journal of the American Society for Information Science, 26(1), 33-44.
41. Sebrechts, M., Vasilakis, J., Miller, M., Cugini, J., & Laskowski, S. (1999). Visualisation of search results: A comparative evaluation of text, 2D and 3D Interfaces. In Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 3-10). New York: ACM Press.
42. Shimitzu, T., Terada, N., & Yoshikawa, M. (2007). Development of an XML information retrieval system for queries on contents and structures. In Proceedings of the Second International Conference on Informatics Research for Development of Knowledge Society Infrastructure (pp. 161-168). Los Alamitos, CA: IEEE Computer Society.
43. Tversky, A., & Kahneman, D. (1982). Judgment under uncertainty: Heuristics and biases. In D. Kahneman. P. Slovic, & A. Tversky (Eds.), Judgment under uncertainty: Heuristics and biases (pp. 3-20). Cambridge, United Kingdom: Cambridge University Press.
44. Vegas, J., Crestani, F., & de la Fuente, P. (2007). Context representation for Web search results. Journal of Information Science, 33(1), 77-94.
45. Ye, Y., & Fischer, G. (2002). Supporting reuse by delivering task-relevant and personalised information. In Proceedings of the 24th International Conference on Software Engineering (pp. 513-523).