Evaluating visual and statistical exploration of scientific literature networks

Proceedings - 2011 IEEE Symposium on Visual Languages and Human Centric Computing, VL/HCC 2011

Volumn , Issue , 2011, Pages 217-224

  Gove, Robert ^a,b   Dunne, Cody ^a,b   Shneiderman, Ben ^a,b   Klavans, Judith ^a   Dorr, Bonnie ^a,b  

^a UNIVERSITY OF MARYLAND   (United States)

^b NONE   (United States)

Author keywords

Empirical evaluation; graphical user interfaces; information visualization; literature exploration

Indexed keywords

ACADEMIC LITERATURE; AUTOMATIC CLUSTERING; CITATION NETWORKS; COORDINATED VIEWS; DOCUMENT SETS; DOMAIN EXPERTS; EMPIRICAL EVALUATIONS; FORMATIVE EVALUATION; INFORMATION VISUALIZATION; LITERATURE SEARCH; NETWORK STATISTICS; PRIMARY CONTRIBUTION; SCIENTIFIC LITERATURE; SYSTEM EVALUATION; TEST SYSTEMS; USER CONTROL;

GRAPHICAL USER INTERFACES; INFORMATION SYSTEMS; VISUALIZATION;

INFORMATION RETRIEVAL SYSTEMS;

EID: 82855176916     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/VLHCC.2011.6070403     Document Type: Conference Paper

References (43)

1. C. Dunne, B. Shneiderman, R. Gove, J. Klavans, and B. Dorr, "Rapid understanding of scientific paper collections: integrating statistics, text analysis, and visualization," University of Maryland, Human-Computer Interaction Lab Tech Report HCIL-2011, 2011.
2. C. Dunne, B. Shneiderman, B. Dorr, and J. Klavans, "iOpener Workbench: Tools for rapid understanding of scientific literature," in Human-Computer Interaction Lab 27th Annual Symposium, University of Maryland, College Park, MD, 2010. [Online]. Available: ftp://ftp.umiacs.umd.edu/pub/ bonnie/iOPENER-5-27-2010.pdf
3. M. A. Hearst, Search User Interfaces. Cambridge University Press, 2009. [Online]. Available: http://searchuserinterfaces.com/book/
4. P. Pirolli and S. Card, "The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis," in Proc. Int. Conf. Intelligence Anal., 2005.
5. M. J. Bates, "Where should the person stop and the information search interface start?" Inf. Process. Manage., vol. 26, pp. 575-591, 1990.
6. K. D. Bollacker, S. Lawrence, and C. L. Giles, "CiteSeer: an autonomous Web agent for automatic retrieval and identification of interesting publications,"in Proc. int. conf. Autonomous Agents, 1998, pp. 116-123.
7. C. L. Giles, K. D. Bollacker, and S. Lawrence, "CiteSeer: an automatic citation indexing system," in Proc. ACM conf. Digital Libraries, 1998, pp. 89-98.
8. Google, "Google Scholar," http://scholar.google.com/, Mar, 2011.
9. Microsoft, "Microsoft Academic Search," http://academic. research.microsoft.com/, June 2011.
10. J. Tang, J. Zhang, L. Yao, J. Li, L. Zhang, and Z. Su, "ArnetMiner: extraction and mining of academic social networks," in Knowledge Discovery and Data Mining, 2008, pp. 990-998.
11. Transinsight, "GoPubMed," http://www.gopubmed.org/, Mar, 2011.
12. Thomson Reuters, "ISI web of knowledge," http://www. isiwebofknowledge.com/, Mar, 2011.
13. A. Malizia, "A cognition-based approach for querying personal digital libraries," in Visual Languages and Human Centric Computing, 2004, pp. 283-284.
14. JabRef Development Team, JabRef, 2011. [Online]. Available: http://jabref.sourceforge.net
15. Center for History and New Media, "Zotero," http://www.zotero.org/, Mar, 2011.
16. Mendeley Ltd, "Mendeley," http://www.mendeley.com/, Mar, 2011.
17. R. Torres, S. M. McNee, M. Abel, J. A. Konstan, and J. Riedl, "Enhancing digital libraries with TechLens+," in Proc. Joint Conf. Digital libraries, 2004, pp. 228-236.
18. S. M. McNee, I. Albert, D. Cosley, P. Gopalkrishnan, S. K. Lam, A. M. Rashid, J. A. Konstan, and J. Riedl, "On the recommending of citations for research papers," in Proc. conf. Comp. supported cooperative work, 2002, pp. 116-125.
19. Q. He, J. Pei, D. Kifer, P. Mitra, and L. Giles, "Context-aware citation recommendation," in Proc. int. conf. World wide web, 2010, pp. 421-430.
20. K. W. Boyack and K. Börner, "Indicator-assisted evaluation and funding of research: Visualizing the influence of grants on the number and citation counts of research papers," JASIST, vol. 54, pp. 447-461, 2003.
21. G. S. Davidson, B. Hendrickson, D. K. Johnson, C. E. Meyers, and B. N. Wylie, "Knowledge mining with vxinsight: Discovery through interaction," J. Intelligent Info Sys, vol. 11, pp. 259-285, 1998.
22. C. Perez-Iratxeta, A. J. Perez, P. Bork, and M. A. Andrade, "Update on XplorMed: a web server for exploring scientific literature," Nucleic Acids Research, vol. 31, pp. 3866-3868, 2003. (Pubitemid 37442266)
23. D. Radev, J. Otterbacher, A. Winkel, and S. Blair-Goldensohn, "Newsinessence: summarizing online news topics," Commun. ACM, vol. 48, pp. 95-98, Oct 2005. (Pubitemid 43906475)
24. S. Park, S. Lee, and J. Song, "Aspect-level news browsing: understanding news events from multiple viewpoints," in Proc. int. conf. Intelligent user interfaces, 2010, pp. 41-50.
25. A. Aris, B. Shneiderman, V. Qazvinian, and D. Radev, "Visual overviews for discovering key papers and influences across research fronts," JASIST, vol. 60, pp. 2219-2228, Nov 2009.
26. E. Bertini, A. Perer, C. Plaisant, and G. Santucci, "BELIV '08: Beyond time and errors: novel evaluation methods for information visualization,"in CHI '08 extended abstracts on Human factors in computing systems, 2008, pp. 3913-3916.
27. C. Chen and M. P. Czerwinski, "Empirical evaluation of information visualizations: an introduction," Int. J. Hum.-Comput. Stud., vol. 53, no. 5, pp. 631-635, 2000. (Pubitemid 32032814)
28. B. Shneiderman and C. Plaisant, "Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies,"in Proc. 2006 AVI workshop on BEyond time and errors, 2006, pp. 1-7.
29. P. Saraiya, C. North, and K. Duca, "Comparing benchmark task and insight evaluation methods on timeseries graph visualizations," in Proc. 2010 AVI workshop on BEyond time and errors, 2010.
30. J. S. Yi, Y.-a. Kang, J. T. Stasko, and J. A. Jacko, "Understanding and characterizing insights: how do people gain insights using information visualization?" in Proc. Conf. BEyond time and errors, 2008, pp. 1-6.
31. L. Shupp, C. Andrews, M. Dickey-Kurdziolek, B. Yost, and C. North, "Shaping the display of the future: The effects of display size and curvature on user performance and insights," Human-Computer Interaction, vol. 24, pp. 230-272, 2009.
32. P. Saraiya, C. North, V. Lam, and K. Duca, "An insight-based longitudinal study of visual analytics," IEEE Trans. Vis. Comput. Graphics, vol. 12, pp. 1511-1522, 2006. (Pubitemid 44523094)
33. J. Seo and B. Shneiderman, "Knowledge discovery in high-dimensional data: case studies and a user survey for the rank-by-feature framework,"IEEE Trans. Vis. Comput. Graphics, vol. 12, pp. 311-322, 2006.
34. A. Perer and B. Shneiderman, "Integrating statistics and visualization: case studies of gaining clarity during exploratory data analysis," in Proc. SIGCHI conf. Human factors in computing syst., 2008, pp. 265-274.
35. S. Faisal, B. Craft, P. Cairns, and A. Blandford, "Internalization, qualitative methods, and evaluation," in Proc. Conf. BEyond time and errors, 2008, pp. 1-8.
36. M. Shimabukuro, E. Flores, M. de Oliveira, and H. Levkowitz, "Coordinated views to assist exploration of spatio-temporal data: a case study," in Proc. Int. Conf. Coordinated & Multiple Views in Exploratory Visualization, 2004, pp. 107-117.
37. C. Plaisant, "The challenge of information visualization evaluation," in Proc. working conf. Advanced visual interfaces, 2004, pp. 109-116.
38. O. Hoeber and X. D. Yang, "Exploring web search results using coordinated views," in Proc. Int. Conf. Coordinated & Multiple Views in Exploratory Visualization, 2006, pp. 3-13.
39. A. Perer and B. Shneiderman, "Balancing systematic and flexible exploration of social networks," IEEE Trans. Vis. Comput. Graphics, vol. 12, pp. 693-700, 2006. (Pubitemid 44955593)
40. M. E. J. Newman, "Fast algorithm for detecting community structure in networks," Phys Rev E, vol. 69, p. 066133, 2004.
41. D. Zajic, B. J. Dorr, J. Lin, and R. Schwartz, "Multi-candidate reduction: Sentence compression as a tool for document summarization tasks," Inf. Process. Manage., vol. 43, pp. 1549-1570, 2007. (Pubitemid 47268107)
42. D. R. Radev, P. Muthukrishnan, and V. Qazvinian, "The ACL anthology network corpus," in Proc. ACL Workshop on Natural Language Process. and Inform. Retrieval for Digital Libraries, Singapore, 2009.
43. C. C. Kuhlthau, "Inside the search process: Information seeking from the user's perspective," JASIS, vol. 42, pp. 361-371, 1991.