Rapid understanding of scientific paper collections: Integrating statistics, text analytics, and visualization

Journal of the American Society for Information Science and Technology

Volumn 63, Issue 12, 2012, Pages 2351-2369

  Dunne, Cody ^a   Shneiderman, Ben ^a   Gove, Robert ^a,c   Klavans, Judith ^b   Dorr, Bonnie ^b  

^a University of Maryland ^*  (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c BOOZ ALLEN HAMILTON   (United States)

Author keywords

graphs; natural language processing; visualization (electronic)

Indexed keywords

COORDINATED WINDOWS; CURRENT THEORIES; GRAPHS; KNOWLEDGEABLE USERS; MULTIPLE DOCUMENTS; NATURAL LANGUAGE PROCESSING; NATURAL LANGUAGES; NETWORK VISUALIZATION; PROGRAM MANAGER; PROTOTYPE SYSTEM; RAPID UNDERSTANDING; REFERENCE MANAGEMENT; RESEARCH FIELDS; SCIENTIFIC PAPERS; TESTING METHOD; TEXT EXTRACTION; USABILITY STUDIES; USABILITY TESTS; VENTURE CAPITAL;

INVESTMENTS; ITERATIVE METHODS; NATURAL LANGUAGE PROCESSING SYSTEMS; PAPER;

VISUALIZATION;

INVESTMENT; LANGUAGES; PAPER; PROCESSING;

EID: 84870568315     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.22652     Document Type: Article

References (60)

1. Aris, A., Shneiderman, B., Qazvinian, V., &, Radev, D., (2009). Visual overviews for discovering key papers and influences across research fronts. Journal of the American Society for Information Science and Technology, 60 (11), 2219-2228. doi: 10.1002/asi.21160
2. Association for Computational Linguistics. (2011). ACL Anthology. Retrieved from http://aclweb.org/anthology-new
3. Association for Computing Machinery. (2011). ACM Digital Library. Retrieved from http://portal.acm.org
4. Bates, M. J., (1990). Where should the person stop and the information search interface start? Information Processing & Management, 26 (5), 575-591. doi: 10.1016/0306-4573(90)90103-9
5. Bertini, E., Perer, A., Plaisant, C., &, Santucci, G., (2008). BELIV'08: BEyond time and errors: novel evaLuation methods for Information Visualization. In Proceedings of CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08) (pp. 3913-3916). New York, NY, USA: ACM. doi: 10.1145/1358628.1358955
6. Bollacker, K., Lawrence, S., &, Giles, C., (1998). CiteSeer: An autonomous Web agent for automatic retrieval and identification of interesting publications. In Proceedings of Second International Conference on Autonomous Agents (AGENTS '98) (pp. 116-123). New York, NY, USA: ACM. doi: 10.1145/280765.280786
7. Bradshaw, S., (2003). Reference directed indexing: Redeeming relevance for subject search in citation indexes. In, T. Koch, &, I. Solvberg, (Eds.), Proceedings of 7th European Conference on Research and Advanced Technology for Digital Libraries (ECDL '03) (Vol. 2769, pp. 499-510). Springer Berlin / Heidelberg. doi: 10.1007/978-3-540-45175-445
8. Center for History and New Media. (2011). Zotero [Software]. Retrieved from http://www.zotero.org
9. Chen, C., (2004). Searching for intellectual turning points: Progressive knowledge domain visualization. PNAS: Proc. National Academy of Sciences of the United States of America, 101 (90001), 5303-5310. doi: 10.1073/pnas.0307513100
10. Chen, C., (2006). CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature. Journal of the American Society for Information Science and Technology, 57 (3), 359-377. doi: 10.1002/asi.20317
11. Chen, C., &, Czerwinski, M. P., (2000, November). Empirical evaluation of information visualizations: An introduction. International Journal of Human-Computer Studies, 53 (5), 631-635. doi: 10.1006/ijhc.2000.0421
12. Chen, C., Ibekwe-SanJuan, F., &, Hou, J., (2010, July). The structure and dynamics of cocitation clusters: A multiple-perspective cocitation analysis. Journal of the American Society for Information Science and Technology, 61, 1386-1409. doi: 10.1002/asi.v61:7
13. Cornell University Library. (2011). ArXiv. Retrieved from http://arxiv.org
14. Dorr, B., Zajic, D., &, Schwartz, R., (2003). Hedge Trimmer: A parse-and-trim approach to headline generation. In Proceedings of HLT/NAACL 2003 Text Summarization Workshop and Document Understanding Conference (HLT/NAACL-DUC '03) (pp. 1-8). Stroudsburg, PA, USA: ACL. doi: 10.3115/1119467.1119468
15. Dunne, C., Riche, N., Lee, B., Metoyer, R., &, Robertson, G., (2012). GraphTrail: Analyzing large multivariate, heterogeneous networks while supporting exploration history. In Proceedings of 2012 International Conference on Human Factors in Computing Systems (CHI '12) (pp. 1663-1672). New York, NY, USA: ACM. doi: 10.1145/2207676.2208293
16. Elsevier. (2011). SciVerse Scopus. Retrieved from http://scopus.com/
17. Garfield, E., (1994). The concept of citation indexing: A unique and innovative tool for navigating the research literature. Current Contents. Retrieved from http://thomsonreuters.com/products-services/science/free/essays/ concept-of-citation-indexing/
18. Giles, C., Bollacker, K., &, Lawrence, S., (1998). CiteSeer: An automatic citation indexing system. In Proceedings of 3rd ACM Conference on Digital Libraries (DL '98) (pp. 89-98). New York, NY, USA: ACM. doi: 10.1145/276675.276685
19. Google. (2011). Google Scholar. Retrieved from http://scholar.google.com
20. Gove, R., (2011). Understanding scientific literature networks: Case study evaluations of integrating vizualizations and statistics (Unpublished master's thesis). University of Maryland, Department of Computer Science. Retrieved from http://hdl.handle.net/1903/11764
21. Gove, R., Dunne, C., Shneiderman, B., Klavans, J., &, Dorr, B., (2011). Evaluating visual and statistical exploration of scientific literature networks. In Proceedings of 2011 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC '11) (pp. 217-224). Los Alamitos, CA, USA. IEEE. doi: 10.1109/VLHCC.2011.6070403
22. Hearst, M. A., (2009). Search user interfaces (1st). Retrieved from http://searchuserinterfaces.com/book
23. Institute of Electrical and Electronics Engineers. (2011). IEEE Xplore. Retrieved from http://ieeexplore.ieee.org
24. JabRef Development Team. (2011). JabRef [Software]. Retrieved from http://jabref.sourceforge.net
25. Kuhlthau, C. C., (1991). Inside the search process: Information seeking from the user's perspective. Journal of the American Society for Information Science, 42 (5), 361-371. doi: 10.1002/(SICI)1097-4571(199106)42:5%3C361::AID- ASI6%3E3.0.CO;2-%23
26. Marchionini, G., (1997). Information seeking in electronic environments. Retrieved from http://www.ils.unc.edu/~march/isee-book/web-page.html
27. Marchionini, G., (2006). Exploratory search: From finding to understanding. CACM: Communications of the ACM, 49, 41-46. doi: 10.1145/1121949.1121979
28. Mei, Q., &, Zhai, C., (2008). Generating impact-based summaries for scientific literature. In Proceedings of 46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL/HLT '08) (pp. 816-824). Columbus, Ohio, USA: ACL. Retrieved from http://aclweb.org/anthology- new/P/P08/P08-1093
29. Mendeley Ltd. (2011). Mendeley [Software]. Retrieved from http://www.mendeley.com
30. Microsoft Research. (2011). Microsoft academic search. Retrieved from http://academic.research.microsoft.com
31. Mohammad, S., Dorr, B., Egan, M., Hassan, A., Muthukrishan, P., Qazvinian, V., Zajic, D., (2009). Using citations to generate surveys of scientific paradigms. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics (HLT/NAACL '09) (pp. 584-592). Stroudsburg, PA, USA: ACL. doi: 10.3115/1620754.1620839
32. Nanba, H., Abekawa, T., Okumura, M., &, Saito, S., (2004). Bilingual PRESRI: Integration of multiple research paper databases. In, C. Fluhr, G. Grefenstette, &, W. Croft, (Eds.), Proceedings of 7th International Conference on Computer-Assisted Information Retrieval (Recherche d'Information Assistee par Ordinateur) (RIAO '04) (pp. 195-211). Avignon, France: CID. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.102.9560
33. Nanba, H., &, Okumura, M., (1999). Towards multi-paper summarization using reference information. In Proceedings of 16th International Joint Conference on Artificial Intelligence (IJCAI '99) (pp. 926-931). San Francisco, CA, USA: Morgan Kaufmann Publishers Inc. Retrieved from http://dl.acm.org/ citation.cfm?id=1624312.1624351
34. National Center for Biotechnology Information. (2011). PubMed. Retrieved from http://ncbi.nlm.nih.gov/pubmed
35. National Visualization and Analytics Center. (2005). Illuminating the path: The research and development agenda for visual analytics. Retrieved from http://nvac.pnl.gov/agenda.stm
36. Newman, M. E. J., (2004). Fast algorithm for detecting community structure in networks. Physical Review E: Statistical, Nonlinear, and Soft Matter Physics, 69 (6), 066133. doi: 10.1103/PhysRevE.69.066133
37. North, C., &, Shneiderman, B., (1997). A taxonomy of multiple window coordinations. Human-Computer Interaction Lab Tech Report No. HCIL-97-18. Retrieved from http://www.cs.umd.edu/local-cgi-bin/hcil/rr.pl?number=97-18
38. NWB Team. (2006). Network Workbench [Software]. Retrieved from http://nwb.slis.indiana.edu
39. Oracle. (2011). NetBeans Platform [Software]. Retrieved from http://netbeans.org/features/platform
40. Perer, A., &, Shneiderman, B., (2006). Balancing systematic and flexible exploration of social networks. TVCG: IEEE Transactions on Visualization and Computer Graphics, 12 (5), 693-700. doi: 10.1109/TVCG.2006.122
41. Perer, A., &, Shneiderman, B., (2008). Integrating statistics and visualization: Case studies of gaining clarity during exploratory data analysis. In Proceedings of 26th Annual SIGCHI Conference on Human Factors in Computing Systems (CHI '08) (pp. 265-274). New York, NY, USA: ACM. doi: 10.1145/1357054.1357101
42. Plaisant, C., (2004). The challenge of information visualization evaluation. In Proceedings of 2004 Working Conference on Advanced Visual Interfaces (AVI '04) (pp. 109-116). New York, NY, USA: ACM. doi: 10.1145/989863.989880
43. Plaisant, C., &, Shneiderman, B., (2005). Show me! Guidelines for producing recorded demonstrations. In E. Martin & A. Schürr (Eds), Proceedings of 2005 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC '05) (pp. 171-178). Los Alamitos, CA, USA: IEEE Computer Society. doi: 10.1109/VLHCC.2005.57
44. Qazvinian, V., &, Radev, D., (2008). Scientific paper summarization using citation summary networks. In Proceedings of 22nd International Conference on Computational Linguistics (COLING '08) (pp. 689-696). Stroudsburg, PA, USA: ACL. doi: 10.3115/1599081.1599168
45. Radev, D., Otterbacher, J., Winkel, A., &, Blair-Goldensohn, S., (2005). NewsInEssence: Summarizing online news topics. Communications of the ACM, 48, 95-98. doi: 10.1145/1089107.1089111
46. Radev, D. R., Joseph, M. T., Gibson, B., &, Muthukrishnan, P., (2009a). A bibliometric and network analysis of the field of computational linguistics. Retrieved from http://clair.si.umich.edu/~radev/papers/biblio.pdf
47. Radev, D. R., Muthukrishnan, P., &, Qazvinian, V., (2009). The ACL Anthology Network corpus. In Proceedings of ACL-IJCNLP 2009 Workshop on Text and Citation Analysis for Scholarly Digital Libraries (NLPIR4DL '09) (pp. 54-61). Stroudsburg, PA, USA: ACL. doi: 10.3115/1699750.1699759
48. Saraiya, P., North, C., &, Duca, K. A., (2005). An insight-based methodology for evaluating bioinformatics visualizations. TVCG: IEEE Transactions on Visualization and Computer Graphics, 11 (4), 443-456. doi: 10.1109/TVCG.2005.53
49. Saraiya, P., North, C., Lam, V., &, Duca, K. A., (2006, November). An insight-based longitudinal study of visual analytics. IEEE Transactions on Visualization and Computer Graphics, 12 (6), 1511-1522. doi: 10.1109/TVCG.2006.85
50. Sekine, S., &, Nobata, C., (2003). A survey for multi-document summarization. In, D. Radev, &, S. Teufel, (Eds.), Proceedings of HLT/NAACL 2003 Text Summarization Workshop and Document Understanding Conference (HLT/NAACL-DUC '03) (pp. 65-72). Stroudsburg, PA, USA: ACL. doi: 10.3115/1119467.1119476
51. Seo, J., &, Shneiderman, B., (2006). Knowledge discovery in high-dimensional data: Case studies and a user survey for the rank-by-feature framework. IEEE Transactions on Visualization and Computer Graphics, 12 (3), 311-322. doi: 10.1109/TVCG.2006.50
52. Shneiderman, B., &, Plaisant, C., (2006). Strategies for evaluating information visualization tools: Multi-dimensional in-depth long-term case studies. In Proceedings of 2006 AVI workshop on BEyond time and errors: novel evaLuation methods for Information Visualization (BELIV '06) (pp. 1-7). New York, NY, USA: ACM. doi: 10.1145/1168149.1168158
53. Teufel, S., &, Moens, M., (2002). Summarizing scientific articles: Experiments with relevance and rhetorical status. Computational Linguistics, 28(4), 28, 409-445. doi: 10.1162/089120102762671936
54. Teufel, S., Siddharthan, A., &, Tidhar, D., (2006). Automatic classification of citation function. In Proceedings of 2006 Conference on Empirical Methods in Natural Language Processing (EMNLP '06) (pp. 103-110). Stroudsburg, PA, USA: ACL. doi: 10.3115/1610075.1610091
55. Thomson Reuters. (2011a). EndNote [Software]. Retrieved from http://www.endnote.com
56. Thomson Reuters. (2011b). ISI Web of Knowledge. Retrieved from http://isiwebofknowledge.com
57. Whidby, M., Zajic, D., &, Dorr, B. J., (2011). Citation handling for improved summarization of scientific documents. Language and Media Processing Laboratory Tech Report No. LAMP-TR-157. Retrieved from http://hdl.handle.net/ 1903/11822
58. Zajic, D., Dorr, B., &, Schwartz, R., (2004). BBN/UMD at DUC-2004: Topiary. In Proceedings of HLT/NAACL 2004 Workshop on Document Understanding (HLT/NAACL-DUC '04) (pp. 112-119). Boston, MA: ACL. Retrieved from http://www.umiacs.umd.%20edu/~bonnie/publications.html
59. Zajic, D., Dorr, B. J., Lin, J., &, Schwartz, R., (2007). Multi-candidate reduction: Sentence compression as a tool for document summarization tasks. Information Processing and Management, 43 (6), 1549-1570. doi: 10.1016/j.ipm.2007.01.016
60. Zajic, D. M., Dorr, B. J., Schwartz, R., Monz, C., &, Lin, J., (2005). A sentence-trimming approach to multi-document summarization. In Proceedings of HLT/EMNLP 2005 Workshop on Text Summarization (HLT/EMNLP '05) (pp. 151-158). Vancouver, Canada. Retrieved from http://www.casl.umd.edu/node/ 719