EScience in practice: Lessons from the Cornell Web Lab

D-Lib Magazine

Volumn 15, Issue 5-6, 2009, Pages

  Arms, William Y ^a   Calimlim, Manuel ^b   Walle, Lucia ^b  

^a School of Operations Research and Information Engineering   (United States)

^b NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 67650280413     PISSN: None     EISSN: 10829873     Source Type: Journal    
DOI: 10.1045/may2009-arms     Document Type: Article

References (27)

1. William Arms and Ronald Larsen (editors). The Future of Scholarly Communication: Building the Infrastructure for Cyberscholarship. NSF/ JISC workshop, Phoenix, Arizona, April 2007..
2. Amy Friedlander (editor). Promoting Digital Scholarship: Formulating Research Challenges in the Humanities, Social Sciences and Computation. Council on Library and Information Resources, 2008. .
3. See, for example, the University of Washington eScience Institute. .
4. See, for example, the M.Sc. in eScience at the University of Copenhagen. .
5. Digging into Data Challenge. .
6. Venter, Craig. Bigger faster better. Seed, November 20 2008. .
7. William Arms, Selcuk Aya, Pavel Dmitriev, Blazej Kot, Ruth Mitchell, and Lucia Walle. A research library based on the historical collections of the Internet Archive. D-Lib Magazine, 12 (2), February 2006. .
8. William Arms, Selcuk Aya, Pavel Dmitriev, Blazej Kot, Ruth Mitchell, and Lucia Walle. Building a research library for the history of the Web. ACM/IEEE Joint Conference on Digital Libraries, 2006. .
9. National Science Foundation. Sustainable Digital Data Preservation and Access Network Partners (DataNet). 2008. .
10. D. Crandall, L. Backstrom, D. Huttenlocher, and J. Kleinberg. Mapping the World's Photos. WWW 2009 (forthcoming). .
11. Paul Berkman. Sustaining the National Science Digital Library. Project Kaleidoscope, 2004. .
12. The Internet Archive's home page and the Wayback Machine are at: .
13. Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung. The Google File System. 19th ACM Symposium on Operating Systems Principles, October 2003. .
14. Jeffrey Dean and Sanjay Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. Usenix SDI '04, 2004.
15. For information about Apache Hadoop see: .
16. The Lucene family of search engines is part of the Apache Jakarta project: .
17. Heritrix is the Internet Archive's open source web crawler: .
18. Wioletta Holownia, Michal Kuklis, and Natasha Qureshi. Web Lab Collaboration Server and Web Lab Website. May 2008. .
19. Felix Weigel, Biswanath Panda, Mirek Riedwald, Johannes Gehrke, and Manuel Calimlim. Large-Scale Collaborative Analysis and Extraction of Web Data. Proc. 34th Int. VLDB Conf., 2008. pp. 1476-1479.
20. The Web Lab technical reports are at .
21. Andrzej Kielbasinski. Data Movement and Tracking, Spring 2007 Report. May 2007. .
22. W. Arms, S. Aya, M. Calimlim, J. Cordes, J. Deneva, P. Dmitriev, J. Gehrke, L. Gibbons, C. D. Jones, V. Kuznetsov, D. Lifka, M. Riedewald, D. Riley, A. Ryd, and G. J. Sharp. Three Case Studies of Large-Scale Data Flows. Proc. IEEE Workshop on Workflow and Data Flow for Scientific Applications (SciFlow). 2006.
23. Vijayanand Chokkapu and Asif-ul Haque. PageRank Calculation using Map Reduce. May 2008. .
24. J. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of the ACM, Vol. 46, No. 5, September 1999, pp. 604-632.
25. Xingfu Dong. Hubs and Authorities Calculation using MapReduce. December 2008. .
26. Jacob Bank and Benjamin Cole, Calculating the Jaccard Similarity Coefficient with Map Reduce for Entity Pairs in Wikipedia. December 2008. .
27. National Science Foundation. CISE - Cluster Exploratory (CluE). 2008. .