Reproducibility using vistrails

Implementing Reproducible Research

Volumn , Issue , 2014, Pages 33-56

  Freire, Juliana ^a   Koop, David ^a   Chirigati, Fernando ^a   Silva, Cláudio T ^a  

^a POLYTECHNIC UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85013774401     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1201/b16868     Document Type: Chapter

References (72)

1. The ALPS project. http://alps.comp-phys.org (Accessed March, 2013).
2. E.W. Anderson, J.P. Ahrens, K. Heitmann, S. Habib, and C.T. Silva. Provenance in comparative analysis: A study in cosmology. Computing in Science and Engineering, 10(3):30–37, 2008.
3. E.W. Anderson, G.A. Preston, and C.T. Silva. Towards development of a circuit based treatment for impaired memory: A multidisciplinary approach. In IEEE EMBS Neural Engineering, Kohala Coast, HI, pp. 302–305, 2007.
4. A. Baptista, B. Howe, J. Freire, D. Maier, and C.T. Silva. Scientific exploration in the era of ocean observatories. Computing in Science and Engineering, 10(3):53–58, 2008.
5. B. Bauer et al. The ALPS project release 2.0: Open source software for strongly correlated systems. Journal of Statistical Mechanics: Theory and Experiment, 2011(05):P05001, 2011.
6. L. Bavoil, S. Callahan, P. Crossno, J. Freire, C. Scheidegger, C.T. Silva, and H.T. Vo. VisTrails: Enabling interactive multiple-view visualizations. In Proceedings of IEEE Visualization, Minneapolis, MN, pp. 135–142, 2005.
7. Biostatistics Journal. http://biostatistics.oxfordjournals.org (Accessed March, 2013).
8. S.P. Callahan, J. Freire, C.E. Scheidegger, C.T. Silva, and H.T. Vo. Towards provenance-enabling ParaView. In J. Freire, D. Koop, and L. Moreau, editors, Provenance and Annotation of Data and Processes, Lecture Notes in Computer Science, pp. 120–127. Springer-Verlag, Salt Lake City, UT, 2008.
9. F. Chirigati and J. Freire. Towards integrating workflow and database provenance. In P. Groth and J. Frew, editors, Provenance and Annotation of Data and Processes, Lecture Notes in Computer Science, pp. 11–23. Springer, Berlin, Germany, 2012.
10. F. Chirigati, D. Shasha, and J. Freire. Reprozip: Packing experiments for sharing and publication. In Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, SIGMOD’13, 2013 ACM, New York, 2013.
11. F.S. Chirigati, R. Dahis, S. Manuel Serra da Cruz, J. Freire, C.T. Silva, and M. Mattoso. Desenvolvimento de estruturas de controle explícito para o SGWfC VisTrails. In Brazilian Symposium on Databases (SBBD), Fortaleza, Brazil, 2009 (Best poster award).
12. NSF Center for Coastal Margin Observation and Prediction (CMOP). http://www.stccmop.org(Accessed March, 2013).
13. Collage: Authoring Environment for Executable Publications. https://collage.elsevier.com/(Accessed March, 2013).
14. Council for Scientific and Industrial Research (CSIR) in South Africa. http://www.csir.co.za(Accessed March, 2013).
15. The Data Observation Network for Earth (DataONE). https://dataone. org/(Accessed March, 2013).
16. A. Dolgert, L. Gibbons, C.D. Jones, V. Kuznetsov, M. Riedewald, D. Riley, G.J. Sharp, and P. Wittich. Provenance in high-energy physics workflows. Computing in Science and Engineering, 10(3):22–29, 2008.
17. D.L. Donoho, A. Maleki, I.U. Rahman, M. Shahram, and V. Stodden. Reproducible research in computational harmonic analysis. Computing in Science and Engineering, 11(1):8–18, Jan–Feb 2009.
18. EO4VisTrails—Earth Observation Capabilities for VisTrails. http://code.google.com/p/eo4vistrails (Accessed March, 2013).
19. M.H. Freedman, J. Gukelberger, M.B. Hastings, S. Trebst, M. Troyer, and Z. Wang. Galois conjugates of topological phases. Physical Review B, 85:045414, Jan 2012.
20. J. Freire, D. Koop, E. Santos, C. Scheidegger, C.T. Silva, and H.T. Vo. The Architecture of Open Source Applications, Brown, A. and Wilson, G. (Eds.) Lulu Publishing Inc., 2011. http://www.aosabook.org/en/vistrails. html
21. J. Freire, P. Bonnet, and D. Shasha. Exploring the coming repositories of reproducible experiments: Challenges and opportunities. PVLDB, 4(12):1494–1497, 2011.
22. J. Freire, P. Bonnet, and D. Shasha. Computational reproducibility: State-of-the-art, challenges, and database research opportunities. In Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data, SIGMOD’12, pp. 593–596, ACM, New York, 2012.
23. J. Freire, D. Koop, E. Santos, and C.T. Silva. Provenance for computational tasks: A survey. Computing in Science and Engineering, 10(3):11–21, May 2008.
24. J. Freire, C.T. Silva, S. Callahan, E. Santos, C. Scheidegger, and H.T. Vo. Managing rapidly-evolving scientific workflows. In International Provenance and Annotation Workshop (IPAW), LNCS 4145, pp. 10–18. Springer Verlag, Chicago, IL, 2006.
25. J. Freire and C.T. Silva. Making computations and publications reproducible with VisTrails. Computing in Science and Engineering, 14(4):18–25, 2012.
26. M. Gavish and D. Donoho. A universal identifier for computational results. Procedia Computer Science. In Proceedings of the International Conference on Computational Science (ICCS), Singapore, 4:637–647, 2011.
27. P. Van Gorp and S. Mazanek. SHARE: A web portal for creating and sharing executable research papers. Procedia Computer Science, 4:589–597, 2011. In Proceedings of the International Conference on Computational Science (ICCS). Singapore.
28. GridFields. http://code.google.com/p/gridfields
29. R. Heiland, M. Swat, B. Zaitlen, J. Glazier, and A. Lumsdale. Workflows for parameter studies of multi-cell modeling (HPC). In Proceedings of the ACM High Performance Computing Symposium, Orlando, FL, pp. 94:1–94:6, 2010.
30. T. Hey, S. Tansley, and K. Tolle, editors. The Fourth Paradigm: Data-Intensive Scientific Discovery. Microsoft Research, Redmond, WA, 2009.
31. B. Howe, P. Lawson, R. Bellinger, E. Anderson, E. Santos, J. Freire, C. Scheidegger, A. Baptista, and C.T. Silva. End-to-end escience: Integrating workflow, query, visualization, and provenance at an ocean observatory. In IEEE International Conference on eScience, Indianapolis, IN, pp. 127–134, 2008.
32. B. Howe, C. Silva, and J. Freire. A science cloud on your desktop: VisTrails + GridFields, 2009. http://clue.cs.washington.edu (Accessed March, 2013).
33. IBM. OpenDX. http://www.research.ibm.com/dx (Accessed March, 2013).
34. The Insight Toolkit. http://www.itk.org (Accessed March, 2013).
35. The Kepler Project. http://kepler-project.org(Accessed March, 2013).
36. Kitware. ParaView. http://www.paraview.org (Accessed March, 2013).
37. D. Koop, E. Santos, B. Bauer, M. Troyer, J. Freire, and C.T. Silva. Bridging workflow and data provenance using strong links. In SSDBM, Heidelberg, Germany, pp. 397–415, 2010.
38. D. Koop, E. Santos, P. Mates, H.T. Vo, P. Bonnet, B. Bauer, B. Surer, M. Troyer, D.N. Williams, J.E. Tohline, J. Freire, and C.T. Silva. A provenance-based infrastructure to support the life cycle of executable papers. Procedia Computer Science, 4:648–657, 2011. In Proceedings of the International Conference on Computational Science (ICCS). Singapore.
39. D. Koop, C. Scheidegger, J. Freire, and C.T. Silva. The provenance of workflow upgrades. In IPAW, Troy, NY, pp. 2–16, 2010.
40. D. Koop, C.E. Scheidegger, S.P. Callahan, J. Freire, and C.T. Silva. VisComplete: Automating suggestions for visualization pipelines. IEEE Transactions on Visualization and Computer Graphics, 14(6):1691–1698, 2008.
41. Lawrence Livermore National Laboratory. VisIt: Visualize It in Parallel Visualization Application. https://wci.llnl.gov/codes/visit, March 29, 2008. (Accessed March, 2013).
42. F. Leisch. Sweave: Dynamic generation of statistical reports using literate data analysis. In Compstat, pp. 575–580, 2002.
43. R.J. LeVeque. Python tools for reproducible research on hyperbolic problems. Computing in Science and Engineering, 11(1):19–27, Jan–Feb 2009.
44. Madagascar. http://www.ahay.org/wiki/Main_Page (Accessed March, 2013).
45. P. Mates, E. Santos, J. Freire, and C.T. Silva. CrowdLabs: Social analysis and visualization for the sciences. In SSDBM, Portland, OR, pp. 555–564, 2011.
46. J. Morisette, C. Jarnevich, T. Holcombe, C. Talbert, D. Ignizio, M. Talbert, C.T. Silva, D. Koop, A. Swanson, and N. Young. VisTrails SAHM: Visualization and workflow management for ecological niche modeling. Ecography, 36:129–135, 2013.
47. D.A. Norman. Things That Make Us Smart: Defending Human Attributes in the Age of the Machine. Addison Wesley, Reading, MA, 1994.
48. Oracle Database 11g Release 2. http://www.oracle.com/technetwork/database/enterprise-edition/overview (Accessed March, 2013).
49. Oracle Total Recall with Oracle Database 11g Release 2. http://www.oracle.com/technetwork/database/application-development/total-recall-1667156.html (Accessed March, 2013).
50. The Pegasus Project. http://pegasus.isi.edu/(Accessed March, 2013).
51. Q. Pham, T. Malik, I. Foster, R. Di Lauro, and R. Montella. SOLE: Linking research papers with science objects. In P. Groth and J. Frew, editors, Provenance and Annotation of Data and Processes, vol. 7525 of Lecture Notes in Computer Science, pp. 203–208. Springer, Berlin, Germany, 2012.
52. PNAS Submission Guidelines. http://www.pnas.org/site/misc/iforc. shtml\#submission (Accessed March, 2013).
53. Software for Assisted Habitat Modeling Package for VisTrails (SAHM: VisTrails). http://www.fort.usgs.gov/products/software/sahm (Accessed March, 2013).
54. E. Santos, D. Koop, T. Maxwell, C. Doutriaux, T. Ellqvist, G. Potter, J. Freire, D. Williams, and C.T. Silva. Designing a provenance-based climate data analysis application. In P. Groth and J. Frew, editors, Provenance and Annotation of Data and Processes, vol. 7525 of Lecture Notes in Computer Science, pp. 214–219. Springer, Berlin, Germany, 2012.
55. E. Santos, D. Koop, H.T. Vo, E.W. Anderson, J. Freire, and C.T. Silva. Using workflow medleys to streamline exploratory tasks. In SSDBM, New Orleans, LA, pp. 292–301, 2009.
56. E. Santos, L. Lins, J. Ahrens, J. Freire, and C.T. Silva. VisMashup: Streamlining the creation of custom visualization applications. IEEE Transactions on Visualization and Computer Graphics, 15(6):1539–1546, 2009.
57. C.E. Scheidegger, H.T. Vo, D. Koop, J. Freire, and C.T. Silva. Querying and creating visualizations by analogy. IEEE Transactions on Visualization and Computer Graphics, 13(6):1560–1567, 2007.
58. SIGMOD Experimental Repeatability. http://www.sigmod2011.org/calls_papers_sigmod_research_repeatability.shtml (Accessed March, 2013).
59. C.T. Silva, E. Anderson, E. Santos, and J. Freire. Using VisTrails and provenance for teaching scientific visualization. Computer Graphics Forum, 30(1):75–84, 2011.
60. C.T. Silva, J. Freire, and S.P. Callahan. Provenance for visualizations: Reproducibility and beyond. Computing in Science and Engineering, 9(5):82–89, September 2007.
61. The Swift System. http://www.ci.uchicago.edu/swift (Accessed March, 2013).
62. The Taverna Project. http://www.taverna.org.uk/(Accessed March, 2013).
63. J.E. Tohline, J. Ge, W. Even, and E. Anderson. A customized python module for CFD flow analysis within VisTrails. Computing in Science and Engineering, 11(3):68–73, 2009.
64. The Triana Project. http://www.trianacode.org (Accessed March, 2013).
65. IEEE Transactions on Signal Processing—Reproducible Research. http://www.signalprocessingsociety.org/publications/periodicals/tsp/(Accessed March, 2013).
66. C. Upson et al. The application visualization system: A computational environment for scientific visualization. IEEE Computer Graphics and Applications, 9(4):30–42, 1989.
67. Ultrascale Visualization—Climate Data Analysis Tools (UV-CDAT). http://uv-cdat.llnl.gov (Accessed March, 2013).
68. T.L. Van Zyl, G. McFerren, and A. Vahed. Earth observation scientific workflows in a distributed computing environment. Technical Report 7727, CSIR, 2011. http://hdl.handle.net/10204/5435 (Accessed March, 2013).
69. VDS—The GriPhyN Virtual Data System. http://www.ci.uchicago.edu/wiki/bin/view/VDS/VDSWeb/WebMain (Accessed March, 2013).
70. VisTrails. http://www.vistrails.org (Accessed March, 2013).
71. VLDB Experimental Reproducibility. http://www.vldb.org/2013/experimental_reproducibility.html (Accessed March, 2013).
72. vtDV3D VisTrails Package. http://portal.nccs.nasa.gov/DV3D/vtDV3D/_build/html/index.html (Accessed March, 2013).