Exploring the coming repositories of reproducible experiments: Challenges and opportunities

Proceedings of the VLDB Endowment

Volumn 4, Issue 12, 2011, Pages 1494-1497

  Freire, Juliana ^a   Bonnet, Philippe ^b   Shasha, Dennis ^a  

^a NEW YORK UNIVERSITY   (United States)

^b IT UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

DATA REPOSITORIES; HIGH QUALITY; REPRODUCIBILITIES; RESEARCH CHALLENGES; WORK-FLOWS; COMPUTATIONAL REPRODUCIBILITY; VALIDATED SOFTWARES;

EID: 84862703767     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: None     Document Type: Article

References (29)

1. The SAO/NASA Astrophysics Data System. http://adsabs.harvard.edu.
2. The ALPS project. http://alps.comp-phys.org/.
3. ICIAM Workshop on Reproducible Research: Tools and Strategies for Scientific Computing. http://www.mitacs.ca/events/index.php?option=com_content&view=article&id=214&Itemid=230&lang=en, 2011.
4. B. Bauer et. al. The ALPS project release 2.0: Open source software for strongly correlated systems, Jan. 2011. Accepted for publication in Journal of Statistical Mechanics: Theory and Experiment. Paper available at http://arxiv.org/pdf/1101.2646 and workflowsat http://arxiv.org/abs/1101.2646.
5. C. Beeri, A. Eyal, S. Kamenkovich, and T. Milo. Querying business processes. In VLDB, pages 343-354, 2006.
6. Beyond the PDF Workshop. https://sites.google.com/site/beyondthepdf, 2011.
7. CrowdLabs. http://www.crowdlabs.org.
8. Guidelines for Research Integrity and Good Scientific Practice at ETH Zurich. http://www.vpf.ethz.ch/services/researchethics/Broschure.
9. ETH Zurich's head of research resigns. http://www.ethlife.ethz.ch/archive_articles/090921_Peter_Chen_Ruecktritt_MM/index_EN.
10. The executable paper grand challenge, 2011. http://www.executablepapers.com.
11. S. Fomel and J. Claerbout. Guest editors' introduction: Reproducible research. Computing in Science Engineering, 11(1):5-7, 2009.
12. M. J. Franklin, A. Y. Halevy, and D. Maier. From databases to dataspaces: a new abstraction for information management. SIGMOD Record, 34(4):27-33, 2005.
13. Genbank. http://www.ncbi.nlm.nih.gov/genbank.
14. D. Koop, E. Santos, P. Mates, H. Vo, P. Bonnet, B. Bauer, B. Surer, M. Troyer, D. Williams, J. Tohline, J. Freire, and C. Silva. A provenance-based infrastructure to support the life cycle of executable papers. In Proceedings of the International Conference on Computational Science, pages 648-657, 2011.
15. Madagascar. http://www.reproducibility.org/wiki/Main_Page.
16. S. Manegold, I. Manolescu, L. Afanasiev, J. Feng, G. Gou, M. Hadjieleftheriou, S. Harizopoulos, P. Kalnis, K. Karanasos, D. Laurent, M. Lupu, N. Onose, C. Ré, V. Sans, P. Senellart, T. Wu, and D. Shasha. Repeatability & workability evaluation of SIGMOD 2009. SIGMOD Record, 38(3):40-43, 2009.
17. I. Manolescu, L. Afanasiev, A. Arion, J. Dittrich, S. Manegold, N. Polyzotis, K. Schnaitter, P. Senellart, S. Zoupanos, and D. Shasha. The repeatability experiment of SIGMOD 2008. SIGMOD Record, 37(1):39-45, 2008.
18. P. Mates, E. Santos, J. Freire, and C. Silva. Crowdlabs: Social analysis and visualization for the sciences. In Proceedings of SSDBM, 2011. To appear.
19. J. Mesirov. Accessible reproducible research. Science, 327(5964):415-416, 2010.
20. myExperiment. http://www.myexperiment.org.
21. nanoHub. http://nanohub.org.
22. H. Nguyen, T. Nguyen, H. Nguyen, and J. Freire. Querying Wikipedia Documents and Relationships. In Proceedings of WebDB, 2010.
23. Nobel laureate retracts two papers unrelated to her prize. http://www.nytimes.com/2010/09/24/science/24retraction.html?_r=1&emc=eta1, September 2010.
24. It's science, but not necessarily right. http://www.nytimes.com/2011/06/26/opinion/sunday/26ideas.html?_r=2, June 2011.
25. C. E. Scheidegger, H. T. Vo, D. Koop, J. Freire, and C. T. Silva. Querying and creating visualizations by analogy. IEEE Transactions on Visualization and Computer Graphics, 13(6):1560-1567, 2007.
26. SIAM Mini-symposium on Verifiable, Reproducible Research and Computational Science. http://meetings.siam.org/sess/dsp_programsess.cfm?SESSIONCODE=11845.
27. Repeatability section of the ACM SIGMOD 2011. http://www.sigmod2011.org/calls_papers_sigmod_research_repeatability.shtml.
28. Computational repeatability: Tuning case study. http:// effdas.itu.dk/repeatability/tuning.html.
29. VisTrails. http://www.vistrails.org.