Towards practical incremental recomputation for scientists: An implementation for the Python language

2nd Workshop on the Theory and Practice of Provenance, TaPP 2010

Volumn , Issue , 2010, Pages

  Guo, Philip J ^a   Engler, Dawson ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATION THEORY; HIGH LEVEL LANGUAGES; PROGRAM INTERPRETERS; TANTALUM COMPOUNDS;

COMPUTATIONAL SCIENTISTS; INTERMEDIATE RESULTS; ORDERS OF MAGNITUDE; PROTOTYPE DATA; PYTHON LANGUAGE; RE-COMPUTING; RECOMPUTATION; RUNTIMES;

PHOSPHORUS COMPOUNDS;

EID: 84858314586     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Parallel Python http://www.parallelpython.com/.
2. Programming for Scientists (blog) http://www.programming4scientists.com/.
3. BRANDT, J., GUO, P. J., LEWENSTEIN, J., DONTCHEVA, M., AND KLEMMER, S. R. Opportunistic programming: Writing code to prototype, ideate, and discover. IEEE Software 26, 5 (2009), 18-24.
4. BRONSON, N. personal email communication, discussing hindrances to data subsetting, 2009.
5. DEAN, J., AND GHEMAWAT, S. Mapreduce: simplified data processing on large clusters. In Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation (2004), USENIX Association, pp. 10-10.
6. GRAY, W., AND BOEHM-DAVIS, D. Milliseconds matter: An introduction to microstrategies and to their use in describing and predicting interactive behavior. Journal of Experimental Psychology: Applied 6, 4 (2000), 322-335.
7. GUO, P. J., AND ENGLER, D. Linux kernel developer responses to static analysis bug reports. In Proceedings of the USENIX Annual Technical Conference (2009), USENIX Association, pp. 285-292.
8. HAMMER, M. A., ACAR, U. A., AND CHEN, Y. CEAL: a C-based language for self-adjusting computation. In Proceedings of the 2009 ACM SIGPLAN conference on Programming language design and implementation (2009), ACM, pp. 25-37.
9. LUDÄSCHER, B., ALTINTAS, I., BERKLEY, C., HIGGINS, D., JAEGER, E., JONES, M., LEE, E. A., TAO, J., AND ZHAO, Y. Scientific workflow management and the Kepler system: Research articles. Concurr. Comput.: Pract. Exper. 18, 10 (2006), 1039-1065.
10. MUNISWAMY-REDDY, K.-K., HOLLAND, D. A., BRAUN, U., AND SELTZER, M. Provenance-aware storage systems. In Proceedings of the USENIX Annual Technical Conference (2006), USENIX Association, pp. 4-4.
11. OINN, T., GREENWOOD, M., ADDIS, M., ALPDEMIR, M. N., FERRIS, J., GLOVER, K., GOBLE, C., GODERIS, A., HULL, D., MARVIN, D., LI, P., LORD, P., POCOCK, M. R., SENGER, M., STEVENS, R., WIPAT, A., AND WROE, C. Taverna: lessons in creating a workflow environment for the life sciences: Research articles. Concurr. Comput.: Pract. Exper. 18, 10 (2006), 1067-1100.
12. OLSTON, C., REED, B., SRIVASTAVA, U., KUMAR, R., AND TOMKINS, A. Pig latin: a not-so-foreign language for data processing. In Proceedings of the ACM SIGMOD international conference on Management of data (2008), ACM, pp. 1099-1110.
13. RIGO, A. Representation-based just-in-time specialization and the Psyco prototype for Python. In Proceedings of the ACM SIGPLAN symposium on Partial evaluation and semantics-based program manipulation (2004), ACM, pp. 15-26.
14. SALCIANU, A., AND RINARD, M. C. Purity and side effect analysis for Java programs. In VMCAI (2005), pp. 199-215.
15. SCHEIDEGGER, C. E., VO, H. T., KOOP, D., FREIRE, J., AND SILVA, C. T. Querying and re-using workflows with VisTrails. In Proceedings of the ACM SIGMOD international conference on Management of data (2008), ACM, pp. 1251-1254.
16. SEO, J. personal email communication, discussing sequential vs. parallel scripts, 2009.
17. ZHANG, M., ZHANG, X., ZHANG, X., AND PRABHAKAR, S. Tracing lineage beyond relational operators. In VLDB'07: Proceedings of the 33rd international conference on Very large data bases (2007), VLDB Endowment, pp. 1116-1127.