Pydoop: A Python MapReduce and HDFS API for Hadoop

HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Volumn , Issue , 2010, Pages 819-825

  Leo, Simone ^a   Zanetti, Gianluigi ^a  

^a CRS4 ^*  (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

DISTRIBUTED FILE SYSTEMS; MAP-REDUCE; OPEN SOURCE IMPLEMENTATION; PYTHON PROGRAMMING;

APPLICATION PROGRAMMING INTERFACES (API); DATA HANDLING; HIGH LEVEL LANGUAGES;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 78650021696     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1851476.1851594     Document Type: Conference Paper

References (18)

1. Amazon Elastic MapReduce. http://aws.amazon.com/elasticmapreduce
2. Applications and organizations using hadoop. http://wiki.apache.org/ hadoop/PoweredBy.
3. Disco. http://discoproject.org.
4. Dumbo. http://wiki.github.com/klbostee/dumbo.
5. Hadoop. http://hadoop.apache.org.
6. Hadoop + Python = Happy. http://code.google.com/p/happy.
7. Hadoop Common Credits. http://hadoop.apache.org/common/credits.html.
8. Hadoop Distributed File System (HDFS) APIs in perl, python, ruby and php.http://wiki.apache.org/hadoop/HDFS-APIs.
9. Kevin's Word List Page. http://wordlist.sourceforge.net.
10. NumPy. http://numpy.scipy.org.
11. Octopy - Easy MapReduce for Python. http://code.google.com/p/octopy.
12. Starfish. http://rufy.com/starfish/doc.
13. The Jython Project. http://www.jython.org.
14. Thrift. http://incubator.apache.org/thrift.
15. D. Abrahams and R. Grosse-Kunstleve. Building hybrid systems with Boost.Python. C/C++ Users Journal, 21(7):29-36, 2003.
16. J. Dean and S. Ghemawat. MapReduce: simplified data processing on large clusters. In OSDI '04: 6th Symposium on Operating Systems Design and Implementation, 2004.
17. S. Ghemawat, H. Gobioff, and S. Leung. The Google file system. ACM SIGOPS Operating Systems Review, 37(5):43, 2003.
18. S. Leo, P. Anedda, M. Gaggero, and G. Zanetti. Using virtual clusters to decouple computation and data management in high throughput analysis applications. In Proceedings of the 18th Euromicro Conference on Parallel, Distributed and Network-based Processing, Pisa, Italy, 17-19 February 2010, pages 411-415, 2010.