Productivity frameworks in big data image processing computations - Creating photographic mosaics with Hadoop and Scalding

Procedia Computer Science

Volumn 29, Issue , 2014, Pages 2306-2314

  Szul, Piotr ^a   Bednarz, Tomasz ^a  

^a CSIRO   (Australia)

Author keywords

Big data; Hadoop; Image processing; Productivity frameworks

Indexed keywords

APPLICATION PROGRAMMING INTERFACES (API); DATA HANDLING; IMAGE PROCESSING; PRODUCTIVITY;

BINARY DATA; DATA IMAGES; DE FACTO STANDARD; HADOOP; TEXTUAL DATA;

BIG DATA;

EID: 84902843665     PISSN: 18770509     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1016/j.procs.2014.05.215     Document Type: Conference Paper

References (22)

1. The Apache Software Foundation, "Apache Hadoop, " 2007. [Online]. Available: http://hadoop.apache.org/.
2. The Apache Software Foundation, "Apache Oozie Workflow Scheduler for Hadoop, " 2011. [Online]. Available: http://oozie.apache.org/.
3. The Apache Software Foundation, "Apache HBase, " [Online]. Available: http://hbase.apache.org/.
4. The Apache Software Foundation, "Apache Mahout, " [Online]. Available: http://mahout.apache.org/.
5. The Apache Software Foundation, "Apache Flume, " 2009. [Online]. Available: http://flume.apache.org/.
6. J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters, " Communications of the ACM, vol. 51, no. 1, pp. 107-113, 2008.
7. The Apache Software Foundation, "Apache Pig, " 2007. [Online]. Available: https://pig.apache.org/.
8. cascading.org, "Cascading: Application Platform for Enterprise Big Data, " 2007. [Online]. Available: http://www.cascading.org.
9. The Apache Software Foundation, "Crunch, " 2013. [Online]. Available: http://crunch.apache.org/.
10. NICTA, "Soobi, " 2011. [Online]. Available: http://www.opennicta.com/home/scoobi.
11. Twitter, "Scalding, " 2011. [Online]. Available: https://github.com/twitter/scalding.
12. cascalog.org, "Cascalog:Fully-featured data processing and querying library for Clojure or Java., " 2010. [Online]. Available: http://cascalog.org/.
13. K. Wiley, A. Connolly, S. Krughoff, J. Gardner, M. Balazinska, B. Howe, Y. Kwon and Y. Bu, "Astronomical Image Processing with Hadoop, " in Astronomical Data Analysis Software and Systems XX. ASP Conference Proceedings, 2011.
14. S. Chen, T. Bednarz, P. Szul, D. Wang, Y. Arzhaeva, N. Burdett, A. Khassapov, J. Zic, S. Nepal, T. Gurevey and J. Taylor, "Galaxy + Hadoop: Toward a Collaborative and Scalable Image Processing Toolbox in Cloud, " in ICSOC Workshop 2013, 2013.
15. B. Harris and J. George, "VideoMosaic Project, " 2006. [Online]. Available: http://www.intelegance.net/video/videomosaic.shtml.
16. Wikpedia, "Photographic mosaic, " [Online]. Available: http://en.wikipedia.org/wiki/Photographic-mosaic.
17. JH Labs, "JH Labs - Java Image Processing, " [Online]. Available: http://www.jhlabs.com/ip/filters/index.html.
18. cascading.org, "Partial Aggregation instead of Combiners, " [Online]. Available: http://docs.cascading.org/cascading/2.0/userguide/ htmlsingle/#N21472.
19. Scala, "The Scala Programming Language, " 2002. [Online]. Available: http://www.scalalang.org/.
20. L. Liu, C. Sweeney, S. Arietta and J. Lawrence, "HIPI - Hadoop Image Processing Interface, " [Online]. Available: http://hipi.cs.virginia.edu/ about.html.
21. The Apache Software Foundation, "Scrunch - A Scala Wrapper for the Apache Crunch Java API, " 2013. [Online]. Available: http://crunch.apache. org/scrunch.html.
22. M. H. Almeer, "Cloud Hadoop Map Reduce For Remote Sensing Image Analysis, " Journal of Emerging Trends in Computing and Information Sciences, vol. 3, no. 4, pp. 637-644, 2012.