Semantic characterization of MapReduce workloads

Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013

Volumn , Issue , 2013, Pages 87-97

  Xu, Zhihong ^a   Hirzel, Martin ^b   Rothermel, Gregg ^a  

^a UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^b IBM RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BLACK-BOX TESTING; CHARACTERIZATION; SEMANTICS;

BLACK BOX APPROACH; LARGE AMOUNTS OF DATA; MAP-REDUCE; NON-TRIVIAL; PERFORMANCE PROBLEMS; SEMANTIC CHARACTERIZATIONS; SEMANTIC PROPERTIES; USER CODES;

MULTIPROCESSING SYSTEMS;

EID: 84893614281     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IISWC.2013.6704673     Document Type: Conference Paper

References (24)

1. Andre Baresel, David Binkley, Mark Harman, and Bogdan Korel. Evolutionary testing in the presence of loop-assigned flags: a testability transformation approach. In International Symposium on Software Testing and Analysis (ISSTA), pages 108-118, 2004.
2. Kevin S. Beyer, Vuk Ercegovac, Rainer Gemulla, Andrey Balmin, Mohamed Eltabakh, Carl-Christian Kanne, Fatma Ozcan, and Eugene J. Shekita. Jaql: A scripting language for large scale semistructured data analysis. In Very Large Data Bases (VLDB), pages 1272-1283, 2011.
3. Cristian Cadar, Vijay Ganesh, Peter M. Pawlowski, David L. Dill, and Dawson R. Engler. EXE: Automatically generating inputs of death. In Computer and Communications Security (CCS), pages 322-335, 2006.
4. Yanpei Chen, Sara Alspaugh, and Randy Katz. Interactive analytical processing in big data systems: A cross-industry study of MapReduce workloads. In Very Large Data Bases (VLDB), pages 1802-1813, 2012.
5. Lori A. Clarke. A system to generate test data and symbolically execute programs. Transactions on Software Engineering (TSE), 2(3):215-222, 1976.
6. Tyson Condie, Neil Conway, Peter Alvaro, Joseph M. Hellerstein, Khaled Elmeleegy, and Russell Sears. MapReduce online. In Networked Systems Design and Implementation (NSDI), pages 313-328, 2010.
7. Jeffrey Dean and Sanjay Ghemawat. MapReduce: Simplified data processing on large clusters. In Operating Systems Design and Implementation (OSDI), pages 137-150, 2004.
8. Bruno Dufour, Karel Driesen, Laurie Hendren, and Clark Verbrugge. Dynamic metrics for Java. In Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA), pages 149-168, 2003.
9. Joe W. Duran and Simeon Ntafos. A report on random testing. In International Conference on Software Engineering (ICSE), pages 179-183, 1981.
10. Michael D. Ernst, Greg J. Badros, and David Notkin. An empirical analysis of C preprocessor use. Transactions on Software Engineering (TSE), 28(12):1146-1170, 2002.
11. Patrice Godefroid, Nils Klarlund, and Koushik Sen. DART: Directed automated random testing. In Programming Language Design and Implementation (PLDI), pages 213-223, 2005.
12. Martin Hirzel, Henrique Andrade, Bugra Gedik, Gabriela Jacques-Silva, Rohit Khandekar, Vibhore Kumar, Mark Mendell, Howard Nasgaard, Scott Schneider, Robert Soule, and Kun-Lung Wu. IBM Streams Processing Language: Analyzing big data in motion. IBM Journal of Research and Development (IBMRD), 57(3/4):7:1-7:11, 2013.
13. Fabian Hueske, Mathias Peters, Matthias J. Sax, Astrid Rheinlander, Rico Bergmann, Aljoscha Krettek, and Kostas Tzoumas. Opening the black boxes in data flow optimization. In Very Large Data Bases (VLDB), pages 1256-1267, 2012.
14. Soila Kavulya, Jiaqi Tan, Rajeev Gandhi, and Priya Narasimhan. An analysis of traces from a production MapReduce cluster. In Cluster, Cloud, and Grid Computing (CCGrid), pages 94-103, 2010.
15. Ralf Lammel. Google's MapReduce programming model - revisited. Science ofComputer Programming (SCP), 70(1):1-30, 2007.
16. Kim G. Larsen, Marius Mikucionis, Brian Nielsen, and Arne Skou. Testing real-time embedded software using UPPAAL-TRON. In Embedded Software (EMSOFT), pages 299-306, 2005.
17. Mahout official website. http://mahout.apache.org/.
18. Floreal Morandat, Brandon Hill, Leo Osvald, and Jan Vitek. Evaluating the design of the R language. In European Conference for Object-Oriented Programming (ECOOP), pages 104-131, 2012.
19. Christopher Olston, Shubham Chopra, and Utkarsh Srivastava. Generating example data for dataflow programs. In International Conference on Management ofData (SIGMOD), pages 245-256, 2009.
20. Christopher Olston, Benjamin Reed, Utkarsh Srivastava, Ravi Kumar, and Andrew Tomkins. Pig Latin: A not-so-foreign language for data processing. In International Conference on Management of Data (SIGMOD), pages 1099-1110, 2008.
21. Roy P. Pargas, Mary Jean Harrold, and Robert R. Peck. Test-data generation using genetic algorithms. Software Testing, Verification And Reliability (JSTVR), 9(4):263-282, 1999.
22. Gregor Richards, Sylvain Lebresne, Brian Burg, and Jan Vitek. An analysis of the dynamic behavior of JavaScript programs. In Programming Language Design and Implementation (PLDI), pages 1-12, 2010.
23. Zhihong Xu, Martin Hirzel, Gregg Rothermel, and Kun-Lung Wu. Testing properties of dataflow program operators. In Conference on Automated Software Engineering (ASE), 2013.
24. Yuan Yu, Pradeep Kumar Gunda, and Michael Isard. Distributed aggregation for data-parallel computing: Interfaces and implementations. In Symposium on Operating Systems Principles (SOSP), pages 247-260, 2009.