Spreadsheets for stream processing with unbounded windows and partitions

DEBS 2016 - Proceedings of the 10th ACM International Conference on Distributed and Event-Based Systems

Volumn , Issue , 2016, Pages 49-60

  Hirzel, Martin ^a   Rabbah, Rodric ^a   Suter, Philippe ^a   Tardieu, Olivier ^a   Vaziri, Mandana ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

End user programming; Spreadsheets; Stream processing

Indexed keywords

COMPUTER PROGRAMMING; SOFTWARE ARCHITECTURE; SPREADSHEETS;

COMPUTATIONAL PARADIGM; END USER PROGRAMMING; PROGRAMMING EXPERIENCE; PROGRAMMING MODELS; STREAM PROCESSING; STREAM PROCESSING SYSTEMS; STREAMING APPLICATIONS; TIME-BASED WINDOWS;

C++ (PROGRAMMING LANGUAGE);

EID: 84978717761     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2933267.2933607     Document Type: Conference Paper

References (45)

1. T. Akidau, A. Balikov, K. Bekiroglu, S. Chernyak, J. Haberman, R. Lax, S. McVeety, D. Mills, P. Nordstrom, and S. Whittle. MillWheel: Fault-tolerant stream processing at internet scale. In Very Large Data Bases (VLDB) Industrial Track, pages 734-746, 2013.
2. M. H. Ali, C. Gerea, B. Raman, B. Sezgin, T. Tarnavski, T. Verona, P. Wang, P. Zabback, A. Kirilov, A. Ananthanarayan, M. Lu, A. Raizman, R. Krishnan, R. Schindlauer, T. Grabs, S. Bjeletich, B. Chandramouli, J. Goldstein, S. Bhat, Y. Li, V. Di Nicola, X. Wang, D. Maier, I. Santos, O. Nano, and S. Grell. Microsoft CEP server and online behavioral targeting. In Demo at Very Large Data Bases (VLDB-Demo), pages 1558-1561, 2009.
3. The Apache POI project. http://poi.apache.org. Retrieved Aug., 2015.
4. A. Arasu, S. Babu, and J. Widom. The CQL continuous query language: semantic foundations and query execution. Journal on Very Large Data Bases (VLDB J.), 15(2):121-142, 2006.
5. M. Arnold, D. Grove, B. Herta, M. Hind, M. Hirzel, A. Iyengar, L. Mandel, V. Saraswat, A. Shinnar, J. Siḿeon, M. Takeuchi, O. Tardieu, and W. Zhang. META: Middleware for events, transactions, and analytics. IBM Journal of Research & Development, 60(2/3):151-1510, 2016.
6. D. Balson and J. Tyszkiewicz. User defined spreadsheet functions in excel. In European Spreadsheet Risks Interest Group Annual Conference (EuSpRIG), 2012.
7. D. W. Barowy, D. Gochev, and E. D. Berger. Checkcell: Data debugging for spreadsheets. In Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA), pages 507-523, 2014.
8. A. Benveniste, P. Caspi, S. A. Edwards, N. Halbwachs, P. L. Guernic, and R. de Simone. The synchronous languages 12 years later. Proceedings of the IEEE, 91(1):64-83, 2003.
9. I. Botan, R. Derakhshan, N. Dindar, L. Haas, R. J. Miller, and N. Tatbul. SECRET: A model for analysis of the execution semantics of stream processing systems. In Very Large Data Bases (VLDB), pages 232-243, 2010.
10. E. Bouillet, M. Feblowitz, Z. Liu, A. Ranganathan, and A. Riabov. A tag-based approach for the design and composition of information processing applications. In Onward! Track of Object-Oriented Programming, Systems, Languages, and Applications (Onward!), pages 585-602, 2008.
11. P. Caspi, D. Pilaud, N. Halbwachs, and P. Raymond. Lustre: A declarative language for real-time programming. In Symposium on Principles of Programming Languages (POPL), 1987.
12. K. S.-P. Chang and B. A. Myers. Creating interactive web data applications with spreadsheets. In Symposium on User Interface Software and Technology (UIST), pages 87-96, 2014.
13. K. S.-P. Chang and B. A. Myers. A spreadsheet model for handling streaming data. In Conference on Human Factors in Computing Systems (CHI), pages 3399-3402, 2015.
14. Big data analytics. http://www.hashdoc.com/document/8626/big-data-analytics. Retrieved Aug., 2015.
15. J. Cunha, J. a. P. Fernandes, J. Mendes, and J. a. Saraiva. MDSheet: A framework for model-driven spreadsheet engineering. In International Conference on Software Engineering (ICSE), pages 1395-1398, 2012.
16. P. T. Eugster, P. A. Felber, R. Guerraoui, and A.-M. Kermarrec. The many faces of publish/subscribe. ACM Computing Surveys (CSUR), 35(2):114-131, June 2003.
17. B. Gedik. Generic windowing support for extensible stream processing systems. Software Practice and Experience (SP&E), 2013.
18. M. I. Gordon, W. Thies, and S. Amarasinghe. Exploiting coarse-grained task, data, and pipeline parallelism in stream programs. In Architectural Support for Programming Languages and Operating Systems (ASPLOS), pages 151-162, 2006.
19. S. Gulwani. Automating string processing in spreadsheets using input-output examples. In Principles of Programming Languages (POPL), 2011.
20. S. Gulwani and M. Marron. NLyze: Interactive programming by natural language for spreadsheet data analysis and manipulation. In International Conference on Management of Data (SIGMOD), pages 803-814, 2014.
21. F. Hermans and E. Murphy-Hill. Enron's spreadsheets and related emails: A dataset and analysis. In International Conference on Software Engineering (ICSE), volume 2, pages 7-16, 2015.
22. M. Hirzel, H. Andrade, B. Gedik, G. Jacques-Silva, R. Khandekar, V. Kumar, M. Mendell, H. Nasgaard, S. Schneider, R. Souĺe, and K.-L. Wu. IBM Streams Processing Language: Analyzing big data in motion. IBM Journal of Research & Development, 57(3/4):71-711, 2013.
23. M. Hirzel, R. Rabbah, P. Suter, O. Tardieu, and M. Vaziri. Spreadsheets for stream partitions and windows. In Workshop on Software Engineering Methods in Spreadsheets (SEMS@ICSE), pages 39-40, 2015.
24. M. Hirzel, R. Souĺe, S. Schneider, B. Gedik, and R. Grimm. A catalog of stream processing optimizations. ACM Computing Surveys (CSUR), 46(4), Apr. 2014.
25. About IFTTT. https://ifttt.com/wtf Retrieved Aug., 2015.
26. R. E. Kalman. A new approach to linear filtering and prediction problems. Transactions of the ASME-Journal of Basic Engineering, 82(Series D):35-45, 1960.
27. E. Kandogan, E. Haber, R. Barrett, A. Cypher, P. Maglio, and H. Zhao. A1: End-user programming for web-based system administration. In Symposium on User Interface Software and Technology (UIST), pages 211-220, 2005.
28. P. Li, K. Agrawal, J. Buhler, and R. D. Chamberlain. Deadlock avoidance for streaming computations with filtering. In Symposium on Parallelism in Algorithms and Architectures (SPAA), pages 243-252, 2010.
29. M. H. Linehan, S. Dehors, E. Rabinovich, and F. Fournier. Controlled English language for production and event processing rules. In Conference on Distributed Event-Based Systems (DEBS), 2011.
30. B. Lisper and J. MalstrÖm. Haxcel: A spreadsheet interface to Haskell. In Workshop on the Implementation of Functional Languages (IFL), pages 206-222, 2002.
31. J. McGarry. Processing continuous data streams in electronic spreadsheets. PatentNo.US6, 490, 600B1, 2002.
32. Node-RED: A visual tool for wiring the internet of things. http://nodered.org. Retrieved Aug., 2015.
33. K. W. Piersol. Object-oriented spreadsheets: The analytic spreadsheet package. In Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA), pages 385-390, 1986.
34. J. Sajaniemi and J. Pekkanen. An empirical analysis of spreadsheet calculation. Software - Practice and Experience (SP&E), 18(6):583-596, June 1988.
35. S. Schneider, M. Hirzel, B. Gedik, and K.-L. Wu. Auto-parallelizing stateful distributed streaming applications. In International Conference on Parallel Architectures and Compilation Techniques (PACT), pages 53-64, 2012.
36. P. Sestoft. Implementing function spreadsheets. In Workshop on End-User Software Engineering (WEUSE), pages 91-94, 2008.
37. U. Srivastava and J. Widom. Flexible time management in data stream systems. In Principles of Database Systems (PODS), pages 263-274, 2004.
38. StreamBase Microsoft Excel adapter. http://docs.streambase.com/sb66/index.jsp?topic=/com.streambase.sb.ide.help/data/html/samplesinfo/Excelsample.html. Retrieved Aug., 2015.
39. K. Tangwongsan, M. Hirzel, S. Schneider, and K.-L. Wu. General incremental sliding-window aggregation. In Conference on Very Large Data Bases (VLDB), pages 702-713, 2015.
40. A. Toshniwal, S. Taneja, A. Shukla, K. Ramasamy, J. M. Patel, S. Kulkarni, J. Jackson, K. Gade, M. Fu, J. Donham, N. Bhagat, S. Mittal, and D. Ryaboy. Storm @Twitter. In International Conference on Management of Data (SIGMOD), 2014.
41. P. A. Tucker, D. Maier, T. Sheard, and L. Fegaras. Exploiting punctuation semantics in continuous data streams. Transations on Knowledge and Data Engineering (TKDE), 15(3):555-568, 2003.
42. M. Vaziri, O. Tardieu, R. Rabbah, P. Suter, and M. Hirzel. Stream processing with a spreadsheet. In European Conference on Object-Oriented Programming (ECOOP), pages 360-384, 2014.
43. A. Woo, S. Seth, T. Olson, J. Liu, and F. Zhao. A spreadsheet approach to programming and managing sensor networks. In Conference on Information Processing in Sensor Networks (IPSN), pages 424-431, 2006.
44. Z. Xu, M. Hirzel, G. Rothermel, and K.-L. Wu. Testing properties of dataflow program operators. In Conference on Automated Software Engineering (ASE), pages 103-113, 2013.
45. M. Zaharia, T. Das, H. Li, T. Hunter, S. Shenker, and I. Stoica. Discretized streams: Fault-tolerant streaming computation at scale. In Symposium on Operating Systems Principles (SOSP), pages 423-438, 2013.