SmartSynth: Synthesizing smartphone automation scripts from natural language

MobiSys 2013 - Proceedings of the 11th Annual International Conference on Mobile Systems, Applications, and Services

Volumn , Issue , 2013, Pages 193-205

  Le, Vu ^a   Gulwani, Sumit ^b   Su, Zhendong ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Automation script; Natural language processing; Program synthesis; Smartphone

Indexed keywords

AUTOMATION SCRIPTS; CONVERSATIONAL INTERACTION; DOMAIN SPECIFIC LANGUAGES; NATURAL LANGUAGE PROCESSING; PROGRAM SYNTHESIS; PROGRAMMING ENVIRONMENT; PROGRAMMING SYSTEM; SYNTHESIS ALGORITHMS;

AUTOMATION; PROBLEM ORIENTED LANGUAGES; SIGNAL ENCODING; SMARTPHONES;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84881381666     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2462456.2464443     Document Type: Conference Paper

References (42)

1. http://nlp.naturalparsing.com/.
2. A. V. Aho, M. S. Lam, R. Sethi, and J. D. Ullman. Compilers: Principles, Techniques, and Tools (2nd Edition). Addison Wesley, August 2006.
3. R. Alur, L. D'Antoni, S. Gulwani, D. Kini, and M. Viswanathan. Automated grading of dfa constructions. In IJCAI, 2013.
4. L. Androutsopoulos. Natural language interfaces to databases - an introduction. Journal of Natural Language Engineering, 1, 1995.
5. Apple. Siri for iPhone. http://www.apple.com/iphone/features/siri.html.
6. J. Aron. How innovative is Apple's new voice assistant, Siri? The New Scientist, 2011.
7. Crafty Apps. Tasker for Android. http://tasker.dinglisch.net/.
8. S. S. Epstein. Transportable natural language processing through simplicity-the PRE system. ACM Transactions on Information Systems (TOIS), 3(2), 1985.
9. C. Finucane, G. Jing, and H. Kress-Gazit. LTLMoP: Experimenting with language, temporal logic and robot control. In IEEE/RSJ ICIRS, 2010.
10. Google. Voice Actions for Android. http://www.google.com/mobile/voice- actions/.
11. S. Gulwani. Dimensions in program synthesis. In PPDP, 2010.
12. S. Gulwani. Automating string processing in spreadsheets using input-output examples. In POPL, 2011.
13. S. Gulwani. Synthesis from examples: Interaction models and algorithms. SYNASC, 2012. Invited talk paper.
14. S. Gulwani, W. Harris, and R. Singh. Spreadsheet data manipulation using examples. Communication of the ACM, 2012.
15. S. Gulwani, S. Jha, A. Tiwari, and R. Venkatesan. Synthesis of loop-free programs. In PLDI, 2011.
16. S. Gulwani, V. Korthikanti, and A. Tiwari. Synthesizing geometry constructions. In PLDI, 2011.
17. T. Gvero, V. Kuncak, and R. Piskac. Interactive Synthesis of Code Snippets. In CAV, 2011.
18. G. Hendrix, E. Sacerdoti, D. Sagalowicz, and J. Slocum. Developing a natural language interface to complex data. ACM Transactions on Database Systems (TODS), 3(2), 1978.
19. D. Jurafsky and J. H. Martin. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics and Speech Recognition. Prentice Hall, 2nd edition, 2008.
20. R. J. Kate, Y. W. Wong, and R. J. Mooney. Learning to transform natural to formal languages. In AAAI, 2005.
21. D. Klein and C. D. Manning. Accurate unlexicalized parsing. In ACL, 2003.
22. Y. Li, H. Yang, and H. V. Jagadish. NaLIX: an interactive natural language interface for querying XML. In ICMD, 2005.
23. G. Little and R. C. Miller. Keyword programming in Java. In ASE, 2007.
24. G. Little and R. C. Miller. Keyword programming in Java. ASE, 2009.
25. H. Liu and H. Lieberman. Metafor: visualizing stories as code. In IEEE IUI, 2005.
26. H. Liu and H. Lieberman. Programmatic semantics for natural language interfaces. In Extended Abstracts on Human Factors in Computing Systems, 2005
27. D. Mandelin, L. Xu, R. Bodík, and D. Kimelman. Jungloid mining: helping to navigate the api jungle. In PLDI, 2005.
28. M. D. Marneffe, B. MacCartney, and C. D. Manning. Generating typed dependency parses from phrase structure parses. In LREC, 2006.
29. Microsoft Research. on{X}. http://onx.ms/.
30. MIT Center for Mobile Learning. MIT App Inventor for Android. http://appinventor.mit.edu/.
31. R. Pandita, X. Xiao, H. Zhong, T. Xie, S. Oney, and A. Paradkar. Inferring method specifications from natural language api descriptions. In ICSE, 2012.
32. D. Perelman, S. Gulwani, T. Ball, and D. Grossman. Type-directed completion of partial expressions. In PLDI, 2012.
33. D. Price, E. Riloff, J. Zachary, and B. Harvey. NaturalJava: a natural language interface for programming in Java. In IEEE IUI, 2000.
34. M.-R. Ra, B. Liu, T. L. Porta, and R. Govindan. Medusa: A Programming Framework for Crowd-Sensing Applications. In MobiSys, 2012.
35. R. Singh and S. Gulwani. Learning semantic string transformations from examples. VLDB, 2012.
36. I. Song, F. Guedea, F. Karray, Y. Dai, and I. El Khalil. Natural language interface for mobile robot navigation control. In ISIC, 2004.
37. SRI International. Cognitive Assistant that Learns and Organizes. http://www.ai.sri.com/project/CALO.
38. N. Tillmann, M. Moskal, J. de Halleux, and M. Fahndrich. TouchDevelop: programming cloud-connected mobile devices via touchscreen. In ONWARD, 2011.
39. Two forty four a.m. LLC. Locale. http://www.twofortyfouram.com/.
40. N. Wirth. Program development by stepwise refinement. Communication of the ACM, 14(4), 1971.
41. X. Xiao, A. Paradkar, S. Thummalapenta, and T. Xie. Automated extraction of security policies from natural-language software documents. In FSE, 2012.
42. B. Yan and G. Chen. AppJoy: Appjoy: Personalized mobile application discovery. In MobiSys, 2011.