Creating contextual help for GUIs using screenshots

UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology

Volumn , Issue , 2011, Pages 145-154

  Yeh, Tom ^a   Chang, Tsung Hsiang ^b   Xie, Bo ^a   Walsh, Greg ^a   Watkins, Ivan ^a   Wongsuphasawat, Krist ^a   Huang, Man ^a   Davis, Larry S ^a   Ben, Bederson ^a  

^a Institute of Advanced Computer Science   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Contextual help; Help; Pixel analysis

Indexed keywords

COMPUTER SKILL; CONTEXTUAL HELP; END-USERS; HELP; PROGRAMMING SKILLS; SCREENSHOTS; SOURCE CODE ACCESS; UNIVERSITY CAMPUS;

COMPUTER PROGRAMMING; PIXELS;

GRAPHICAL USER INTERFACES;

EID: 80755169518     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2047196.2047214     Document Type: Conference Paper

References (33)

1. St. Amant, R., Lieberman, H., Potter, R., and Zettlemoyer, L. Programming by example: visual generalization in programming by example. Communications of the ACM 43, 3 (2000), 107-114.
2. St. Amant, R., Rey, M., Riedl, M.O., Ritter, F.E., and Reifers, A. Image Processing in Cognitive Models with SegMan Image processing in SegMan. In Proc. of HCI, 2001.
3. Bergman, L., Castelli, V., Lau, T., and Oblinger, D. DocWizards: A System for Authoring Follow-me Documentation Wizards. In Proc. of UIST, 2005.
4. Bigham, J.P., Lau, T., and Nichols, J. TrailBlazer: Enabling Blind Users to Blaze Trails Through the Web. In Proc. of IUI, 2009.
5. Chakravarthi, Y.A., Lutteroth, C., and Weber, G. AIMHelp: Generating Help for GUI Applications Automatically. In Proc. of CHINZ, 2009.
6. Chapuis, O. and Roussel, N. UIMarks: Quick Graphical Interaction with Specific Targets. In Proc. of UIST, 2010.
7. Dixon, M. and Fogarty, J. Prefab: Implementing Advanced Behaviors Using Pixel-Based Reverse Engineering of Interface Structure. In Proc. of CHI, 2010.
8. Dixon, M., Leventhal, D. and Fogarty, J. Content and Hierarchy in Pixel-Based Methods for Reverse Engineering Interface Structure. In Proc. of CHI 2011.
9. Farkas, D.K. The role of balloon help. ACM SIGDOC Asterisk Journal of Computer Documentation 17, 2 (1993), 3-19.
10. Findlater, L., Jansen, A., Shinohara, K., et al. Enhanced Area Cursors: Reducing Fine Pointing Demands for People with Motor Impairments. In Proc. of UIST, 2010.
11. Grabler, F., Agrawala, M., Li, W., Dontcheva, M., and Igarashi, T. Generating photo manipulation tutorials by demonstration. ACM Transactions on Graphics 28, 3 (2009), 1.
12. Grossman, T. and Balakrishnan, R. The Bubble Cursor: Enhancing Target Acquisition by Dynamic Resizing of the Cursor's Activation Area. In Proc. of CHI, 2005.
13. Grossman, T. and Fitzmaurice, G. ToolClips: An Investigation of Contextual Video Assistance for Functionality Understanding. In Proc. of CHI, 2010.
14. Huang, J. and B. Twidale, M.B. Graphstract: Minimal Graphical Help for Computers. In Proc. of UIST, 2007.
15. Hurst, A., Hudson, S.E., and Mankoff, J. Automatically identifying targets users interact with during real world tasks. In Proc. of IUI, 2010.
16. Kang, H. and Plaisant, C. New approaches to help users get started with visual interfaces: multi-layered interfaces and integrated initial guidance. In Proc. of the 2003 annual national conference on Digital government research, (2003).
17. Kelleher, C. and Pausch, R. Stencils-Based Tutorials: Design and Evaluation. In Proc. of CHI, 2005.
18. Lau, T., Bergman, L., Castelli, V., and Oblinger, D. Sheepdog: Learning Procedures for Technical Support. In Proc. of IUI, 2004.
19. Olsen, D.R., Hudson, S.E., Verratti, T., Heiner, J.M., and Phelps, M. Implementing interface attachments based on surface representations. In Proc. of CHI, 1999.
20. Olsen, D.R., Taufer, T., and Fails, J.A. ScreenCrayons: Annotating Anything. In Proc. of UIST, 2004.
21. Palaigeorgiou, G. and Despotakis, T. Known and Unknown Weaknesses in Software Animated Demonstrations (Screen-casts): A Study in Self-Paced Learning Settings. Journal of Information Technology Education 9, (2010).
22. Pangoli, S. and Paternó, F. Automatic generation of task-oriented help. ACM Press, 1995.
23. Plaisant, C. and Shneiderman, B. Show Me! Guidelines for Producing Recorded Demonstrations. In Proc. of VL/HCC, 2005.
24. Potter, R.L.-S. Pixel data access: interprocess communication in the user interface for end-user programming and graphical macros. (1999).
25. Prabaker, M., Bergman, L., and Castelli, V. An evaluation of using programming by demonstration and guided walkthrough techniques for authoring and utilizing documentation. ACM Press, New York, New York, USA, 2006.
26. Riedl, M.O. and St. Amant, R. Toward automated exploration of interactive systems. Proceedings of the 7th international conference on Intelligent user interfaces - IUI '02, ACM Press (2002), 135.
27. Sukaviriya, P. and Foley, J.D. Coupling a UI framework with automatic generation of context-sensitive animated help. ACM Press, New York, New York, USA, 1990.
28. Sukaviriya, P. Dynamic construction of animated help from application context. ACM Press.
29. Terry, M. and Mynatt, E.D. Side Views: Persistent, On-Demand Previews for Open-Ended Tasks. In Proc. of UIST, 2002.
30. Wiedenbeck, S. and Zila, P.L. Hands-on practice in learning to use software: a comparison of exercise, exploration, and combined formats. ACM Transactions on Computer-Human Interaction 4, 2 (1997), 169-196.
31. Wongsuphasawat, K., Guerra Gómez, J., Plaisant, C., Wang, T., Taieb-Maimon, M., Shneiderman, B. LifeFlow: Visualizing an Overview of Event Sequences. In Proc. of CHI 2011.
32. Yeh, T., Chang, T.-H., and Miller, R.C. Sikuli: Using GUI Screenshots for Search and Automation. In Proc. of UIST, 2009.
33. Zettlemoyer, L.S., St. Amant, R., and Dulberg, M.S. IBOTS: Agent Control Through the User Interface. In Proc. of IUI, 1999.