Prefab: Implementing advanced behaviors using pixel-based reverse engineering of interface structure

Conference on Human Factors in Computing Systems - Proceedings

Volumn 3, Issue , 2010, Pages 1525-1534

  Dixon, Morgan ^a   Fogarty, James ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

pixel based reverse engineering; prefab; user interface toolkits

Indexed keywords

GRAPHICAL INTERFACE; HUMAN-COMPUTER INTERACTION RESEARCHES; INTERACTION TECHNIQUES; INTERFACE STRUCTURES; SIDE VIEW; USER INTERFACE TOOLKIT; USER INTERFACE TOOLKITS;

COMPUTER SYSTEMS; GRAPHICAL USER INTERFACES; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; KNOWLEDGE MANAGEMENT; PAINT; REENGINEERING; REVERSE ENGINEERING;

PIXELS;

EID: 77954024190     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1753326.1753554     Document Type: Conference Paper

References (27)

1. Baudisch, P., Tan, D.S., Collomb, M., Robbins, D., Hinckley, K., Agrawala, M., Zhao, S. and Ramos, G. (2006). Phosphor: Explaining Transitions in the User Interface using Afterglow Effects. Proc. of the ACM Symposium on User Interface Software and Technology (UIST 2006), 169-178.
2. Edwards, W.K., Hudson, S.E., Marinacci, J., Rodenstein, R., Rodriguez, T. and Smith, I. (1997). Systematic Output Modification in a 2D User Interface Toolkit. Proc. of the ACM Symposium on User Interface Software and Technology (UIST 1997), 151-158.
3. Grossman, T. and Balakrishnan, R. (2005). The Bubble Cursor: Enhancing Target Acquisition by Dynamic Resizing of the Cursor's Activation Area. Proc. of the ACM Conference on Human Factors in Computing Systems (CHI 2005), 281-290.
4. Hartmann, B., Wu, L., Collins, K. and Klemmer, S.R. (2007). Programming by a Sample: Rapidly Creating Web Applications with d.Mix. Proc. of the ACM Symposium on User Interface Software and Technology (UIST 2007), 241-250.
5. Hudson, S.E. (1991). Incremental Attribute Evaluation: A Flexible Algorithm for Lazy Update. ACM Transactions on Programming Languages and Systems (TOPLAS), 13(3). 315-341.
6. Hudson, S.E., Mankoff, J. and Smith, I. (2005). Extensible Input Handling in the subArctic Toolkit. Proc. of the ACM Conference on Human Factors in Computing Systems (CHI 2005), 381-390.
7. Hudson, S.E. and Smith, I. (1997). Supporting Dynamic Downloadable Appearances in an Extensible User Interface Toolkit. Proc. of the ACM Symposium on User Interface Software and Technology (UIST 1997), 159-168.
8. Hudson, S.E. and Tanaka, K. (2000). Providing Visually Rich Resizable Images for User Interface Components. Proc. of the ACM Symposium on User Interface Software and Technology (UIST 2000), 227-235.
9. Hurst, A., Hudson, S.E. and Mankoff, J. (2010). Automatically Identifying Targets Users Interact with During Real World Tasks. Proc. of the International Conference on Intelligent User Interfaces (IUI 2010), To Appear.
10. Hurst, A., Mankoff, J., Dey, A.K. and Hudson, S.E. (2007). Dirty Desktops: Using a Patina of Magnetic Mouse Dust to Make Common Interactor Targets Easier to Select. Proc. of the ACM Symposium on User Interface Software and Technology (UIST 2007), 183-186.
11. Hutchings, D.R. and Stasko, J. (2005). mudibo: Multiple Dialog Boxes for Multiple Monitors. Extended Abstracts of the ACM Conference on Human Factors in Computing Systems (CHI 2005), 1471-1474.
12. Myers, B.A., Hudson, S.E. and Pausch, R. (2000). Past, Present, and Future of User Interface Software Tools. ACM Transactions on Computer-Human Interaction (TOCHI), 7(1). 3-28.
13. Olsen, D.R., Hudson, S.E., Verratti, T., Heiner, J.M. and Phelps, M. (1999). Implementing Interface Attachments Based on Surface Representations. Proc. of the ACM Conference on Human Factors in Computing Systems (CHI 1999), 191-198.
14. Olsen, D.R., Taufer, T. and Fails, J.A. (2004). ScreenCrayons: Annotating Anything. Proc. of the ACM Symposium on User Interface Software and Technology (UIST 2004), 165-174.
15. Potter, R. (1993). Triggers: Guiding Automaton with Pixel to Achieve Data Access. A. Cypher, eds. MIT Press.
16. Rissanen, J. (1978). Modeling by Shortest Data Description. Automatica 14(5). 465-471.
17. Russell, S. and Norvig, P. (2002). Artificial Intelligence: A Modern Approach. Prentice Hall.
18. St. Amant, R., Lieberman, H., Potter, R. and Zettlemoyer, L.S. (2000). Visual Generalization in Programming by Example. Communications of the ACM 43(3). 107-114.
19. St. Amant, R., Riedl, M.O., Ritter, F.E. and Reifers, A. (2005). Image Processing in Cognitive Models with SegMan. Proc. of the International Conference on Human-Computer Interaction (HCII 2005).
20. Stuerzlinger, W., Chapuis, O., Phillips, D. and Roussel, N. (2006). User Interface Façades: Towards Fully Adaptable User Interfaces. Proc. of the ACM Symposium on User Interface Software and Technology (UIST 2006), 309-318.
21. Tan, D.S., Meyers, B.R. and Czerwinski, M. (2004). WinCuts: Manipulating Arbitrary Window Regions for More Effective Use of Screen Space. Extended Abstracts of the ACM Conference on Human Factors in Computing Systems (CHI 2004), 1525-1528.
22. Terry, M. and Mynatt, E.D. (2002). Side Views: Persistent, On-Demand Previews for Open-Ended Tasks. Proc. of the ACM Symposium on User Interface Software and Technology (UIST 2002), 71-80.
23. Wobbrock, J.O., Fogarty, J., Liu, S., Kimuro, S. and Harada, S. (2009). The Angle Mouse: Target-Agnostic Dynamic Gain Adjustment Based on Angular Deviation. Proc. of the ACM Conference on Human Factors in Computing Systems (CHI 2009), 1401-1410.
24. Worden, A., Walker, N., Bharat, K. and Hudson, S.E. (1997). Making Computers Easier for Older Adults to Use: Area Cursors and Sticky Icons. Proc. of the ACM Conference on Human Factors in Computing Systems (CHI 1997), 266-271.
25. Yeh, T., Change, T.-H. and Miller, R.C. (2009). Sikuli: Using GUI Screenshots for Search and Automation. Proc. of the ACM Symposium on User Interface Software and Technology (UIST 2009), 183-192.
26. Zettlemoyer, L.S. and St. Amant, R. (1999). A Visual Medium for Programmatic Control of Interactive Applications. Proc. of the ACM Conference on Human Factors in Computing Systems (CHI 1999), 199-206.
27. Zettlemoyer, L.S., St. Amant, R. and Dulberg, M.S. (1998). IBOTS: Agent Control Through the User Interface. Proc. of the International Conference on Intelligent User Interfaces (IUI 1998), 31-37.