Automatically generating personalized user interfaces with Supple

Artificial Intelligence

Volumn 174, Issue 12-13, 2010, Pages 910-950

  Gajos, Krzysztof Z ^a,b   Weld, Daniel S ^a   Wobbrock, Jacob O ^c  

^a University of Washington   (United States)

^b HARVARD UNIVERSITY   (United States)

^c UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Ability based user interfaces; Adaptation; Automatic user interface generation; Optimization; Personalized user interfaces; Supple

Indexed keywords

ABILITY-BASED USER INTERFACES; ADAPTATION; AUTOMATIC USER INTERFACE GENERATION; AUTOMATICALLY GENERATED; COGNITIVE ABILITY; COMPUTER HUMAN INTERFACE; DESIGN CRITERION; EXACT SOLUTION; HUMAN USERS; INPUT AND OUTPUTS; INTERFACE DESIGNERS; INTERFACE DESIGNS; INTERFACE GENERATION; LARGE SOLUTIONS; MOTOR IMPAIRMENTS; OPTIMIZATION PROBLEMS; PERSONALIZATIONS; PERSONALIZED INTERFACE; RUNTIME ADAPTATION; RUNTIMES; SCALABLE SOLUTION; USER INTERFACE GENERATION; WORST CASE;

AUTOMOBILE EXHIBITIONS; COST FUNCTIONS; DESIGN; OPTIMIZATION;

USER INTERFACES;

EID: 77953712541     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2010.05.005     Document Type: Article

References (94)

1. Abrams M., Phanouriou C., Batongbacal A.L., Williams S.M., and Shuster J.E. UIML: An appliance-independent XML user interface language. WWW '99: Proceedings of the Eighth International Conference on World Wide Web (1999), Elsevier North-Holland, Inc., New York, NY, USA 1695-1708
2. Accot J., and Zhai S. Refining Fitts' law models for bivariate pointing. CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2003), ACM Press, New York, NY, USA 193-200
3. Agrawala M., and Stolte C. Rendering effective route maps: Improving usability through generalization. In: Fiume E. (Ed). SIGGRAPH 2001, Computer Graphics Proceedings (2001), ACM Press/ACM SIGGRAPH 241-250
4. Aitchison J. The Lognormal Distribution (1976), Cambridge University Press, Cambridge
5. Bergman E., and Johnson E. Towards accessible human-computer interaction. Advances in Human-Computer Interaction 5 1 (1995)
6. Bodart F., Hennebert A.M., Leheureux J.M., Provot I., Sacre B., and Vanderdonckt J. Towards a systematic building of software architectures: The TRIDENT methodological guide. Design, Specification and Verification of Interactive Systems (1995), Springer, Wien 262-278
7. Borning A., and Duisberg R. Constraint-based tools for building user interfaces. ACM Transactions on Graphics (TOG) 5 4 (1986) 345-374
8. Alan Borning, Kim Marriott, Peter Stuckey, Yi Xiao, Solving linear arithmetic constraints for user interface applications, in: Proceedings of the 1997 ACM Symposium on User Interface Software and Technology, October 1997, pp. 87-96
9. Bouillon L., Vanderdonckt J., and Kwok Chieu C. Flexible re-engineering of web sites. IUI '04: Proceedings of the 9th International Conference on Intelligent User Interfaces (2004), ACM, New York, NY, USA 132-139
10. Buxton B. Sketching User Experiences: Getting the Design Right and the Right Design (Interactive Technologies) (April 2007), Morgan Kaufmann
11. M. Dawe, Desperately seeking simplicity: How young adults with cognitive disabilities and their families adopt assistive technologies, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2006, pp. 1143-1152
12. Dixon M., and Fogarty J. Prefab: Implementing advanced behaviors using pixel-based reverse engineering of interface structure. Proceedings of CHI '10 (2010), ACM, New York, NY, USA
13. Fichten C.S., Barile M., Asuncion J.V., and Fossey M.E. What government, agencies, and organizations can do to improve access to computers for postsecondary students with disabilities: Recommendations based on Canadian empirical data. Int. J. Rehabil. Res. 23 3 (2000) 191-199
14. Leah Findlater, Joanna McGrenere, A comparison of static, adaptive, and adaptable menus, in: Proceedings of ACM CHI 2004, 2004, pp. 89-96
15. Fitts P.M. The information capacity of the human motor system in controlling the amplitude of movement. J. Exp. Psychol. 47 6 (June 1954) 381-391
16. Florins M., Montero Simarro F., Vanderdonckt J., and Michotte B. Splitting rules for graceful degradation of user interfaces. AVI '06: Proceedings of the Working Conference on Advanced Visual Interfaces (2006), ACM, New York, NY, USA 59-66
17. Fogarty J., Forlizzi J., and Hudson S.E. Aesthetic information collages: generating decorative displays that contain information. UIST '01: Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (2001), ACM, New York, NY, USA 141-150
18. James Fogarty, Scott E. Hudson, GADGET: A toolkit for optimization-based approaches to interface and display generation, in: Proceedings of UIST '03, Vancouver, Canada, 2003
19. Krzysztof Gajos, David Christianson, Raphael Hoffmann, Tal Shaked, Kiera Henning, Jing Jing Long, Daniel S. Weld, Fast and robust interface generation for ubiquitous applications, in: Proceedings of Ubicomp '05, Tokyo, Japan, 2005
20. Krzysztof Gajos, Raphael Hoffmann, Daniel S. Weld, Improving user interface personalization, in: Supplementary Proceedings of UIST '04, Santa Fe, NM, 2004
21. Gajos K., and Weld D.S. Supple: Automatically generating user interfaces. Proceedings of the 9th International Conference on Intelligent User Interface (2004), ACM Press, Funchal, Madeira, Portugal 93-100
22. Krzysztof Gajos, Daniel S. Weld, Preference elicitation for interface optimization, in: Proceedings of UIST 2005, Seattle, WA, USA, 2005
23. Gajos K., Wu A., and Weld D.S. Cross-device consistency in automatically generated user interfaces. Proceedings of Workshop on Multi-User and Ubiquitous User Interfaces (MU3I '05) (2005)
24. Gajos K.Z., Czerwinski M., Tan D.S., and Weld D.S. Exploring the design space for adaptive graphical user interfaces. AVI '06: Proceedings of the Working Conference on Advanced Visual Interfaces (2006), ACM Press, New York, NY, USA 201-208
25. Gajos K.Z., Everitt K., Tan D.S., Czerwinski M., and Weld D.S. Predictability and accuracy in adaptive user interfaces. CHI '08: Proceedings of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (2008), ACM, New York, NY, USA 1271-1274
26. Gajos K.Z., Long J.J., and Weld D.S. Automatically generating custom user interfaces for users with physical disabilities. Assets '06: Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility (2006), ACM, New York, NY, USA 243-244
27. Gajos K.Z., Wobbrock J.O., and Weld D.S. Automatically generating user interfaces adapted to users' motor and vision capabilities. UIST '07: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (2007), ACM Press, New York, NY, USA 231-240
28. Gajos K.Z., Wobbrock J.O., and Weld D.S. Improving the performance of motor-impaired users with automatically-generated, ability-based interfaces. CHI '08: Proceedings of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (2008), ACM, New York, NY, USA 1257-1266
29. Greenberg S. The Computer User as Toolsmith: The Use, Reuse, and Organization of Computer-based Tools (1993), Cambridge University Press
30. Grossman T., and Balakrishnan R. A probabilistic approach to modeling two-dimensional pointing. ACM Transactions on Computer-Human Interaction (TOCHI) 12 3 (2005) 435-459
31. Harada S., Wobbrock J.O., and Landay J.A. Voicedraw: A voice-driven hands-free drawing application. ASSETS '07 (2007), ACM Press
32. Hartmann A.K., and Weigt M. Phase Transitions in Combinatorial Optimization Problems: Basics, Algorithms and Statistical Mechanics (2006), Wiley-VCH
33. Hartmann A.K., and Weigt M. Statistical mechanics perspective on the phase transition in vertex covering of finite-connectivity random graphs. Theoretical Computer Science 265 1-2 (August 2001) 199-225
34. Hayes P.J., Szekely P.A., and Lerner R.A. Design alternatives for user interface management systems based on experience with cousin. CHI '85: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (1985), ACM, New York, NY, USA 169-175
35. Hinckley K., Cutrell E., Bathiche S., and Muss T. Quantitative analysis of scrolling techniques. CHI '02: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2002), ACM Press, New York, NY, USA 65-72
36. Hodes T.D., Katz R.H., Servan-Schreiber E., and Rowe L. Composable ad-hoc mobile services for universal interaction. MobiCom '97: Proceedings of the 3rd Annual ACM/IEEE International Conference on Mobile Computing and Networking (1997), ACM, New York, NY, USA 1-12
37. Holm S. A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics 6 65-70 (1979) 1979
38. A. Hornof, A. Cavender, R. Hoselton, Eyedraw: A system for drawing pictures with eye movements, in: Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility, 2004, pp. 86-93
39. Hwang F., Keates S., Langdon P., and Clarkson J. Mouse movements of motion-impaired users: a submovement analysis. Assets '04: Proceedings of the 6th International ACM SIGACCESS Conference on Computers and Accessibility (2004), ACM Press, New York, NY, USA 102-109
40. Janssen C., Weisbecker A., and Ziegler J. Generating user interfaces from data models and dialogue net specifications. CHI '93: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (1993), ACM, New York, NY, USA 418-423
41. Keates S., Langdon P., Clarkson J.P., and Robinson P. User models and user physical capability. User Modeling and User-Adapted Interaction 12 2 (June 2002) 139-169
42. H.H. Koester, Abandonment of speech recognition by new users, in: Proceedings of the 26th Annual Conference of the Rehabilitation Engineering and Assistive Technology Society of North America (RESNA '03), Atlanta, Georgia, June 19-23, 2003
43. Kohavi R., Henne R.M., and Sommerfield D. Practical guide to controlled experiments on the web: Listen to your customers not to the HiPPO. KDD '07: Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2007), ACM, New York, NY, USA 959-967
44. B. Lafreniere, A. Bunt, J. Whissell, C. Clarke, M. Terry, Characterizing large-scale use of a direct manipulation application in the wild, Technical Report CS-2009-27, David R. Cheriton School of Computer Science, University of Waterloo, 2009
45. Lamberti F., and Sann A. Extensible GUIs for remote application control on mobile devices. IEEE Computer Graphics and Applications 28 4 (2008) 50-57
46. C.M. Law, A. Sears, K.J. Price, Issues in the categorization of disabilities for user testing, in: Proceedings of HCII, 2005
47. Lawler E.L., and Wood D.E. Branch-and-bound methods: A survey. Operations Research 14 4 (1966) 699-719
48. Lin J., and Landay J.A. Employing patterns and layers for early-stage design and prototyping of cross-device user interfaces. CHI '08: Proceedings of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (2008), ACM, New York, NY, USA 1313-1322
49. Littel R.C., Milliken G.A., Stroup W.W., and Wolfinger R.D. SAS System for Mixed Models (1996), SAS Institute, Inc., Cary, NC
50. Mackay W.E. Triggers and barriers to customizing software. CHI '91: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (1991), ACM Press, New York, NY, USA 153-160
51. MacKenzie S.I., and Buxton W. Extending Fitts' law to two-dimensional tasks. CHI '92: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (1992), ACM Press, New York, NY, USA 219-226
52. McGrenere J., Baecker R.M., and Booth K.S. An evaluation of a multiple interface design solution for bloated software. CHI '02: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2002), ACM Press, New York, NY, USA 164-170
53. McGrenere J., Baecker R.M., and Booth K.S. A field evaluation of an adaptable two-interface design for feature-rich software. ACM Transactions on Computer-Human Interaction 14 1 (May 2007)
54. Meskens J., Vermeulen J., Luyten K., and Coninx K. Gummy for multi-platform user interface designs: Shape me, multiply me, fix me, use me. AVI '08 (2008), ACM Press
55. Mitten L.G. Branch-and-bound methods: General formulation and properties. Operations Research 18 1 (1970) 24-34
56. Myers B., Hudson S.E., and Pausch R. Past, present, and future of user interface software tools. ACM Transactions on Computer-Human Interaction 7 1 (March 2000) 3-28
57. Jeffrey Nichols, Brad A. Myers, Michael Higgins, Joe Hughes, Thomas K. Harris, Roni Rosenfeld, Mathilde Pignol, Generating remote control interfaces for complex appliances, in: CHI Letters: ACM Symposium on User Interface Software and Technology, UIST '02, Paris, France, 2002
58. Nichols J., Myers B.A., and Rothrock B. UNIFORM: automatically generating consistent remote control user interfaces. CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2006), ACM Press, New York, NY, USA 611-620
59. Nichols J., Rothrock B., Chau D.H., and Myers B.A. HUDDLE: automatically generating interfaces for systems of multiple connected appliances. UIST '06: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (2006), ACM Press, New York, NY, USA 279-288
60. Stina Nylander, Markus Bylund, Annika Waern, The ubiquitous interactor - device independent access to mobile services, in: Proceedings of the Conference on Computer Aided Design of User Interfaces (CADUI '2004), Funchal, Portugal, 2004
61. Olsen D.R. A programming language basis for user interface. CHI '89: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (1989), ACM Press, New York, NY, USA 171-176
62. Olsen D.R., Jefferies S., Nielsen T., Moyes W., and Fredrickson P. Cross-modal interaction using xweb. UIST '00: Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology (2000), ACM, New York, NY, USA 191-200
63. Reinhard Oppermann, Helmut Simm, Adaptability: User-initiated individualization, in: Adaptive User Support: Ergonomic Design of Manually and Automatically Adaptable Software Table of Contents, 1994, pp. 14-66
64. Paganelli L., and Paterno F. Automatic reconstruction of the underlying interaction design of web applications. SEKE '02: Proceedings of the 14th International Conference on Software Engineering and Knowledge Engineering (2002), ACM, New York, NY, USA 439-445
65. Palen L. Social, individual and technological issues for groupware calendar systems. CHI '99: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (1999), ACM, New York, NY, USA 17-24
66. Fabio Paterno, Cristiano Mancini, Silvia Meniconi, ConcurTaskTrees: A diagrammatic notation for specifying task models, in: INTERACT, 1997, pp. 362-369
67. Paterno F., Santoro C., Mantyjarvi J., Mori G., and Sansone S. Authoring pervasive multimodal user interfaces. Int. J. Web Eng. Technol. 4 2 (2008) 235-261
68. Phillips B., and Zhao H. Predictors of assistive technology abandonment. Assistive Technology 5 1 (1993) 36-45
69. Shankar Ponnekanti, Brian Lee, Armando Fox, Pat Hanrahan, Terry Winograd, ICrafter: A service framework for ubiquitous computing environments, in: Proceedings of Ubicomp 2001, 2001, pp. 56-75
70. Prosser P. An empirical study of phase transitions in binary constraint satisfaction problems. Artificial Intelligence 81 1-2 (March 1996) 81-109
71. David Reitter, Erin Panttaja, Fred Cummins, UI on the fly: Generating a multimodal user interface, in: Proceedings of Human Language Technology Conference 2004/North American Chapter of the Association for Computational Linguistics (HLT/NAACL-04), 2004
72. Kai Richter, Jeffrey Nichols, Krzysztof Gajos, Ahmed Seffah (Eds.), Proceedings of the CHI '06 Workshop on the Many Faces of Consistency in Cross Platform Design, 2006
73. Russell S., and Norvig P. Artificial Intelligence: A Modern Approach (1995), Prentice-Hall
74. Saffer D. Designing for Interaction: Creating Smart Applications and Clever Devices (Voices that Matter). 1st edition (July 2006), Peachpit Press
75. Schuster C., and Von Eye A. The relationship of ANOVA models with random effects and repeated measurement designs. Journal of Adolescent Research 16 2 (March 2001) 205-220
76. Sears A. Layout appropriateness: A metric for evaluating user interface widget layout. Software Engineering 19 7 (1993) 707-719
77. Sears A., and Shneiderman B. Split menus: Effectively using selection frequency to organize menus. ACM Transactions on Computer-Human Interaction 1 1 (1994) 27-51
78. Sharp H., Rogers Y., and Preece J. Interaction Design: Beyond Human-Computer Interaction. 2nd edition (March 2007), Wiley
79. Sukaviriya P., Foley J.D., and Griffith T. A second generation user interface design environment: the model and the runtime architecture. CHI '93: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (1993), ACM Press, New York, NY, USA 375-382
80. Szekely P., Luo P., and Neches R. Facilitating the exploration of interface design alternatives: The humanoid model of interface design. CHI '92: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (1992), ACM, New York, NY, USA 507-515
81. Szekely P.A., Sukaviriya P.N., Castells P., Muthukumarasamy J., and Salcher E. Declarative interface models for user interface construction tools: the mastermind approach. Proceedings of the IFIP TC2/WG2.7 Working Conference on Engineering for Human-Computer Interaction (1966), Chapman & Hall, Ltd., London, UK 120-150
82. J. Vanderdonckt, F. Bodart, The "Corpus Ergonomicus": A comprehensive and unique source for human-machine interface guidelines, in: Proceedings of 1st International Conference on Applied Ergonomics ICAE, in: Advances in Applied Ergonomics, 1996, pp. 162-169
83. Vanderdonckt J.M., and Bodart F. Encapsulating knowledge for intelligent automatic interaction objects selection. CHI '93: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (1993), ACM, New York, NY, USA 424-429
84. Vermunt J.K. Log-linear Models for Event Histories (1997), Sage Publications
85. Vollick I., Vogel D., Agrawala M., and Hertzmann A. Specifying label layout style by example. UIST '07: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (2007), ACM, New York, NY, USA 221-230
86. Alan Wexelblat, Pattie Maes, Footprints: History-rich tools for information foraging, in: CHI, 1999, pp. 270-277
87. Wiecha C., Bennett W., Boies S., Gould J., and Greene S. ITS: A tool for rapidly developing interactive applications. ACM Transactions on Information Systems (TOIS) 8 3 (1990) 204-236
88. Wilcoxon F. Individual comparisons by ranking methods. Biometrics Bulletin 1 6 (1945) 80-83
89. Williams C.P., and Hogg T. Exploiting the deep structure of constraint problems. Artificial Intelligence 70 1-2 (1994) 73-117
90. Winship C., and Mare R.D. Regression models with ordinal variables. American Sociological Review 49 4 (1984) 512-525
91. Wobbrock J.O., Ringel Morris M., and Wilson A.D. User-defined gestures for surface computing. CHI '09: Proceedings of the 27th International Conference on Human Factors in Computing Systems (2009), ACM, New York, NY, USA 1083-1092
92. Zanden B.V., and Myers B.A. Automatic, look-and-feel independent dialog creation for graphical user interfaces. CHI '90: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (1990), ACM, New York, NY, USA 27-34
93. Zhou M.X., and Aggarwal V. An optimization-based approach to dynamic data content selection in intelligent multimedia interfaces. UIST '04: Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (2004), ACM Press 227-236
94. Zhou M.X., Wen Z., and Aggarwal V. A graph-matching approach to dynamic media allocation in intelligent multimedia interfaces. IUI '05: Proceedings of the 10th International Conference on Intelligent User Interfaces (2005), ACM Press 114-121