Automatically identifying targets users interact with during real world tasks

International Conference on Intelligent User Interfaces, Proceedings IUI

Volumn , Issue , 2010, Pages 11-20

  Hurst, Amy ^a   Hudson, Scott E ^a   Mankoff, Jennifer ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Computer accessibility; Pointing input; Target identification; Usability analysis

Indexed keywords

AFFORDANCES; DATA SETS; HUMAN PERFORMANCE ASSESSMENT; HYBRID APPROACH; HYBRID SOLUTION; MACHINE-LEARNING; OPERATING SYSTEMS; REAL WORLD SETTING; REAL-WORLD TASK; TARGET IDENTIFICATION; USABILITY ANALYSIS; VISUAL CUES;

APPLICATION PROGRAMMING INTERFACES (API); COMPUTER OPERATING SYSTEMS; COMPUTER VISION; USER INTERFACES;

TARGETS;

EID: 77951109801     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1719970.1719973     Document Type: Conference Paper

References (28)

1. Accot, J. and Zhai, S., (2002), More than dotting the i's - foundations for crossing-based interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, pp. 73-80.
2. St. Amant, R., Lieberman, H., Potter, R., and Zettlemoyer, L., (2000), Programming by example: visual generalization in programming by example. In Communications of the ACM, ACM Press, 43, 3, pp. 107- 114.
3. St. Amant, R. and Riedl, M. O., A perception/action substrate for cognitive modeling in HCI. In International Journal of Human-Computer Studies, Elsevier, 55(1), pp. 15-39.
4. Chapuis, O., Blanch, R., and Beaudouin-Lafon, M., (2007), Fitts' Law in the Wild: A Field Study of Aimed Movements. Technical Report n.1480, LRI, Univ. Paris-Sud, France, December 2007, 11 pages.
5. Fitts, P.M., (1954), The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement. In Journal of Experimental Psychology, 47, pp. 381-391.
6. Forsyth, D. and Ponce, J., (2002), Computer Vision - A Modern Approach, 1st edition, Prentice Hall.
7. Findlater, L. and McGrenere, J., (2004), A comparison of static, adaptive, and adaptable menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Press, pp. 89-96.
8. Freund, Y. and Schapire. R.E., (1996), Experiments with a new boosting algorithm. In Proceedings of Machine Learning, Morgan Kaufmann, pp. 148-156.
9. Hurst, A., Mankoff, J., and Hudson, S. E., (2008), Understanding pointing problems in real world computing environments. In Proceedings of the ACM SIGACCESS conference on Computers and Accessibility, ACM Press, pp. 43-50.
10. ImageMagick software suite: http://www.imagemagick.org (Accessed 09/17/09
11. Iqbal, S. T. and Horvitz, E., (2007), Disruption and recovery of computing tasks: field study, analysis, and directions. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, ACM Press, pp. 677-686.
12. JAVA Advance Imaging, Template Matching https://jaistuff.dev.java.net/ (Accessed 09/17/09
13. Kaufman, D. R., Patel, V. L., Hilliman, C., Morin, P. C., Pevzner, J., Weinstock, R. S., Goland, R., Shea, S., and Starren, J., (2003), Usability in the real world: assessing medical information technologies in patient's homes. In Journal of Biomedical Informatics, 36, 1/2, pp. 45-60.
14. Keates, S., Hwang, F., Langdon, P., Clarkson, P. J., and Robinson, P., (2002), Cursor measures for motionimpaired computer users. In Proceedings of the ACM SIGACCESS conference on Computers and Accessibility, ACM Press, pp. 135-142.
15. MacKenzie, I. S., Kauppinen, T., and Silfverberg, M., (2001), Accuracy measures for evaluating computer pointing devices. In Proceedings of the SIGCHI conference on Human factors in Computing Systems, ACM Press, pp. 9-16.
16. Mankoff, J., Hudson, S. E., and Abowd, G.D., (2000), Interaction techniques for ambiguity resolution in recognition- based interfaces. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST), ACM Press, pp. 11-20.
17. Microsoft Office Outlook 2003 Step By Step, Microsoft Press, 2004.
18. Microsoft Office Powerpoint 2003 Step By Step, Microsoft Press, 2004.
19. Microsoft Office Word 2003 Step By Step, Microsoft Press, 2004.
20. Microsoft Active Accessibility API, http://msdn2.microsoft.com/enus/ library/ms697707(VS.85).aspx, accessed 9/17/09.
21. Mitchell, T., (1997), Machine Learning, McGraw-Hill.
22. Quinlan, J.R., (1993), C4.5: Programs for Machine Learning, Morgan Kaufmann.
23. Testplant Software, Eggplant Functional Tester, http://www. redstonesoftware.com/, accessed 9/17/09.
24. Trewin, S., Keates, S., and Moffatt, K., (2006), Developing steady clicks: a method of cursor assistance for people with motor impairments. In Proceedings of the ACM SIGACCESS conference on Computers and Accessibility, ACM Press, pp. 26-33.
25. Windows XP Step By Step, 2nd edition, Microsoft Press, 2005.
26. Witten, I.H. and Frank, E., (2005), Data Mining: Practical machine learning tools and techniques, 2nd Edition, Morgan Kaufmann.
27. Yeh, T., Chang, T., and Miller, R. C., (2009), Sikuli: using GUI screenshots for search and automation. In Proceedings of the ACM Symposium on User Interface Software and Technology, ACM Press, pp. 183-192.
28. Zettlemoyer, L. S. and St. Amant, R., (1999), A visual medium for programmatic control of interactive applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Press, pp. 199-206.