Direct pen interaction with a conventional graphical user interface

Human-Computer Interaction

Volumn 25, Issue 4, 2010, Pages 324-388

  Vogel, Daniel ^a   Balakrishnan, Ravin ^b  

^a MOUNT ALLISON UNIVERSITY   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

3D MOTION CAPTURE; LOGGING DATA; MOUSE USAGE; OBJECT MANIPULATION; OBSERVATIONAL STUDY; OFFICE APPLICATIONS; PARAMETER SELECTION; PEN INPUT; SCREEN CAPTURE; TABLET PCS;

ERGONOMICS; ERRORS; PERSONAL COMPUTERS;

GRAPHICAL USER INTERFACES;

EID: 78650356241     PISSN: 07370024     EISSN: None     Source Type: Journal    
DOI: 10.1080/07370024.2010.499839     Document Type: Article

References (86)

1. Accot, J., & Zhai, S. (2002). More than dotting the i's-foundations for crossing-based interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Changing our World, Changing Ourselves. Minneapolis, MN: ACM.
2. Agarawala, A., & Balakrishnan, R. (2006). Keepin' it real: pushing the desktop metaphor with physics, piles and the pen. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Montréal, Canada: ACM.
3. Ahlstroem, D., Alexandrowicz, R., & Hitz, M. (2006). Improving menu interaction: a comparison of standard, force enhanced and jumping menus. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Montréal, Canada: ACM.
4. Apitz, G., & Guimbretière, F. (2004). CrossY: A crossing-based drawing application. Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology.
5. Santa Fe, NM: ACM. Autodesk. (2007). SketchBook Pro [Computer software]. Retrieved from http://www.auto.desk.com/sketchbookpro
6. Balakrishnan, R., & MacKenzie, I. S. (1997). Performance differences in the fingers, wrist, and forearm in computer input control. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Atlanta, GA: ACM.
7. Bi, X., Moscovich, T., Ramos, G., Balakrishnan, R., & Hinckley, K. (2008). An exploration of pen rolling for pen-based interaction. Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology. Monterey, CA: ACM.
8. Bricklin, D. (2002, November 22). About tablet computing old and new. Retrieved from http://www. bricklin.com/tabletcomputing.htm
9. Briggs, R. O., Dennis, A. R., Beck, B. S., & Nunamaker, J. F. (1993). Whither the pen-based interface. Journal of Management and. Information Systems, 9(3), 71-90.
10. Buxton, W. A. S. (1995). Chunking and phrasing and the design of human-computer dialogues. In Human-Computer Interaction: Toward the Year 2000 (pp. 494-499). San Francisco, CA: Morgan Kaufmann.
11. Buxton, W. A. S., Fiume, E., Hill, R., Lee, A., & Woo, C. (1983). Continuous hand-gesture driven input. Proceedings of Graphics Interface '83, 9th Conference of the Canadian Man-Computer Communications Society. Edmonton, Alberta, Canada: A. K. Peters, Ltd.
12. Buxton, W. A. S., Sniderman, R., Reeves, W., Patel, S., & Baecker, R. (1979). The evolution of the SSSP score editing tools. Computer Music Journal, 3(4), 14-25.
13. Cao, X., & Zhai, S. (2007). Modeling human performance of pen stroke gestures. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. San Jose, CA: ACM.
14. Chatty, S., & Lecoanet, P. (1996). Pen computing for air traffic control. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Common Ground. Vancouver, Canada: ACM.
15. Chen, A. (2004, May 24). Tablet PCs pass inspection.Retrieved from http://www.eweek.com
16. Dixon, M., Guimbretière, F., & Chen, N. (2008). Maximizing efficiency in crossing-based dialog boxes. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Florence, Italy: ACM.
17. Fitzmaurice, G. W., Balakrishnan, R., Kurtenbach, G., & Buxton, W. A. S. (1999). An exploration into supporting artwork orientation in the user interface. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: The CHI Is the Limit. Pittsburgh, PA: ACM.
18. Fitzmaurice, G., Khan, A., Pieké, R., Buxton, W. A. S., & Kurtenbach, G. (2003). Tracking menus. Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology.
19. Vancouver, Canada: ACM. Forlines, C., & Balakrishnan, R. (2008). Evaluating tactile feedback and direct vs. indirect stylus input in pointing and crossing selection tasks. Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems. Florence, Italy: ACM.
20. Forlines, C., Vogel, D., & Balakrishnan, R. (2006). HybridPointing: Fluid switching between absolute and relative pointing with a direct input device. Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology. Montreux, Switzerland: ACM.
21. Forsberg, A., Dieterich, M., & Zeleznik, R. (1998). The music notepad. Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology. San Francisco, CA: ACM.
22. Gajos, K., & Weld, D. S. (2004). SUPPLE: Automatically generating user interfaces. Proceedings of the 9th International Conference on Intelligent User Interfaces. Funchal, Portugal: ACM.
23. Gallenson, L. (1967). A graphic tablet display console for use under time-sharing. Proceedings of the November 14-16, 1967, Fall Joint Computer Conference. Anaheim, CA: ACM. doi:10.1145/1465611.1465703
24. Gross, M. D., & Do, E. Y. (1996). Ambiguous intentions: A paper-like interface for creative design. Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology. Seattle, WA: ACM.
25. Grossman, T., Hinckley, K., Baudisch, P., Agrawala, M., & Balakrishnan, R. (2006). Hover widgets: Using the tracking state to extend the capabilities of pen-operated devices. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Montréal, Canada: ACM.
26. Guimbretière, F., & Winograd, T. (2000). FlowMenu: Combining command, text, and data entry. Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology.
27. San Diego, CA: ACM. Gurley, B. M., & Woodward, C. E. (1959). Light-pen links computer to operator. Electronics, pp. 85-87.
28. Haider, E., Luczak, H., & Rohmert, W. (1982). Ergonomics investigations of work-places in a police command-control centre equipped with TV displays. Applied Ergonomics, 13(3), 163-170.
29. Hancock, M. S., & Booth, K. S. (2004). Improving menu placement strategies for pen input. Proceedings of Graphics Interface 2004. London, Canada: Canadian Human-Computer Communications Society.
30. Harris, J. (2005, October 6). Saddle up to the minibar. An Office User Interface Blog. Retrieved from http://blogs.msdn.com/jensenh/archive/2005/10/06/ 477801.aspx
31. Hinckley, K., Baudisch, P., Ramos, G., & Guimbretière, F. (2005). Design and analysis of delimiters for selection-action pen gesture phrases in scriboli. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Portland, OR: ACM.
32. Hinckley, K., Cutrell, E., Bathiche, S., & Muss, T. (2002). Quantitative analysis of scrolling techniques. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Changing our World, Changing Ourselves. Minneapolis, MN: ACM.
33. Hinckley, K., Guimbretière, F., Baudisch, P., Sarin, R., Agrawala, M., & Cutrell, E. (2006). The springboard: Multiple modes in one spring-loaded control. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Montréal, Canada: ACM.
34. Hinckley, K., Zhao, S., Sarin, R., Baudisch, P., Cutrell, E., Shilman, M., & Tan, D. (2007). InkSeine: In Situ search for active note taking. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. San Jose, CA: ACM.
35. Hoover, N. (2008, May 28). Microsoft unveils multi-touch technology for Windows 7. Information Week. Retrieved from http://www.informationweek.com
36. Hourcade, J. P., & Berkel, T. R. (2006). Tap or touch?: Pen-based selection accuracy for the young and old. CHI '06 Extended Abstracts on Human Factors in Computing Systems. Montréal, Canada: ACM.
37. Inkpen, K., Dearman, D., Argue, R., Comeau, M., Fu, C., Kolli, S., Moses, J., : : : Wallace, J. (2006). Left-handed scrolling for pen-based devices. International Journal of Human-Computer Interaction, 21, 91-108.
38. Jordan, B., & Henderson, A. (1995). Interaction analysis: Foundations and practice. The Journal of the Learning Sciences, 4(1), 39-103.
39. Kurtenbach, G., & Buxton, W. A. S. (1991a). GEdit: A test bed for editing by contiguous gestures. SIGCHI Bulletin, 23(2), 22-26.
40. Kurtenbach, G., & Buxton, W. A. S. (1991b). Issues in combining marking and direct manipulation techniques. Proceedings of the 4th Annual ACM Symposium on User Interface Software and Technology. Hilton Head, SC: ACM.
41. Lank, E., & Saund, E. (2005). Sloppy selection: Providing an accurate interpretation of imprecise selection gestures. Computers & Graphics, 29, 490-500.
42. Lee, J. C., Dietz, P. H., Leigh, D., Yerazunis, W. S., & Hudson, S. E. (2004). Haptic pen: A tactile feedback stylus for touch screens. Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology. Santa Fe, NM: ACM.
43. Li, Y., Hinckley, K., Guan, Z., & Landay, J. A. (2005). Experimental analysis of mode switching techniques in pen-based user interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Portland, OR: ACM.
44. Lin, J., Newman, M. W., Hong, J. I., & Landay, J. A. (2000). DENIM: Finding a tighter fit between tools and practice for Web site design. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. The Hague, the Netherlands: ACM.
45. Long, C. A. J., Landay, J. A., Rowe, L. A., & Michiels, J. (2000). Visual similarity of pen gestures. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. The Hague, the Netherlands: ACM.
46. MacKenzie, I. S., Sellen, A., & Buxton, W. A. S. (1991). A comparison of input devices in element pointing and dragging tasks. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Reaching Through Technology. New Orleans, LA: ACM.
47. Markoff, J. (2000, November 9). Microsoft sees new software based on pens. New York Times. Retrieved from http://www.nytimes.com/2000/11/09/ technology/09SOFT.html
48. Meyer, A. (1995). Pen computing: A technology overview and a vision. SIGCHI Bulletin, 27(3), 46-90.
49. Microsoft. (2009, October 22). Windows 7 Product Guide. Retrieved from http://www.microsoft.com
50. Microsoft. (n.d.). What is the touch pointer? Windows Vista Help. Retrieved November 12, 2008, from http://windowshelp.microsoft.com
51. Mizobuchi, S., & Yasumura, M. (2004). Tapping vs. circling selections on pen-based devices: evidence for different performance-shaping factors. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Vienna, Austria: ACM.
52. Moran, T. P., Chiu, P., & Melle, W. V. (1997). Pen-based interaction techniques for organizing material on an electronic whiteboard. Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology. Banff, Canada: ACM.
53. Moscovich, T., & Hughes, J. F. (2004). Navigating documents with the virtual scroll ring. Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology. Santa Fe, NM: ACM.
54. Pogue, D. (2000, November 16). Microsoft sets sights on Tablet PC market. New York Times. Retrieved from http://www.nytimes.com/2000/11/16/technology/ 16GEE1.html
55. Ramos, G., & Balakrishnan, R. (2003). Fluid interaction techniques for the control and annotation of digital video. Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology. Vancouver, Canada: ACM.
56. Ramos, G., & Balakrishnan, R. (2005). Zliding: Fluid zooming and sliding for high precision parameter manipulation. Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology. Seattle, WA: ACM.
57. Ramos, G., & Balakrishnan, R. (2007). Pressure marks. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. San Jose, CA: ACM.
58. Ramos, G., Boulos, M., & Balakrishnan, R. (2004). Pressure widgets. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Vienna, Austria: ACM.
59. Ramos, G., Cockburn, A., Balakrishnan, R., & Beaudouin-Lafon, M. (2007). Pointing lenses: facilitating stylus input through visual- and motor-space magnification. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. San Jose, CA: ACM.
60. Ramos, G., Robertson, G., Czerwinski, M., Tan, D., Baudisch, P., Hinckley, K., & Agrawala, M. (2006). Tumble! Splat! Helping users access and manipulate occluded content in 2D drawings. Proceedings of the Working Conference on Advanced Visual Interfaces. Venezia, Italy: ACM.
61. Ranjan, A., Birnholtz, J. P., & Balakrishnan, R. (2006). An exploratory analysis of partner action and camera control in a video-mediated collaborative task. Proceedings of the 2006 20th Anniversary Conference on Computer Supported Cooperative Work. Banff, Canada: ACM.
62. Ren, X., & Moriya, S. (2000). Improving selection performance on pen-based systems: a study of pen-based interaction for selection tasks. ACM Transactions on Computer-Human Interaction, 7, 384-416.
63. Schilit, B. N., Golovchinsky, G., & Price, M. N. (1998). Beyond paper: supporting active reading with free form digital ink annotations. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Los Angeles, CA: ACM.
64. Scholtz, J., Young, J., Drury, J., & Yanco, H. (2004). Evaluation of human-robot interaction awareness in search and rescue. Robotics and Automation, 2004 (Vol. 3, pp. 2327-2332). doi:10.1109/ROBOT.2004.1307409
65. Scott, S. D. (2005). Territoriality in collaborative tabletop workspaces. Unpublished doctoral dissertation. University of Calgary, Calgary, Canada.
66. Scott, S. D., Carpendale, S. M., & Inkpen, K. M. (2004). Territoriality in collaborative tabletop workspaces. Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work. Chicago, IL: ACM.
67. Sellen, A., Kurtenbach, G., & Buxton, W. A. S. (1992). The prevention of mode errors through sensory feedback. Human-Computer Interaction, 7, 141-164.
68. Shao, J., Fiering, L., & Kort, T. (2007). Dataquest insight: Tablet PCs are slowly gaining momentum (No. G00147423). Retrieved from http://www.gartner.com
69. Sharmin, S., Evreinov, G., & Raisamo, R. (2005). Non-visual feedback cues for pen computing. Eurohaptics Conference, 2005 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2005. World Haptics 2005. Washington, DC: IEEE Computer Society.
70. Shilman, M., Tan, D. S., & Simard, P. (2006). CueTIP: A mixed-initiative interface for correcting handwriting errors. Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology. Montreux, Switzerland: ACM.
71. Smith, G., Schraefel, M. C., & Baudisch, P. (2005). Curve dial: Eyes-free parameter entry for GUIs. CHI '05 Extended Abstracts on Human Factors in Computing Systems. Portland, OR: ACM.
72. Sommerich, C. M., Ward, R., Sikdar, K., Payne, J., & Herman, L. (2007). A survey of high school students with ubiquitous access to tablet PCs. Ergonomics, 50, 706-727.
73. Spooner, J. G., & Foley, M. J. (2005, August 30). Tablet PCs' future uncertain. eWeek.com. Retrieved from http://www.eweek.com
74. Stone, B., & Vance, A. (2009, October 4). Just a touch away, the elusive Tablet PC. The New York Times. Available from http://www.nytimes.com/ 2009/10/05/technology/05tablet.html
75. Strauss, A. L., & Corbin, J. M. (1998). Basics of qualitative research: Techniques and procedures for developing. Beverly Hills, CA: Sage.
76. Tian, F., Ao, X., Wang, H., Setlur, V., & Dai, G. (2007). The tilt cursor: Enhancing stimulus-response compatibility by providing 3D orientation cue of pen. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. San Jose, CA: ACM.
77. Tian, F., Xu, L., Wang, H., Zhang, X., Liu, Y., Setlur, V., & Dai, G. (2008). Tilt menu: Using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces. Proceedings of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems. Florence, Italy: ACM.
78. Truong, K. N., & Abowd, G. D. (1999). StuPad: Integrating student notes with class lectures. CHI '99 Extended Abstracts on Human Factors in Computing Systems. Pittsburgh, PA: ACM.
79. Turner, S. A., Pérez-Quiñones, M. A., & Edwards, S. H. (2007). Effect of interface style in peer review comments for UML designs. Journal of Computing Sciences in Colleges, 22, 214-220.
80. Twining, P., Evans, D., Cook, D., Ralston, J., Selwood, I., Jones, A., : : :, Scanlon, E. (2005). Tablet PCs in schools: Case study report. Conventry, UK: Becta ITC Research. Retrieved from http://publications.becta.org.uk/display. cfm?resIDD25914
81. Vogel, D., & Balakrishnan, R. (2010). Occlusion-aware interfaces. Proceedings of the 28th International Conference on Human Factors in Computing Systems. Atlanta, GA: ACM.
82. Ward, J., & Phillips, M. (1987). Digitizer technology: Performance characteristics and the effects on the user interface. Computer Graphics and Applications, IEEE, 7(4), 31-44.
83. Whitefield, A. (1986). Human factors aspects of pointing as an input technique in interactive computer systems. Applied Ergonomics, 17(2), 97-104.
84. Zhai, S., & Kristensson, P. (2003). Shorthand writing on stylus keyboard. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Ft. Lauderdale, FL: ACM.
85. Zhai, S., Smith, B. A., & Selker, T. (1997). Dual stream input for pointing and scrolling. CHI '97 Extended Abstracts on Human Factors in Computing Systems: Looking to the Future. Atlanta, GA: ACM.
86. Zuberec, S. (2000). The interaction design of Microsoft Windows CE. In E. Bergman (Ed.), Information appliances and beyond (p. 385). San Francisco, CA: Morgan Kaufmann.