Towards the temporally perfect virtual button: Touch-feedback simultaneity and perceived quality in mobile touchscreen press interactions

ACM Transactions on Applied Perception

Volumn 11, Issue 2, 2014, Pages

  Kaaresoja, Topi ^a   Brewster, Stephen ^b   Lantz, Vuokko ^a  

^a NOKIA RESEARCH CENTER   (United States)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Audio; Feedback; Mobile device; Simultaneity; Tactile; Temporal perception; Touch; Touchscreen

Indexed keywords

FASTENERS; FEEDBACK; MAXIMUM LIKELIHOOD ESTIMATION; MOBILE DEVICES; VISUAL COMMUNICATION;

AUDIO; SIMULTANEITY; TACTILE; TEMPORAL PERCEPTION; TOUCH; TOUCHSCREEN;

TOUCH SCREENS;

EID: 84906855971     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/2611387     Document Type: Article

References (32)

1. B. D. Adelstein, D. R. Begault, M. R. Anderson, and E. M. Wenzel. 2003. Sensitivity to haptic-audio asynchrony. In Proceedings of the 5th International Conference on Multimodal Interfaces. ACM Press, New York, NY, 73-76. DOI:http://dx.doi.org/10.1145/958432.958448.
2. E. Boring. 1923. A History of Experimental Psychology. Pendragon, New York, NY.
3. S. Brewster. 2002. Overcoming the lack of screen space on mobile computers. Personal and Ubiquitous Computing 6, 188-205. DOI:http://dx.doi.org/ 10.1007/s007790200019.
4. S. Brewster, F. Chohan, and L. Brown. 2007. Tactile feedback for mobile interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'07). ACM Press. DOI:http://dx.doi.org/10.1145/1240624. 1240649.
5. S. Coren, L. M. Ward, and J. T. Enns. 2003. Sensation and Perception. Wiley & Sons.
6. S. Exner. 1875. Experimentelle Untersuchung der einfachsten psychischen Processe. Archiv für die gesamte Physiologie des Menschen und der Tiere 11, 403-432.
7. W. Fujisaki, S. Shimojo, M. Kashino, and S. Y. Nishida. 2004. Recalibration of audiovisual simultaneity. Nature Neuroscience 7, 773-778.
8. M. Fukumoto and T. Sugimura. 2001. Active click: Tactile feedback for touch panels. In Proceedings of Extended Abstracts on Human Factors in Computing (CHIEA'01). ACM Press, New York, NY, 121-122. DOI:http://dx.doi.org/10.1145/ 634067.634141.
9. V. Harrar and L. R. Harris. 2005. Simultaneity constancy: Detecting events with touch and vision. Experimental Brain Research 166, 465-473. DOI:http://dx.doi.org/10.1007/s00221-005-2386-7.
10. L. R. Harris, V. Harrar, P. Jaekl, and A. Kopinska. 2010. Mechanisms of simultaneity constancy. In Space and Time in Perception and Action, R. Nijhawan (Ed.). Cambridge University Press, Cambridge, UK, 232-253. DOI:http://dx.doi. org/10.1017/CBO9780511750540.015.
11. D. He, F. Liu, D. Pape, G. Dawe, and D. Sandin. 2000. Video-based measurement of system latency. In Proceedings of the IPT2000 International Immersive Projection Technology Workshop.
12. E. Hoggan, S. A. Brewster, and J. Johnston. 2008. Investigating the effectiveness of tactile feedback for mobile touchscreens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'08). 1573-1582. DOI:http://dx.doi.org/10.1145/1357054.1357300.
13. C. Jay and R. Hubbold. 2005. Delayed visual and haptic feedback in a reciprocal tapping task. In Proceedings of the 1st Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE Computer Society, Washington, DC, 655-656.
14. R. Jota, A. Ng, P. Dietz, and D. Widgor. 2013. How fast is fast enough?: A study of the effects of latency in direct-touch pointing tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press, New York, NY, 2291- 2300. DOI:http://dx.doi.org/10.1145/2470654.2481317.
15. T. Kaaresoja, E. Anttila, and E. Hoggan. 2011a. The effect of tactile feedback latency in touchscreen interaction. In Proceedings of the World Haptics Conference (WHC). IEEE Computer Society, Washington, DC, 65-70.
16. T. Kaaresoja and S. Brewster. 2010. Feedback is. . . late: Measuring multimodal delays in mobile device touchscreen interaction. In Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction (ICMI-MLMI'10). ACM Press, New York, NY, Article 2. DOI:http://dx.doi.org/10.1145/1891903.1891907.
17. T. Kaaresoja, L. M. Brown, and J. Linjama. 2006. Snap-crackle-pop: Tactile feedback for mobile touch screens. In Proceedings of Eurohaptics 2006. 565-566.
18. T. Kaaresoja, E. Hoggan, and E. Anttila. 2011b. Playing with tactile feedback latency in touchscreen interaction: Two approaches. In Proceedings of the 13th IFIP TC 13th International Conference on Human-Computer Interaction-Volume Part II (INTERACT' 11). Springer-Verlag, Berlin, Heidelberg, 554-571.
19. D. J. Levitin, K. Maclean, M. Mathews, and L. Chu. 1999. The perception of cross-modal simultaneity. In Proceedings of the 3rd International Conference on Computing Anticipatory Systems. 1999.
20. S. MacKenzie and C. Ware. 1993. Lag as a determinant of human performance in interactive systems. In Proceedings of the INTERACT'93 and CHI'93 Conference on Human Factors in Computing Systems (CHI'93). ACM Press, New York, NY, 488- 493.
21. R. C. Miall and J. K. Jackson. 2006. Adaptation to visual feedback delays in manual tracking: Evidence against the Smith Predictor model of human visually guided action. Experimental Brain Research 172, 1, 77-84.
22. R. B. Millar. 2011. Maximum Likelihood Estimation and Inference: With Examples in R, SAS and ADMB. John Wiley & Sons, West Sussex, United Kingdom.
23. D. Miller and G. Bishop. 2002. Latency meter: A device for easily monitoring VE delay. In Proceedings of SPIE Vol. #4660 Stereoscopic Displays and Virtual Reality Systems IX, San Jose, CA.
24. G. A. Miller. 1956. The magical number seven plus or minus two: Some limits on our capacity for processing information. Psychological Review 63, 81-97.
25. A. Ng, J. Lepinski, D. Widgor, S. Sanders, and P. Dietz. 2012. Designing for low-latency direct-touch input. In Proceedings of the UIST'12, St Andrews, UK, 2012, ACM, 453-464. DOI: http://dx.doi.org/10.1145/2380116.2380174.
26. I. Poupyrev and S. Maruyama. 2003. Tactile interfaces for small touch screens. In Proceedings of the 16th Annual Symposium on User Interface Software and Technology (UIST'03). ACM Press, New York, NY, 217-220. DOI:http://dx.doi. org/10.1145/964696.964721.
27. I. Poupyrev, M. Okabe, and S. Maruyama. 2004. Haptic feedback for pen computing: Directions and strategies. In Proceedings of Extended Abstracts on Human Factors in Computing Systems (CHIEA'04). ACM Press, New York, NY, 1309-1312. DOI:http://dx.doi.org/10.1145/985921.986051.
28. J. V. Stone, N. M. Hunkin, J. Porrill, R. Wood, V. Keeler, M. Beanland, M. Port, and N. R. Porter. 2001. When is now? Perception of Simultaneity. Proceedings of the Royal Society of London: Series B, 31-38.
29. J. W. Tukey. 1977. Exploratory Data Analysis. Addison-Wesley.
30. I. M. L. C. Vogels. 2004. Detection of temporal delays in visual-haptic interfaces. Human Factors 46, 118-134.
31. R. Winter, V. Harrar, M. Gozdzik, and L. R. Harris. 2008. The relative timing of active and passive touch. Brain Research 1242, 54-58.
32. M. Zampini, S. Guest, D. I. Shore, and C. Spence. 2005. Audio-visual simultaneity judgments. Perception and Psychophysics 67, 531-544.