A bermuda triangle? - A review of method application and triangulation in user experience evaluation

Conference on Human Factors in Computing Systems - Proceedings

Volumn 2018-April, Issue , 2018, Pages

  Pettersson, Ingrid ^a   Lachner, Florian ^b   Frison, Anna Katharina ^c   Riener, Andreas ^c   Butz, Andreas ^b  

^a VOLVO CAR CORPORATION   (Sweden)

^b UNIVERSITY OF MUNICH   (Germany)

^c JOHANNES KEPLER UNIVERSITY LINZ   (Austria)

Author keywords

Evaluation; Meta analysis; Mixed methods; Review; Triangulation; User experience; UX

Indexed keywords

HUMAN ENGINEERING; REVIEWS; SURVEYS; TRIANGULATION;

CRITICAL DISCUSSIONS; EVALUATION; META ANALYSIS; MIXED METHOD; STATE-OF-THE ART REVIEWS; USABILITY EVALUATION; USER EXPERIENCE EVALUATIONS; USER EXPERIENCES (UX);

USER EXPERIENCE;

EID: 85046960317     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3173574.3174035     Document Type: Conference Paper

References (111)

1. ∗ Muhammad Adnan, Mike Just, and Lynne Baillie. 2016. Investigating time series visualisations to improve the user experience. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5444-5455.
2. ∗ Sarah Fdili Alaoui, Baptiste Caramiaux, Marcos Serrano, and Frédéric Bevilacqua. 2012. Movement qualities as interaction modality. In Proceedings of the Designing Interactive Systems Conference. ACM, 761-769.
3. ∗ Florian Alt, Stefan Schneegass, Jonas Auda, Rufat Rzayev, and Nora Broy. 2014. Using eye-tracking to support interaction with layered 3D interfaces on stereoscopic displays. In Proceedings of the 19th international conference on Intelligent User Interfaces. ACM, 267-272.
4. ∗ David Altimira, Florian Floyd Mueller, Jenny Clarke, Gun Lee, Mark Billinghurst, and Christoph Bartneck. 2016. Digitally augmenting sports: An opportunity for exploring and understanding novel balancing techniques. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1681-1691.
5. Rui Alves, Pedro Valente, and Nuno Jardim Nunes. 2014. The state of user experience evaluation practice. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational. ACM, 93-102.
6. Craig Anslow, Pedro Campos, Andrés Lucero, Laurent Grisoni, Mirjam Augstein, and James Wallace. 2016. Collaboration Meets Interactive Surfaces and Spaces (CMIS): Walls, Tables, Mobiles, and Wearables. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS'16). ACM, New York, NY, USA, 505-508.
7. Carmelo Ardito, Maria F. Costabile, Antonella De Angeli, and Rosa Lanzilotti. 2012. Enriching Archaeological Parks with Contextual Sounds and Mobile Technology. ACM Transactions on Computer-Human Interaction 19, 4(2012), 1-30.
8. Leena Arhippainen, Minna Pakanen, and Seamus Hickey. 2013. Mixed UX Methods Can Help to Achieve Triumphs. In Proceedings of CHI 2013 Workshop'Made for Sharing: HCI Stories for Transfer, Triumph and Tragedy'. ACM, 83.
9. Javier A Bargas-Avila and Kasper Hornbæk. 2011. Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2689-2698.
10. ∗ Eric PS Baumer, Sherri Jean Katz, Jill E Freeman, Phil Adams, Amy L Gonzales, John Pollak, Daniela Retelny, Jeff Niederdeppe, Christine M Olson, and Geri K Gay. 2012. Prescriptive persuasion and open-ended social awareness: expanding the design space of mobile health. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, 475-484.
11. ∗ Luca Benedetti, Holger Winnemöller, Massimiliano Corsini, and Roberto Scopigno. 2014. Painting with bob: Assisted creativity for novices. In Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, 419-428.
12. ∗ Gilbert Beyer, Florian Alt, Jörg Müller, Albrecht Schmidt, Karsten Isakovic, Stefan Klose, Manuel Schiewe, and Ivo Haulsen. 2011. Audience behavior around large interactive cylindrical screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1021-1030.
13. Mark Blythe, Marc Hassenzahl, Effie Law, and Arnold Vermeeren. 2007. An analysis framework for user experience (UX) studies: A green paper. Towards a UX Manifesto (2007), 1.
14. ∗ Amy Campbell, Christopher Wienberg, and Andrew Gordon. 2012. Collecting relevance feedback on titles and photographs in weblog posts. In Proceedings of the 2012 ACM international conference on Intelligent User Interfaces - IUI'12. ACM Press, New York, New York, USA, 139.
15. Heloisa Candello, Claudio Pinhanez, and Flavio Figueiredo. 2017. Typefaces and the Perception of Humanness in Natural Language Chatbots. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17). ACM, New York, NY, USA, 3476-3487.
16. Marta E. Cecchinato, Anna L. Cox, and Jon Bird. 2017. Always On (Line) ?: User Experience of Smartwatches and Their Role Within Multi-Device Ecologies. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17). ACM, New York, NY, USA, 3557-3568.
17. ∗ Sandy Claes, Karin Slegers, and Andrew Vande Moere. 2016. The Bicycle Barometer: Design and Evaluation of Cyclist-Specific Interaction for a Public Display. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5824-5835.
18. John W Creswell. 2013. Research design: Qualitative, quantitative, and mixed methods approaches. Sage publications.
19. Norman K Denzin. 1978. Triangulation: A case for methodological evaluation and combination. Sociological methods (1978), 339-357.
20. Sarah Diefenbach, Nina Kolb, and Marc Hassenzahl. 2014. The'hedonic'in human-computer interaction: history, contributions, and future research directions. In Proceedings of the 2014 conference on Designing interactive systems. ACM, 305-314.
21. ISO DIS. 2009. 9241-210:2010. Ergonomics of human system interaction-Part 210: Human-centred design for interactive systems. International Standardization Organization (ISO). Switzerland (2009).
22. Graham Dove, Kim Halskov, Jodi Forlizzi, and John Zimmerman. 2017. UX Design Innovation: Challenges for Working with Machine Learning As a Design Material. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17). ACM, New York, NY, USA, 278-288.
23. Jodi Forlizzi and Katja Battarbee. 2004. Understanding experience in interactive systems. In Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques. ACM, 261-268.
24. ∗ Jutta Fortmann, Erika Root, Susanne Boll, and Wilko Heuten. 2016. Tangible Apps Bracelet: Designing Modular Wrist-Worn Digital Jewellery for Multiple Purposes. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems. ACM, 841-852.
25. ∗ Jérémy Frey, Maxime Daniel, Julien Castet, Martin Hachet, and Fabien Lotte. 2016. Framework for electroencephalography-based evaluation of user experience. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2283-2294.
26. Anna-Katharina Frison, Philipp Wintersberger, Andreas Riener, and Clemens Schartmüller. 2017. Driving Hotzenplotz: A Hybrid Interface for Vehicle Control Aiming to Maximize Pleasure in Highway Driving. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 236-244.
27. ∗ Chi-Wing Fu, Wooi-Boon Goh, and Junxiang Allen Ng. 2010. Multi-touch techniques for exploring large-scale 3D astrophysical simulations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2213-2222.
28. Wei Gai, Chenglei Yang, Yulong Bian, Chia Shen, Xiangxu Meng, Lu Wang, Juan Liu, Mingda Dong, Chengjie Niu, and Cheng Lin. 2017. Supporting Easy Physical-to-Virtual Creation of Mobile VR Maze Games: A New Genre. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17). ACM, New York, NY, USA, 5016-5028.
29. ∗ Sabiha Ghellal, Ann Morrison, Marc Hassenzahl, and Benjamin Schaufler. 2014. The remediation of nosferatu: exploring transmedia experiences. In Proceedings of the 2014 conference on Designing interactive systems. ACM, 617-626.
30. ∗ Nitesh Goyal and Susan R Fussell. 2016. Effects of Sensemaking Translucence on Distributed Collaborative Analysis. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 288-302.
31. ∗ Erik Grönvall, Sofie Kinch, Marianne Graves Petersen, and Majken K Rasmussen. 2014. Causing commotion with a shape-changing bench: experiencing shape-changing interfaces in use. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 2559-2568.
32. ∗ Jonna R Häkkilä, Maaret Posti, Stefan Schneegass, Florian Alt, Kunter Gultekin, and Albrecht Schmidt. 2014. Let me catch this!: experiencing interactive 3D cinema through collecting content with a mobile phone. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 1011-1020.
33. Daniel Harley, Aneesh P. Tarun, Daniel Germinario, and Ali Mazalek. Tangible VR: Diegetic Tangible Objects for Virtual Reality Narratives. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS'17). ACM, New York, NY, USA, 1253-1263.
34. ∗ Jennefer Hart, Alistair G Sutcliffe, and Antonella De Angeli. 2013. Love it or hate it!: interactivity and user types. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2059-2068.
35. Sandra G. Hart. 2006. Nasa-Task Load Index (NASA-TLX); 20 Years Later. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 50.
36. Marc Hassenzahl. 2004. The interplay of beauty, goodness, and usability in interactive products. Human-computer interaction 19, 4(2004), 319-349.
37. Marc Hassenzahl. 2005. The thing and I: understanding the relationship between user and product. Funology (2005), 31-42.
38. Marc Hassenzahl. 2008. User experience (UX): towards an experiential perspective on product quality. In Proceedings of the 20th Conference on l'Interaction Homme-Machine. ACM, 11-15.
39. Marc Hassenzahl, Michael Burmester, and Franz Koller. 2003. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In Mensch & Computer 2003. Springer, 187-196.
40. ∗ Renate Häuslschmid, Sven Osterwald, Marcus Lang, and Andreas Butz. 2015. Augmenting the Driver's View with Peripheral Information on a Windshield Display. In Proceedings of the 20th International Conference on Intelligent User Interfaces. ACM, 311-321.
41. ∗ Eiji Hayashi and Jason I Hong. 2015. Knock x knock: the design and evaluation of a unified authentication management system. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 379-389.
42. ∗ Eva Hornecker. 2016. The To-and-Fro of Sense Making: Supporting Users' Active Indexing in Museums. ACM Transactions on Computer-Human Interaction (TOCHI) 23, 2(2016), 10.
43. ∗ Shaohan Hu, Lu Su, Shen Li, Shiguang Wang, Chenji Pan, Siyu Gu, Md Tanvir Al Amin, Hengchang Liu, Suman Nath, Romit Roy Choudhury, and others. 2015. Experiences with eNav: A low-power vehicular navigation system. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 433-444.
44. R Burke Johnson, Anthony J Onwuegbuzie, and Lisa A Turner. 2007. Toward a definition of mixed methods research. Journal of mixed methods research 1, 2(2007), 112-133.
45. ∗ Jinyung Jung, Seok-Hyung Bae, and Myung-Suk Kim. 2013. Three case studies of UX with moving products. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. ACM, 509-518.
46. Mohsen Kamalzadeh, Christoph Kralj, Torsten Möller, and Michael Sedlmair. 2016. TagFlip: Active Mobile Music Discovery with Social Tags. In Proceedings of the 21st International Conference on Intelligent User Interfaces. ACM, 19-30.
47. Evangelos Karapanos, John Zimmerman, Jodi Forlizzi, and Jean-Bernard Martens. 2009. User experience over time: an initial framework. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 729-738.
48. Evangelos Karapanos, John Zimmerman, Jodi Forlizzi, and Jean Bernard Martens. 2010. Measuring the dynamics of remembered experience over time. Interacting with Computers 22, 5(2010), 328-335.
49. ∗ Tuula Kärkkäinen, Tuomas Vaittinen, and Kaisa Väänänen-Vainio-Mattila. 2010. I don't mind being logged, but want to remain in control: a field study of mobile activity and context logging. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 163-172.
50. Joseph 'Jofish' Kaye. 2007. Evaluating experience-focused HCI. In Proceedings of CHI 2007 Extended Abstracts on Human factors in computing systems. ACM, 1661-1664.
51. ∗ Tanyoung Kim, Hwajung Hong, and Brian Magerko. 2010. Design requirements for ambient display that supports sustainable lifestyle. In Proceedings of the 8th ACM Conference on Designing Interactive Systems. ACM, 103-112.
52. ∗ Martin Knobel, Marc Hassenzahl, Melanie Lamara, Tobias Sattler, Josef Schumann, Kai Eckoldt, and Andreas Butz. 2012. Clique Trip: feeling related in different cars. In Proceedings of the designing interactive systems conference. ACM, 29-37.
53. Klaus Krippendorff. 2004. Content Analysis: An Introduction to Its Methodology (second ed.). Sage.
54. ∗ Sari Kujala and Talya Miron-Shatz. 2013. Emotions, experiences and usability in real-life mobile phone use. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1061-1070.
55. Sari Kujala and Talya Miron-Shatz. 2015. The Evolving Role of Expectations in Long-term User Experience. In Proceedings of the 19th International Academic Mindtrek Conference (AcademicMindTrek'15). ACM, New York, NY, USA, 167-174.
56. Sari Kujala, Virpi Roto, Kaisa Väänänen-Vainio-Mattila, Evangelos Karapanos, and Arto Sinnelä. 2011. UX Curve: A method for evaluating long-term user experience. Interacting with Computers 23, 5(2011), 473-483.
57. Florian Lachner, Philipp Nägelein, Robert Kowalski, Martin Spann, and Andreas Butz. 2016. Quantified UX: Towards a Common Organizational Understanding of User Experience. In Proc. NordiCHI 2016.
58. Carine Lallemand. 2015. Towards consolidated methods for the design and evaluation of user experience. Ph. D. Dissertation. University of Luxembourg, âA NâA N Luxembourg.
59. ∗ Carine Lallemand and Guillaume Gronier. 2012. Enhancing User eXperience during waiting time in HCI: contributions of cognitive psychology. In Proceedings of the Designing Interactive Systems Conference. ACM, 751-760.
60. ∗ Airi Lampinen, Vilma Lehtinen, Coye Cheshire, and Emmi Suhonen. 2013. Indebtedness and reciprocity in local online exchange. In Proceedings of the 2013 conference on Computer supported cooperative work. ACM, 661-672.
61. Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and evaluation of a user experience questionnaire. In Symposium of the Austrian HCI and Usability Engineering Group. Springer, 63-76.
62. Effie Law, Virpi Roto, Arnold POS Vermeeren, Joke Kort, and Marc Hassenzahl. 2008. Towards a shared definition of user experience. In CHI'08 extended abstracts on Human factors in computing systems. ACM, 2395-2398.
63. Effie Lai-Chong Law. 2011. The measurability and predictability of user experience. In Proceedings of the 3rd ACM SIGCHI symposium on Engineering interactive computing systems. ACM, 1-10.
64. Effie Lai-Chong Law, Virpi Roto, Marc Hassenzahl, Arnold POS Vermeeren, and Joke Kort. 2009. Understanding, scoping and defining user experience: a survey approach. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 719-728.
65. Effie Lai-Chong Law, Paul van Schaik, and Virpi Roto. 2014. Attitudes towards user experience (UX) measurement. International Journal of Human-Computer Studies 72, 6(2014), 526-541.
66. ∗ Reeva Lederman, Greg Wadley, John Gleeson, Sarah Bendall, and Mario Álvarez-Jiménez. 2014. Moderated online social therapy: Designing and evaluating technology for mental health. ACM Transactions on Computer-Human Interaction (TOCHI) 21, 1(2014), 5.
67. ∗ Yong-Ki Lee, Youn-kyung Lim, and Kunpyo Lee. 2016. Timelessness. Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS'16(2016), 73-83.
68. Tuck W Leong, Frank Vetere, and Steve Howard. 2012. Experiencing coincidence during digital music listening. ACM Transactions on Computer-Human Interaction (TOCHI) 19, 1(2012), 6.
69. ∗ Craig M MacDonald and Michael E Atwood. 2014. What does it mean for a system to be useful?: An exploratory study of usefulness. In Proceedings of the 2014 conference on Designing interactive systems. ACM, 885-894.
70. John McCarthy and Peter Wright. 2004. Technology as experience. interactions 11, 5(2004), 42-43.
71. Elisa D Mekler, Julia Ayumi Bopp, Alexandre N Tuch, and Klaus Opwis. 2014. A systematic review of quantitative studies on the enjoyment of digital entertainment games. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 927-936.
72. Elisa D Mekler and Kasper Hornbæk. 2016. Momentary Pleasure or Lasting Meaning?: Distinguishing Eudaimonic and Hedonic User Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 4509-4520.
73. Thomas Meneweger. 2017. Experiencing Automation: UX and Practices with Automated Systems. In Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems (DIS'17 Companion). ACM, New York, NY, USA, 407-408.
74. Jaroslav Michalco, Jakob Grue Simonsen, and Kasper Hornbæk. 2015. An Exploration of the Relation between Expectations and User Experience. International Journal of Human-Computer Interaction 7318, July (2015), 150701125618002.
75. ∗ Hannah J Miller, Shuo Chang, and Loren G Terveen. 2015. I LOVE THIS SITE! vs. It's a little girly: Perceptions of and Initial User Experience with Pinterest. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 1728-1740.
76. ∗ Pejman Mirza-Babaei, Lennart E Nacke, John Gregory, Nick Collins, and Geraldine Fitzpatrick. 2013. How does it play better?: exploring user testing and biometric storyboards in games user research. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 1499-1508.
77. David Moher, Deborah J Cook, Susan Eastwood, Ingram Olkin, Drummond Rennie, and Donna F Stroup. 1999. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. The Lancet 354, 9193(1999), 1896-1900.
78. ∗ Timothy Neate, Michael Evans, and Matt Jones. 2016. Designing visual complexity for dual-screen media. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 475-486.
79. ∗ Marianna Obrist, Rob Comber, Sriram Subramanian, Betina Piqueras-Fiszman, Carlos Velasco, and Charles Spence. 2014. Temporal, affective, and embodied characteristics of taste experiences: A framework for design. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 2853-2862.
80. Marianna Obrist, Virpi Roto, and Kaisa Väänänen-Vainio-Mattila. 2009. User experience evaluation: do you know which method to use?. In CHI'09 Extended Abstracts on Human Factors in Computing Systems. ACM, 2763-2766.
81. ∗ Thomas Olsson and Markus Salo. 2012. Narratives of satisfying and unsatisfying experiences of current mobile augmented reality applications. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 2779-2788.
82. ∗ S. Joon Park, Craig M MacDonald, and Michael Khoo. 2012. Do you care if a computer says sorry?: user experience design through affective messages. In Proceedings of the Designing Interactive Systems Conference. ACM, 731-740.
83. ∗ Denis Parra, Peter Brusilovsky, and Christoph Trattner. 2014. See what you want to see: visual user-driven approach for hybrid recommendation. In Proceedings of the 19th international conference on Intelligent User Interfaces. ACM, 235-240.
84. Ingrid Pettersson, Anna-Katharina Frison, Florian Lachner, Andreas Riener, and Jesper Nolhage. 2017. Triangulation in UX Studies: Learning from Experience. In Proceedings of the 2016 ACM Conference Companion Publication on Designing Interactive Systems. ACM, 341-344.
85. Ingrid Pettersson and Wendy Ju. 2017. Design Techniques for Exploring Automotive Interaction in the Drive towards Automation. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, 147-160.
86. ∗ Erika Shehan Poole. 2012. Interacting with infrastructure: a case for breaching experiments in home computing research. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, 759-768.
87. Katharina Reinecke and Abraham Bernstein. 2011. Improving performance, perceived usability, and aesthetics with culturally adaptive user interfaces. ACM Transactions on Computer-Human Interaction (TOCHI) 18, 2(2011), 8.
88. ∗ Stefan Rennick-Egglestone, Sarah Knowles, Gill Toms, Penny Bee, Karina Lovell, and Peter Bower. 2016. Health Technologies' In the Wild': Experiences of Engagement with Computerised CBT. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2124-2135.
89. ∗ Shyam Reyal, Shumin Zhai, and Per Ola Kristensson. 2015. Performance and user experience of touchscreen and gesture keyboards in a lab setting and in the wild. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 679-688.
90. Virpi Roto, Kaisa Väänänen-Vainio-Mattila, Effie Law, and Arnold Vermeeren. 2009. User experience evaluation methods in product development (UXEM'09). In IFIP Conference on Human-Computer Interaction. Springer, 981-982.
91. Virpi Roto, Heli Väätäjä, Effie Law, and Rachel Powers. 2016. Experience Design for Multiple Customer Touchpoints. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI'16). ACM, New York, NY, USA, Article 146, 3 pages.
92. ∗ Yea-Kyung Row and Tek-Jin Nam. 2014. CAMY: applying a pet dog analogy to everyday ubicomp products. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 63-74.
93. Elizabeth B-N Sanders. 2002. From user-centered to participatory design approaches. Design and the social sciences: Making connections 1, 8 (2002).
94. ∗ Magy Seif El-Nasr, Bardia Aghabeigi, David Milam, Mona Erfani, Beth Lameman, Hamid Maygoli, and Sang Mah. 2010. Understanding and Evaluating Cooperative Games. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'10). ACM, New York, NY, USA, 253-262.
95. ∗ Jaemyung Shin, Bumsoo Kang, Taiwoo Park, Jina Huh, Jinhan Kim, and Junehwa Song. 2016. BeUpright: Posture Correction Using Relational Norm Intervention. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 6040-6052.
96. ∗ Johanna M Silvennoinen and Jussi PP Jokinen. 2016. Aesthetic Appeal and Visual Usability in Four Icon Design Eras. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 4390-4400.
97. Adalberto L Simeone, Ming Ki Chong, Corina Sas, and Hans Gellersen. 2015. Select & Apply: understanding how users act upon objects across devices. Personal and Ubiquitous Computing 19, 5-6(2015), 881-896.
98. Samaneh Soleimani and Effie Lai-Chong Law. 2017. What Can Self-Reports and Acoustic Data Analyses on Emotions Tell Us?. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS'17). ACM, New York, NY, USA, 489-501.
99. ∗ Jacopo Staiano, María Menéndez, Alberto Battocchi, Antonella De Angeli, and Nicu Sebe. 2012. UX-Mate: from facial expressions to UX evaluation. In Proceedings of the Designing Interactive Systems Conference. ACM, 741-750.
100. ∗ S Shyam Sundar, Jeeyun Oh, Saraswathi Bellur, Haiyan Jia, and Hyang-Sook Kim. 2012. Interactivity as self-expression: a field experiment with customization and blogging. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 395-404.
101. Alexandre N Tuch, Rune Trusell, and Kasper Hornbæk. 2013. Analyzing users' narratives to understand experience with interactive products. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 2079-2088.
102. ∗ Daisuke Uriu, Mizuki Namai, Satoru Tokuhisa, Ryo Kashiwagi, Masahiko Inami, and Naohito Okude. 2012. Panavi: recipe medium with a sensors-embedded pan for domestic users to master professional culinary arts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 129-138.
103. Kaisa Väänänen-Vainio-Mattila, Virpi Roto, and Marc Hassenzahl. 2008. Towards practical user experience evaluation methods. Meaningful measures: Valid useful user experience measurement (VUUM) (2008), 19-22.
104. Koen van Turnhout, Arthur Bennis, Sabine Craenmehr, Robert Holwerda, Marjolein Jacobs, Ralph Niels, Lambert Zaad, Stijn Hoppenbrouwers, Dick Lenior, and René Bakker. 2014. Design patterns for mixed-method research in HCI. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational. ACM, 361-370.
105. ∗ Aditya Vashistha, Edward Cutrell, Gaetano Borriello, and William Thies. 2015. Sangeet swara: A community-moderated voice forum in rural india. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 417-426.
106. ∗ Yolanda Vazquez-Alvarez, Matthew P Aylett, Stephen A Brewster, Rocio Von Jungenfeld, and Antti Virolainen. 2016. Designing Interactions with Multilevel Auditory Displays in Mobile Audio-Augmented Reality. ACM Transactions on Computer-Human Interaction (TOCHI) 23, 1(2016), 3.
107. Arnold POS Vermeeren, Effie Lai-Chong Law, Virpi Roto, Marianna Obrist, Jettie Hoonhout, and Kaisa Väänänen-Vainio-Mattila. 2010. User experience evaluation methods: current state and development needs. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries. ACM, 521-530.
108. Froukje Sleeswijk Visser, Pieter Jan Stappers, Remko Van der Lugt, and Elizabeth BN Sanders. 2005. Contextmapping: experiences from practice. CoDesign 1, 2(2005), 119-149.
109. ∗ Qing Wang and Huiyou Chang. 2010. Multitasking bar: prototype and evaluation of introducing the task concept into a browser. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 103-112.
110. Rina R. Wehbe, Edward Lank, and Lennart E. Nacke. 2017. Left Them 4 Dead: Perception of Humans Versus Non-Player Character Teammates in Cooperative Gameplay. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS'17). ACM, New York, NY, USA, 403-415.
111. ∗ Jong-bum Woo and Youn-kyung Lim. 2015. User experience in do-it-yourself-style smart homes. In Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing. ACM, 779-790.