Into the wild: Challenges and opportunities for field trial methods

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2011, Pages 1657-1666

  Brown, Barry ^a,b   Reeves, Stuart ^c   Sherwood, Scott ^d  

^a School of Social Sciences   (United States)

^b Mobile Life VINN Excellence Center   (Sweden)

^c UNIVERSITY OF NOTTINGHAM   (United Kingdom)

^d UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Demand characteristics; Ethnography; Field trials; Methods

Indexed keywords

DEMAND CHARACTERISTICS; ETHNOGRAPHY; EXPERIMENTAL SYSTEM; FIELD TRIAL; METHOD;

HUMAN COMPUTER INTERACTION;

EID: 79958093237     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1978942.1979185     Document Type: Conference Paper

References (31)

1. Barkhuus, L., et al. Picking Pockets on the Lawn: The Development of Tactics and Strategies in a Mobile Game. In Proceedings of UbiComp 2005, Tokyo, Japan., Springer Verlag (2005).
2. Barkhuus, L. and Rode, J. From Mice to Men: 24 years of Evaluation in CHI. Extended Proceedings of CHI 2007 (alt.chi)(2007).
3. Bell, M., et al. Interweaving mobile games with everyday life. In Proceedings of CHI 2006, ACM Press (2006), 417-426. (Pubitemid 44032126)
4. Benford, S., et al. Experiments in inhabited TV. In Proceedings of CHI 98, ACM Press (1998).
5. Benford, S., et al. The Error of our Ways: The experience of Self-Reported Position in a Location-Based Game. In Ubicomp 2004, Springer (2004).
6. Boehner, K., et al. How HCI interprets the probes. In Proceedings of CHI 2007 (2007) ACM.
7. Carter, S., et al. Exiting the cleanroom: On ecological validity and ubiquitous computing. Human Computer Interaction, 23, 1 (2008), 47-99. (Pubitemid 351437050)
8. Clandinin, D. and Connelly, F. Narrative inquiry. Jossey-Bass San Francisco, 2000.
9. Crabtree, A. Taking technomethodology seriously: hybrid change in the ethnomethodology-design relationship. Eur. J. Inf. Syst., 13, 3 (2004), 195-209. (Pubitemid 39300030)
10. Davies, N. Proof-of-concept demonstrators and other evils of application-led research. Proceedings of UbiApp Workshop, Ubicomp 2005(2005).
11. Dourish, P. and Adler, A. Your place or mine? Learning from long-term use of audio-video communication. Computer Supported Cooperative Work (CSCW), 5, 1 (1996), 33-62. (Pubitemid 126708369)
12. Feyerabend, P. Against method. Verso Books, 1993.
13. Gaver, B., et al. Design: Cultural probes. interactions, 6, 1 (1999).
14. Gaver, W. Cultural commentators: Non-native interpretations as resources for polyphonic assessment. International journal of human-computer studies, 65, 4 (2007), 292-305. (Pubitemid 46216837)
15. Gaver, W., et al. Anatomy of a failure: how we knew when our design went wrong, and what we learned from it. Proceedings of CHI 2009(2009).
16. Harper, R. H. R., et al. Locating systems at work. Interacting With Computers, 4, 3 (1992), 343-363.
17. Hutchinson, H., et al. Technology probes: inspiring design for and with families. CHI '03: Proceedings of the SIGCHI conference on Human factors in computing systems(2003).
18. Intille, S., et al. A living laboratory for the design and evaluation of ubiquitous computing technologies. In Proceedings of CHI 2005 (2005), 1941-1944 ACM New York, NY, USA.
19. Jones, S. Was there a Hawthorne effect? American Journal of Sociology(1992), 451-468.
20. Kjeldskov, J., et al. Is it worth the hassle? Exploring the added value of evaluating the usability of context-aware mobile systems in the field. In Proceedings of MobileHCI 2004 (2004), 61-73.
21. Lee, M. L. and Dey, A. K. Lifelogging memory appliance for people with episodic memory impairment. In Proceedings of the 10th international conference on Ubiquitous computing (2008), 44-53 ACM.
22. Ljungblad, S. and Holmquist, L. Transfer scenarios: grounding innovation with marginal practices. ACM, City, 2007.
23. Mauthner, N., et al. The data are out there, or are they? Implications for archiving and revisiting qualitative data. Sociology, 32, 4 (1998), 733-745. (Pubitemid 128366986)
24. McMillan, D., et al. Further into the wild: Running worldwide trials of mobile systems. Pervasive Computing(2010), 210-227.
25. Pousman, Z., et al. Living with tableau machine: a longitudinal investigation of a curious domestic intelligence. In Proceedings of Ubicomp 2008 (2008), 370-379 ACM.
26. Robinson, M. Design for unanticipated use. In Proceedings of ECSCW 1993 (1993), 187-202 Kluwer Academic Publishers.
27. Rogers, Y, et al. Why It's Worth the Hassle: The Value of In-Situ Studies When Designing Ubicomp. In Proceedings of Ubicomp 2007 (2007).
28. Root, R. W. Design of a multi-media vehicle for social browsing. In Proceedings of CSCW 1988 (1988) ACM Press.
29. Smith, I. E., et al. Social Disclosure of Place: From Location Technology to Communication Practices. In Pervasive 2005 (2005), 134-151.
30. Tolmie, P. and Crabtree, A. Deploying research technology in the home. In Proceedings of the 2008 ACM conference on Computer supported cooperative work (2008), 639-648 ACM.
31. Whittaker, S., et al. Let's stop pushing the envelope and start addressing it: a reference task agenda for HCI. Hum.-Comput. Interact., 15, 2 (2000), 75-106. (Pubitemid 32251320)