Adapting evaluation to study behaviour in context

International Journal of Mobile Human Computer Interaction

Volumn 1, Issue 2, 2009, Pages 37-55

  Sherwood, Scott ^a   Reeves, Stuart ^a   Maitland, Julie ^a   Morrison, Alistair ^a   Chalmers, Matthew ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Adaptive evaluation; Evaluation techniques; Methodology; Ubicomp

Indexed keywords

EMBEDDED SYSTEMS;

ADAPTIVE EVALUATION; EVALUATION CRITERIA; EVALUATION TECHNIQUES; IN CONTEXTS; METHODOLOGY; UBICOMP; UBIQUITOUS COMPUTING SYSTEMS; UBIQUITOUS SYSTEMS;

UBIQUITOUS COMPUTING;

EID: 77949349243     PISSN: 1942390X     EISSN: 19423918     Source Type: Journal    
DOI: 10.4018/jmhci.2009040103     Document Type: Article

References (30)

1. Barkhuus, L., Chalmers, M., Tennent, P., Hall, M., Bell, M., Sherwood, S. & Brown, B. (2005) Picking Pockets on the Lawn: The Development of Tactics and Strategies in a Mobile Game. In Beigl, M., Intille, S., Rekimoto, J., & Tokuda, H. (Eds.) Ubicomp, (pp. 358-374). Tokyo: Springer
2. Barkhuus L., Brown B., Bell M., Sherwood S., Hall M. & Chalmers M. (2008) From Awareness to Repartee: Sharing Location within Social Groups. In Czerwinski, M., Lund A., M. & Tan, D., S. (Eds.) CHI, (pp. 497-506), Florence: ACM.
3. Bell, M., Chalmers, M., Barkhuus, L., Hall, M., Sherwood, S., Tennent, P., Brown, B., Rowland, D., Benford, S. & Hampshire, A. (2006) Interweaving Mobile Games with Everyday Life. In Olson, G., M. & Jeffries, R. (Eds.) CHI, (pp. 417-426), Montreal: ACM Press.
4. Benford, S., Rowland, D., Flintham, M., Drozd, A., Hull, R., Reid, J., Morrison, J. & Facer, K. (2005) Life on the edge: supporting collaboration in location-based experiences. In van der Veer, G., C. & Gale, C. (Eds.) CHI (pp. 721-730), Portland: ACM.
5. Benford, S., Seager, W., Flintham, M., Anastasi, R., Rowland, D., Humble, J., Stanton, D., Bowers, J., Tandavanitj, N., Adams, M., Row-Farr, J., Oldroyd, A., & Sutton, J. (2004) The error of our ways: The experience of self-reported position in a location-based game. In Davies, N., Mynatt, E. & Siio, I. (Eds.) Ubicomp (pp.70-87), Nottingham: Springer.
6. Carter, S. & Mankoff J. (2005) Prototypes in the Wild: Lessons Learned from Evaluating Three Ubicomp Systems, Pervasive, 4(4), 51-57.
7. Carter, S., Mankoff, J., & Heer, J. (2007) Momento: Support for Situated Ubicomp Experimentation. In Rosson, M., B. & Gilmore, D., J. (Eds.) CHI, (pp. 125-134), San Jose: ACM Press.
8. Cheok, A. D., Fong, S. W., Goh, K. H., Yang, X., Liu, W., & Farzbiz, F. (2003). Human Pacman: a sensing-based mobile entertainment system with ubiquitous computing and tangible interaction. In Jamin., S. (Ed.) NetGames (pp. 106-117), Redwood City: ACM Press.
9. Consolvo, S. & Walker, M. (2003) Using the Experience Sampling Method to Evaluate Ubicomp Applications. Pervasive Computing, 2(2), 24-31.
10. Crabtree, A., Benford, S., Capra, M., Flintham, M., Drozd, A., Tandavanitj, N., Adams, M., & Row-Farr, J. (2007) The Cooperative Work of Gaming: Orchestrating a Mobile SMS Game. CSCW 16(1-2), 167-198.
11. Crabtree, A, Benford, S., Greenhalgh, C., Tennent, P., Chalmers, M., & Brown, B. (2006) Supporting Ethnographic Studies of Ubiquitous Computing in the Wild. In Carroll, J., M. (Ed.) DIS (pp. 60-69) Pennsylvania: ACM.
12. Crabtree, A., Benford, S., Rodden, T., Greenhalgh, C., Flintham, M., Anastasi, R., Drozd, A., Adams, M., Row-Farr, J., Tandavanitj, N., & Steed, A. (2004) Orchestrating a mixed reality game 'on the ground'. In Dykstra-Erickson, E. & Tscheligi, M. (Eds.) CHI (pp. 391-398), Vienna: ACM.
13. Crabtree, A. & Rodden, T. (2004) Domestic Routines and Design for the Home. CSCW 13(2), 191-220.
14. de Sá, M., Carriço, L., Duarte, L., & Reis, T. (2008) A framework for mobile evaluation. In In Czerwinski, M., Lund A., M. & Tan, D., S. (Eds.) Ext. Abs. CHI (pp. 2673-2678), Florence: ACM.
15. Denzin, N. (1978) Sociological Methods: A Sourcebook, NY: McGraw Hill, 2nd ed
16. Demiris, G., Oliver, D., Dickey, G., Skubic, M. & Rantz, M. (2007) Findings from a participatory evaluation of a smart home application for older adults. Technology and Health Care, 16, 111-118.
17. Dourish, P. (2004) What We Talk About When We Talk About Context. Personal and Ubiquitous Computing, 8(1), 19-30.
18. Froehlich, J., Chen, M. Y., Consolvo, S., Harrison, B., & Landay, J. A. ( 2007) My-Experience: a system for in situ tracing and capturing of user feedback on mobile phones. In Knightly, E., W., Borriello, G. & Carceres, R. (Eds.) MobiSys (pp. 57-70), San Juan: ACM.
19. Grant, L., Daanen, H., Benford, S., Hampshire, A., Drozd, A., & Greenhalgh, C. (2007) MobiMissions: the game of missions for mobile phones. In Swanson, J. (Ed.) SIGGRAPH 2007 Educators Program, San Diego: ACM.
20. Goodwin, M.H. (1980) He-Said-She-Said: Formal cultural Procedures for the Construction of a Gossip Dispute Activity. In American Ethnologist, 7 (4). 674-695.
21. Greenhalgh, C., French, A., Tennant, P., Humble, J., & Crabtree, A. (2007) From replay tool to digital replay system. In Online Proceedings of E-Social Science, Ann Arbor: ESRC/NSF.
22. Macefield, R. (2007) Usability Studies and the Hawthorne Effect. Journal of Usability Studies, 2(3), 145-154.
23. Mackay, W.E. & Fayard, A-L. (1997) HCI, Natural Science and Design: A Framework for Triangulation Across Disciplines. In Coles, S. (Ed.) Designing Interactive Systems. (pp. 223-234), Amsterdam: ACM.
24. Maitland, J., Sherwood, S., Barkhuus, L., Anderson, I., Hall, M., Brown, B., Chalmers, M. & Muller, H. (2006) Increasing the Awareness of Daily Activity Levels with Pervasive Computing. In Bardram, J., E., Chachques, J., C. & Varshney, U. (Eds.) Pervasive Computing Technologies for Healthcare (pp.1-9) Innsruck: IEEE.
25. Morrison, A., Tennent, P. & Chalmers, M. (2006) Coordinated Visualisation of Video and System Log Data. In Andrienko, G., Roberts, J., C. & Weaver, C. (Eds.) Coordinated and Multiple Views in Exploratory Visualization (pp. 91-102), Zurich: IEEE.
26. Rice, B. (1982). The Hawthorne defect: Persistence of a flawed theory. Psychology Today, 16(2), 70-4.
27. Scholtz, J. & Consolvo, S. (2004) Toward a Framework for Evaluating Ubiquitous Computing Applications. Pervasive Computing, 3(2), 82-88.
28. Vogiazou, Y., Reid, J., Raijmakers, B., & Eisenstadt, M. (2006) A research process for designing ubiquitous social experiences. In Mørch, A., Morgan, K., Bratteteig, T., Ghosh, G. & Svanaes, D. (Eds.), NordiCHI, (pp. 86-95), Oslo: ACM Press.
29. Want, R., Hopper, A., Falcao, V. & Gibbons, J. (1992) The active badge location system. Transactions on Information Systems, 10(1), 91-102.
30. Wilson, C. E. (2006.) Triangulation: the explicit use of multiple methods, measures, and approaches for determining core issues in product development. interactions 13(6), 46-ff