User involvement: A review of the benefits and challenges

Behaviour and Information Technology

Volumn 22, Issue 1, 2003, Pages 1-16

  Kujala, Sari ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

COST EFFECTIVENESS; CUSTOMER SATISFACTION; INFORMATION TECHNOLOGY; PRODUCT DEVELOPMENT; SYSTEMS ENGINEERING; USABILITY ENGINEERING;

USER INVOLVEMENT; USER SATISFACTION;

HUMAN COMPUTER INTERACTION;

EID: 0037273087     PISSN: 0144929X     EISSN: None     Source Type: Journal    
DOI: 10.1080/01449290301782     Document Type: Article

References (104)

1. Annett, J. and Stanton, N. A. (eds) 2000, Task Analysis (London: Taylor & Francis).
2. Baecker, R. M., Grudin, J., Buxton, W.S. and Greenberg, S. (eds), 1995, Readings in Human-Computer Interaction: Toward the Year 2000 (CA: Morgan-Kauffman Publishers).
3. Barki, H. and Hartwick, J. 1991, User participation and user involvement in information system development. Proceedings of the Twenty-Fourth Annual Hawaii International Conference on System Sciences, 1991. Volume iv, pp. 487-492.
4. Baroudi, J. J., Olson, M. H. and Ives, B. 1986, An empirical study of the impact of user involvement on system usage and information satisfaction. Communications of the ACM, 29(3), 232-238.
5. Bauersfeld, K. and Halgren, S. 1996, "You've got three days!" Case studies in field techniques for the time-challenged. In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design (New York: Wiley), pp. 177-196.
6. Bekker, M. and Long, J. 2000, User involvement in the design of human-computer interactions: Some similarities and differences between design approaches. In S. McDonald, Y. Waern and G. Cockton (eds) People and Computers XIV (Proceedings of HCI'2000) (London: Springer), pp. 135-147.
7. Beyer, H. and Holtzblatt, K. 1996, Contextual techniques. Interactions, 3(6), 44-50.
8. Beyer, H. and Holtzblatt, K. 1998, Contextual Design: Defining Customer-Centered Systems (San Francisco: Morgan Kaufmann Publishers).
9. Beyer, H. and Holtzblatt, K. 1999, Contextual Design. Interactions, 6(1), 32-42.
10. Bias, R. G. and Mayhew, D. J. (eds) 1994, Cost-Justifying Usability (San Diego, CA: Academic Press).
11. Blackburn, J., Scudder, G. and van Wassenhove, L. N. 2000, Concurrent Software Development. Communications of the ACM, 43(11), 200-214.
12. Blomberg, J., Giacomi, J., Mosher, A. and Swenton-Hall, P. 1993, Ethnographic field methods and their relation to design. In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices (Hillsdale, NJ: Lawrence Erlbaum), pp. 123-155.
13. Blomberg, J., Suchman, L. and Trigg, R. H. 1996, Reflections on work-oriented design project. Human-Computer Interaction, 11, 237-265.
14. Bly, S. 1997, Field work: Is it product work? Interaction, 4(1), 25-30.
15. Brown, D. S. 1996, The challences of user-based design in a medical equipment market. In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design (New York: Wiley), pp. 157-176.
16. Butler, M. B. 1996, Getting to know your users: Usability roundtables at Lotus development. Interactions, 3(1), 23-30.
17. Carmel, E., Whitaker, R. D. and George, J. F. 1993, PD and Joint Application Design: A transatlantic comparison. Communications of the ACM, 36(6), 40-48.
18. Chatzoglou, P. D. and Macaulay, L. A. 1996, Requirements capture and analysis: A survey of current practice. Requirements Engineering, 1(2), 75-87.
19. Checkland, P. and Scholes, J. 1990, Soft Systems Methodology in Action (New York: Wiley).
20. Cherry, C. and Macredie, R. D. 1999, The importance of context in information system design: An assessment of participatory design. Requirements Engineering, 4, 103-114.
21. Clement, A. and Van Den Besselaar, P. 1993, A retrospective look at PD projects. Communications of the ACM, 36(6), 29-37.
22. Coble, J. M., Maffit, J. S., Orland, M. J. and Kahn, M. G. 1996, Using Contextual Inquiry to discover physicians' true needs. In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design (New York: Wiley), pp. 229-248.
23. Curtis, P., Heiserman, T., Jobusch, D., Notess, M. and Webb, J. 1999, Customer-focused design data in a large, multi-site organization. Conference on human factors in computing systems (CHI), pp. 608-615.
24. Damodaran, L. 1996, User involvement in the systems design process-a practical guide for users. Behaviour & Information Technology, 15(6), 363-377.
25. Desurvire, H. W. 1994, Faster, cheaper!! Are usability inspection methods as effective as empirical testing? In J. Nielsen and R. Mack (eds) Usability Inspection Methods (New York: John Wiley & Sons).
26. Diaper, D. 1989, Task observation for Human-Computer Interaction. In D. Diaper (ed) Task Analysis for Human-Computer Interaction (New York: Wiley), pp. 210-251.
27. Dourish, P. and Button, G. 1998, On "technomethodology": Foundational relationships between ethnomethodology and system design. Human-Computer Interaction, 13, 395-432.
28. Dray, S. M. and Karat, C. 1994, Human factors cost justification for an internal development project. In J. Nielsen and R. Mack (eds) Usability Inspection Methods (New York: John Wiley & Sons).
29. Dray, S. M. and Mrazek, D. 1996, A day in the life of a family: An international ethnographic study. In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design (New York: Wiley), pp. 145-156.
30. Ehn, P. 1993, Scandinavian design: On participation and skill. In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices (Hillsdale, NJ: Lawrence Erlbaum), pp. 41-77.
31. Ehrlich, K. and Rohn, J. A. 1994, Cost justification of usability engineering: A vendor's perspective. In R. G. Bias and D. J. Mayhew (eds) Cost-Justifying Usability (San Diego, CA: Academic Press), pp. 73-110.
32. Floyd, C., Mehl, W., Reisin, F., Schmidt, G. and Wolf, G. 1989, Out of Scandinavia: Alternative approaches to software development and system development. Human-Computer Interaction, 4(4), 253-350.
33. Foster, S. T. and Franz, C. R. 1999, User involvement during information systems development: a comparison of analyst and user perceptions of system acceptance. Journal of Engineering and Technology Management, 16, 329-348.
34. Good, M. 1992, Participatory design of a portable torque-feedback device. Conference on human factors in computing systems (CHI), pp. 439-446.
35. Gould, J. D. 1988, How to design usable systems. In M. Helander, T. K. Landauer and P. Prabhu (eds) Handbook of Human-Computer Interaction, 2nd edn. (Amsterdam: Elsevier), pp. 757-789.
36. Gould, J. D., Boies, S. J., Levy, S., Richards, J. T. and Schoonard, J. 1987, The 1984 olympic message system: A test of behavioral principles of system design. Communications of the ACM, 30(9), 758-769.
37. Gould, J. D. and Lewis, C. 1985, Designing for usability: Key principles and what designers think. Communications of the ACM, 28(3), 300-311.
38. Grudin, J. 1991a, Interactive systems: Bridging the gaps between developers and users. IEEE Computer, 24(4), 59-69.
39. Grudin, J. 1991b, Systematic sources of suboptimal interface design in large product development organization. Human-Computer Interaction, 6(2), 147-196.
40. Hackos, J. T. and Redish, J. C. 1998, User and Task Analysis for Interface Design (New York: Wiley.)
41. Hawk, S. R. and Dos Santos, B. L. 1991, Successful system development: The effect of situational factors on alternate user roles. IEEE Transactions on Engineering Management, 38(4), 316-327.
42. Heinbokel, T., Sonnentag, S., Frese, M., Stolte, W. and Brodbeck, F. C. 1996, Don't underestimate the problems of user centredness in software development projects - there are many! Behaviour & Information Technology, 15(4), 226-236.
43. Hirschheim, R. 1989, User participation in practice: Experiences with participative systems design. In K. Knight (ed) Participation in Systems Development (Columbia, Maryland: GP Publishing), pp. 194-212.
44. Holtzblatt, K. and Beyer, H. 1993, Making customer-centered design work for teams. Communications of the ACM, 36(10), 93-103.
45. Hughes, J., King, V., Rodden, T. and Andersen, H. 1995, The role of ethnography in interactive systems design. Interactions, 2(2), 56-65.
46. Hughes, J. A., Randall, D. and Shapiro, D. 1992, Faltering from ethnography to design. Conference on Computer Supported Cooperative Work, pp. 115-122.
47. Hunton, J. E. and Beeler, J. D. 1997, Effects of user participation in systems development: A longitudinal field experiment. MIS Quarterly, December 1997, 359-388.
48. ISO 13407, 1999, Human-centred design processes for interactive systems. IS/TC159/SC4. International Standard.
49. Ives, B. and Olson, M. 1984, User involvement and MIS success: A review of research. Management Science, 30(5), 586-603.
50. Jeffries, R. 1997, The role of task analysis in the design of software. In M. Helander, T. K.Landauer and P. Prabhu (eds) Handbook of Human-Computer Interaction, 2nd edn. (Amsterdam: Elsevier), pp. 347-359.
51. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. 1991, User interface evaluation in the real world: A comparison of four techniques. Conference on human factors in computing systems (CHI) (New York: ACM), pp. 119-124.
52. Johnson, P. 1989, Supporting system design by analyzing current task knowledge. In D. Diaper (ed) Task Analysis for Human-Computer Interaction (New york: Wiley), pp. 161-185.
53. Juhl, D. 1996, Using field-oriented design techniques to develop consumer software products. In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design (New York: Wiley), pp. 215-228.
54. Kaasgaard, K. 2000, Software Design & Usability. Making usability research usable, A talk with Stephanie Rosenbaum (Copenhagen: Copenhagen Business School Press), pp. 153-176.
55. Karat, C. 1994, A comparison of user interface evaluation methods. In J. Nielsen and R. Mack (eds) Usability Inspection Methods (New York: John Wiley & Sons).
56. Karat, C. 1997, Cost-justifying usability engineering in the software life cycle. In M. Helander, T. K. Landauer and P. Prabhu (eds) Handbook of Human-Computer Interaction, 2nd edn. (Amsterdam: Elsevier), pp. 653-688.
57. Karat, C., Campbell, R. and Fiegel, T. 1992, Comparison of empirical testing and walkthrough methods in user interface evaluation. Conference on human factors in computing systems (CHI) (New York: ACM), pp. 397-404.
58. Karat, J. 1997, Evolving the scope of user-centered design. Communications of the ACM, 40(7), 33-38.
59. Karlsson, M. 1996, User Requirements Elicitation, A Framework for the Study of the Relation between User and Artefact. Thesis for the degree of Doctor of Philosophy (Göteborg: Chalmers University of Technology).
60. Keil, M. and Carmel, E. 1995, Customer-developer links in software development. Communications of the ACM, 38(5), 33-44.
61. Kensing, F., Simonsen, J. and Bødker, K. 1998, MUST: A method for participatory design. Human-Computer Interaction, 13(2), 167-198.
62. Kirwan, B. and Ainsworth, L. K. (eds) 1993, A guide to task analysis (London: Taylor & Francis).
63. Kituse, A. 1991, Why aren't computers... Across the Board, 28 (October), 44-48.
64. Kuhn, S. and Muller, M. J. 1993, Participatory design. Communications of the ACM, 36(6), 24-18.
65. Kujala, S. and Mäntylä, M. 2000, How effective are user studies? In S. McDonald, Y. Waern and G. Cockton (eds) People and Computers XIV (Proceedings of HCI'2000) (London: Springer), pp. 61-71.
66. Kyng, M. 1994, Scandinavian design: Users in product development. Conference on human factors in computing systems (CHI), April 24-28, 1994 (Boston, United States: ACM), pp. 3-9.
67. Lafreniére, D. 1996, Cuta: A simple, practical, low-cost approach to task analysis. Interactions, 3(5), 35-39.
68. Lewis, S., Mateas, M., Palmiter, S. and Lynch, G. 1996, Ethnographic data for product development: A collaborative process. Interactions, 3(6), 52-69.
69. Lund, A. M. 1997, Another approach to justifying the cost of usability. Interactions, 4(3), 48-56.
70. Maiden, N. A. M. and Rugg, G. 1996, ACRE: selecting methods for requirements acquisition. Software Engineering Journal, 11(3), 183-192.
71. Mantei, M. M. and Teorey, T. T. J. 1988, Cost/benefit for incorporating human factors in the software lifecycle. Communications of the ACM, 31(4), 428-439.
72. Mayhew, D. J. 1999, The Usability Engineering Lifecycle (San Francisco, Morgan Kaugmann Publishers).
73. Mayhew, D. J. and Mantei, M. 1994, A basic framework for cost-justifying usability engineering. In R. G. Bias and D. J. Mayhew (eds) Cost-Justifying Usability (San Diego, CA: Academic Press), pp. 73-110.
74. Mckeen, J. D. and Guimaraes, T. 1997, Successful strategies for user participation in systems development. Journal of Management Information Systems, 14(2), 133-150.
75. Millen, D. R. 2000, Rapid ethnography: Time deepening strategies for HCl field research. In Proceedings on Designing interactive systems: processes practices, methods, and techniques, pp. 280-286.
76. Muller, M. J., Blomberg, J. L., Carter, K. A., Dykstra, E. A., Greenbaum, J. and Halskov Madsen, K. 1991, Panel: Participatory design in Britain and North America: Responses to the "Scandinavian challenge". Conference on human factors in computing systems (CHI), pp. 389-392.
77. Muller, M. J. and Carr, R. 1996, Using the CARD and PICTIVE participatory design methods for collaborative analysis. In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design (New York: Wiley), pp. 17-34.
78. Muller, M. J., Hallewell Haslwanter, J. and Dayton, T. 1997, Participatory practices in the software lifecycle. In M. Helander, T. K. Landauer and P. Prabhu (eds) Handbook of Human-Computer Interaction, 2nd edn. (Amsterdam: Elsevier), pp. 255-297.
79. Mumford, E. 1993, The participation of users in systems design: An account of the origin, evolution, and use of the ETHICS method. In D. Schuler and A. Namioka (eds) Participatory design: Principles and practices (Hillsdale, NJ, Erlbaum), pp. 257-270.
80. Nielsen, J. 1993, Usability Engineering (London: Academic Press).
81. Nielsen, J. 1994, Heuristic evaluation. In J. Nielsen and R. Mack (eds) Usability Inspection Methods (New York: John Wiley & Sons).
82. Noyes, J. M., Starr, A. F. and Frankish, C. R. 1996, User involvement in the early stages of the development of an aircraft warning system. Behaviour & Information Technology, 15(2), 67-75.
83. Plowman, R., Rogers, Y. and Ramage, M. 1995, What are workplace studies for? The Fourth European Conference on Computer-Supported Cooperative Work, 10-14 September 1995, (Stockholm, Sweden: Kluwer), pp. 309-324.
84. Poltrock, S. E. and Grudin, J. 1994, Organizational obstacles to interface design and development: Two participant-observer studies. ACM Transactions on Computer-Human Interaction, 1(1), 52-80.
85. Ramey, J., Rowberg, A. H. and Robinson, C. 1996, Adaptation of an ethnographic method for investigation of the task domain in diagnostic radiology. In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design (New York: Wiley), pp. 1-16.
86. Reed, S. 1992, Who defines usability? You do! PC/Computing, (Dec), 220-232.
87. Richardson, J., Ormerod, T. C. and Shepherd, A. 1998, The role of task analysis in capturing requirements for interface design. Interacting with Computers, 9, 367-384.
88. Rockwell, C. 1999, Customer connection creates a winning product, building success with contextual techniques. Interactions, 6(1), 50-57.
89. Rowley, D. E. 1996, Organizational considerations in field-oriented product development: Experiences of a cross-functional team. In D. Wixon and Ramey, J. (eds) Field Methods Casebook for Software Design (New York: Wiley).
90. Saleem, N. 1996, An empirical test of the contingency approach to user participation in information systems development. Journal of Management Information Systems, 13(1), 145-166.
91. Schuler, D. and Namioka, A. (eds) 1993, Participatory Design: Principles and Practices (Hillsdale, NJ: Lawrence Erlbaum).
92. Shapiro, D. 1994, The limits of ethnography: combining social sciences for CSCW. The Conference on Computer Supported Cooperative Work (New York: ACM), pp. 417-428.
93. Simonsen, J. and Kensing, F. 1997, Using ethnography in contextual design. Communications of the ACM, 40(7), 82-88.
94. Viller, S. and Sommerville, I. 1999a, Social analysis in the requirements engineering process: from ethnography to method. International Symposium on Requirements Engineering (Limerick: IEEE Computer Soc. Press), pp. 6-13.
95. Viller, S. and Sommerville, I. 1999b, Coherence: An approach to representing ethnographic analyses in systems design. Human-Computer Interaction, 14(1&2), 9-41.
96. Wilson, A., Bekker, M., Johnson, H. and Johnson, P. 1996, Costs and benefits of user involvement in design: Practitioners' views. People and Computers XI, Proceedings of HCI'96 (London: Springer Verlag), pp. 221-240.
97. Wilson, A., Bekker, M., Johnson, P. and Johnson, H. 1997, Helping and hindering user involvement - A tale of everyday design. Conference on human factors in computing systems (CHI) (Atlanta: ACM), pp. 178-185.
98. Wixon, D. 1995, Qualitative research methods in design and development. Interactions, 2(4), 19-26.
99. Wixon, D. and Jones, S. 1996, Usability for fun and profit: A case study of the design of DEC rally version 2. In M. Rudisill, C. Lewis, P. B. Polson, T. D. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context (San Francisco: Morgan Kaufman Publishers), pp. 3-35.
100. Wixon, D., Jones, S., Tse, L. and Casady, G. 1994, Inspection and Design Reviews: Framework, history, and reflection. In J. Nielsen and R. Mack (eds) Usability Inspection Methods (New York: John Wiley & Sons).
101. Wixon, D. Pietras, C. M., Huntwork, P. K. and Muzzey, D. W. 1996, Changing the rules: A pragmatic approach to product development. In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design (New York: Wiley) pp. 57-89.
102. Wixon, D. and Ramey, J. (eds) 1996, Field Methods Casebook for Software Design (New York: Wiley).
103. Wixon, D. and Wilson, C. 1997, The usability engineering framework for product design and evaluation. In M. Helander, T. K. Landauer and P. Prabhu (eds) Handbook of Human-Computer Interaction, 2nd edn. (Amsterdam: Elsevier), pp. 653-688.
104. Wood, L. E. 1997, Semi-structured interviewing for user-centered design. Interactions, 4(2), 48-61.