Expanding the criteria for evaluating socio-technical software

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans

Volumn 38, Issue 4, 2008, Pages 777-790

  Whitworth, Brian ^a   Bañuls, Victor ^b   Sylla, Cheickna ^c   Mahinda, Edward ^c  

^a MASSEY UNIVERSITY   (New Zealand)

^b UNIVERSIDAD PABLO DE OLAVIDE   (Spain)

^c NEW JERSEY INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Sociotechnical; Software requirements; System performance; Technology assessment

Indexed keywords

DECISION THEORY; HIERARCHICAL SYSTEMS;

(E ,2E) THEORY; (N-1) CRITERION; (OTDR) TECHNOLOGY; ANALYTIC HIERARCHY; COMPREHENSIVE EVALUATION; EVALUATION CRITERIONS; EVALUATION FRAMEWORK; PERCEIVED EASE OF USE (PEOU); PERCEIVED USEFULNESS (PU); PERFORMANCE EVALUATION (PE); SOCIO TECHNICAL; SYSTEM PERFORMANCES; TECHNOLOGY ACCEPTANCE MODEL (TAM);

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 46649107716     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2008.923038     Document Type: Article

References (90)

1. J. C. Westland and T. H. K. Clark, Global Electronic Commerce. Cambridge, MA: MIT Press, 2000.
2. P. B. Seddon, V. Graeser, and L. P. Willcocks, "Measuring organizational IS effectiveness: An overview and update of senior management perspectives," ACM SIGMIS Database, vol. 33, no. 2, pp. 11-28, 2002.
3. S. Taylor and P. A. Todd, "Assessing IT usage: The role of prior experience," MIS Q., vol. 19, no. 4, pp. 561-570, Dec. 1995.
4. E. Brynjolfsson, "The productivity paradox of information technology," Commun. ACM, vol. 36, no. 12, pp. 66-77, Dec. 1993.
5. M. Y. Ivory and M. A. Hearst, "The state of the art in automating usability evaluation ofuser interfaces," ACM Comput. Surv., vol. 33, no. 4, pp. 470-516, Dec. 2001.
6. W. J. Orlikowski and D. G. Gash, "Technological frames: Making sense of information technology in organizations," ACM Trans. Inf. Syst., vol. 12, no. 2, pp. 174-207, Apr. 1994.
7. J. R. Ralston, Voltaire's Bastards. New York: Penguin Books, 1993.
8. B. N. Reeves and A. C. Lemke, "The problem as a moving target in cooperative system design," in Proc. ITCI Consortium Workshop, Jan. 1991.
9. J. Grudin, "Human factors, CHI and MIS," in Advances in Manage. Inf. Syst., P. Zhang and D. Galletta, Eds. Armonk, NY: M. E. Sharpe, 2005.
10. M. Fishbein and I. Ajzen, Belief Attitude, Intention and Behaviour: An Introduction to Theory and Research. Reading, MA: Addison-Wesley, 1975.
11. F. D. Davis and V. Venkatesh, "A critical assessment of potential measurement biases in the technology acceptance model: Three experiments," Int. J. Human-Comput. Stud., vol. 45, no. 1, pp. 19-45, Jul. 1996.
12. F. D. Davis, "Perceived usefulness, perceived ease of use, and user acceptance of information technology," Manage. Inf. Syst. Q., vol. 13, no. 3, pp. 319-340, Sep. 1989.
13. D. Hix and R. S. Schulman, "Human-computer interface development tools: A methodology for their evaluation," Commun. ACM, vol. 34, no. 3, pp. 75-87, Mar. 1991.
14. J. Lin and H. Lu, "Towards an understanding of the behavioral intention to use a web site," Int. J. Inf. Manage., vol. 20, no. 3, pp. 197-208, Jun. 2000.
15. L. Vijayasarathy, "Predicting consumer intentions to use on-line shopping: The case for an augmented technology acceptance model," Inf. Manage., vol. 41, no. 6, pp. 747-762, Jul. 2004.
16. V. Lai and H. Li, "Technology acceptance model for internet banking: An invariance analysis," Inf. Manage., vol. 42, no. 2, pp. 373-386, Jan. 2005.
17. H. Heijden, "Factors influencing the usage of websites: The case of a generic portal in The Netherlands," Inf. Manage., vol. 40, no. 6, pp. 541-549, Jul. 2003.
18. P. Legris, J. Ingham, and P. Collerette, "Why do people use information technology? A critical review of the technology acceptance model," Inf. Manage., vol. 40, no. 3, pp. 191-204, Jan. 2003.
19. V. Venkatesh and M. G. Morris, "Why don't men ever stop to ask for directions? Gender, social influence, and their role in technology acceptance and usage behavior," MIS Q., vol. 24, no. 1, pp. 115-139, Mar. 2000.
20. I. Brown, "Individual and technological factors affecting perceived ease of use of web-based learning technologies in a developing country," Electron. J. Inf. Syst. Dev. Ctries., vol. 9, no. 5, pp. 1-15, 2002.
21. V. Venkatesh, "Determinants of perceived ease of use: Integrating control, intrinsic motivation, and emotion into the technology acceptance model," Inf. Syst. Res., vol. 11, no. 4, pp. 342-365, Dec. 2000.
22. J. Moon and Y. Kim, "Extending the TAM for a World-Wide-Web context," Inf. Manage., vol. 38, no. 4, pp. 217-230, Feb. 2001.
23. C. Ong, J. Lai, and Y. Wang, "Factors affecting engineer's acceptance of asynchronous e-learning systems in high-tech companies," Inf. Manage., vol. 41, no. 6, pp. 795-804, Jul. 2004.
24. H. Shih, "An empirical study on predicting user acceptance of e-shopping on the Web," Inf. Manage., vol. 41, no. 3, pp. 351-368, Jan. 2004.
25. J. Yu et al., "Extending the TAM for a t-commerce," Inf. Manage., vol. 42, no. 7, pp. 965-976, Oct. 2005.
26. I. Benbasat and H. Barki, "Quo Vadis TAM," J. Assoc. Inf. Syst., vol. 8, no. 4, pp. 212-218, Apr. 2007.
27. L. Festinger, A Theory of Cognitive Dissonance. Stanford, CA: Stanford Univ. Press, 1957.
28. V. Venkatesh and M. G. Morris, "User acceptance of information technology: Toward a unified view," MIS Q., vol. 27, no. 3, pp. 425-478, Sep. 2003.
29. S. E. Asch, Social Psychology. New York: Prentice-Hall, 1952.
30. R. S. Crutchfield, "Conformity and character," Amer. Psychol., vol. 10, pp. 191-198, 1955.
31. M. Lea and R. Spears, "Computer-mediated communication, de-individuation and group decision-making," Int. J. Man-Mach. Stud. vol. 34, no. 2, pp. 283-301, Feb. 1991.
32. T. Postmes, "Social influence in computer-mediated groups," Ph.D. dissertation, Univ. Amsterdam, Amsterdam, The Netherlands, 1997.
33. B. Whitworth, B. Gallupe, and R. McQueen, "Generating agreement in computer-mediated groups," Small Group Res., vol. 32, no. 5, pp. 625-665, 2001.
34. B. Whitworth, "Polite computing," Behav. Inf. Technol., vol. 24, no. 5, pp. 353-363, Sep. 2005. [Online]. Available: http:// brianwhitworth.com/polite.rtf
35. P. J. Hu et al., "Examining the technology acceptance model using physician acceptance of telemedicine technology," J. Manage. Inf. Syst., vol. 16, no. 2, pp. 91-112, Sep. 1999.
36. I. Sommerville, Software Engineering, 7th ed. Upper Saddle River, NJ: Pearson Educ., 2004.
37. D. Compeau, C. A. Higgins, and S. Huff, "Social cognitive theory and individual reactions to computing technology: A longitudinal study," MIS Q., vol. 23, no. 2, pp. 145-158, Jun. 1999.
38. G. Moore and I. Benbasat, "Development of an instrument to measure the perceptions of adopting an information technology innovation," Inf. Syst. Res., vol. 2, no. 3, pp. 192-222, Sep. 1991.
39. K. E. Boulding, "General systems theory -The skeleton of science," Manage. Sci., vol. 2, no. 3, pp. 197-208, Apr. 1956.
40. J. Grudin, "The computer reaches out: The historical continuity of user interface design," in Proc. CHI, ACM SIGCHI Conf., Seattle, WA, 1990, pp. 261-268.
41. K. Kuutti, "Activity theory as a potential framework for human-computer interaction," in Research Context and Consciousness: Activity Theory and Human-Computer Interaction, B. A. Nardi, Ed. Cambridge, MA: MIT Press, 1996.
42. S. Alter, "A general, yet useful theory of information systems," Commun. AIS, vol. 1, no. 3, pp. 13-60, Mar. 1999.
43. C. E. Shannon and W. Weaver, The Mathematical Theory of Communication Urbana, IL: Univ. Illinois Press, 1949.
44. B. Whitworth, "Social-technical systems," in Encyclopedia of Human Computer Interaction, C. Ghaoui, Ed. London, U.K.: Idea Group Reference, 2006, pp. 533-541.
45. B. Whitworth, B. Gallupe, and R. J. McQueen, "A cognitive three-process model of computer-mediated group interaction," Group Decis. Negot. vol. 9, no. 5, pp. 431-456, Sep. 2000.
46. F. Losavio et al., "Designing quality architecture: Incorporating ISO standards into the unified process," Inf. Syst. Manage., vol. 21, no. 1, pp. 27-44, Dec. 2004.
47. T. Berners-Lee, Weaving the Web: The Original Design and Ultimate Destiny of the World Wide Web. New York: Harper-Collins, 2000.
48. A. Gargaro et al., "The power of standards," Commun. ACM, vol. 36, no. 8, pp. 11-12, Aug. 1993.
49. M. De Simone and R. Kazman, "Software architectural analysis: An experience report," in Proc. CASCON, Toronto, ON, Canada, 1995.
50. K. Knoll and S. L. Jarvenpaa, "Information technology alignment or 'fit' in highly turbulent environments: The concept of flexibility," in Proc. SIGCPR, Alexandria, VA, 1994.
51. P. Regan, Legislating Privacy, Technology, Social Values and Public Policy. Chapel Hill, NC: Univ. North Carolina Press, 1995.
52. J. C. Laprie and A. Costes, "Dependability: A unifying concept for reliable computing," in Proc 12th Int. Symp. Fault-Tolerant Comput. 1982, pp. 18-21.
53. Guidelines for the Security of Information Systems, OECD, Paris, France, 1996, p. 50.
54. E. Jonsson, "An integrated framework for security and dependability," in Proc. NSPW, Charlottsville, VA, 1998, pp. 22-29.
55. G. Gediga, K. Hamborg, and I. Duntsch, "The IsoMetrics usability inventory: An operationalization of ISO9241-10 supporting summative and formative evaluation of software systems," Behav. Inf. Technol., vol. 18, no. 3, pp. 151-164, 1999.
56. B. Nuseibeh and S. Easterbrook, Requirements Engineering: A Roadmap, in the Future of Software Engineering, A. Finkelstein, Ed. Limerick, Ireland: ACM Press, 2000.
57. J. G. Walls, G. R. Widmeyer, and O. A. El Sawy, "Building and information system design theory for vigilant EIS," Inf. Syst. Res. vol. 3, no. 1, pp. 36-59, Mar. 1992.
58. A. R. Hevner, S. T. March, and J. Park, "Design science in information systems research," MIS Q., vol. 28, no. 1, pp. 75-105, 2004.
59. L. V. Bertalanffy, General System Theory. New York: George Braziller Inc., 1968.
60. L. Chung et al., Non-functional Requirements in Software Engineering Boston, MA: Kluwer, 1999.
61. B. Whitworth, J. Fjermestad, and E. Mahinda, "The web of system performance: A multi-goal model of information system performance," Commun. ACM, vol. 49, no. 5, pp. 93-99, May 2006.
62. B. Whitworth and M. Zaic, "The WOSP model: Balanced information system design and evaluation," Commun. Assoc. Inf. Syst., vol. 12, pp. 258-282, 2003.
63. K. Patten et al., "Leading IT flexibility: Anticipation, agility and adaptability," in Proc. Amer. Conf. Inf. Syst., Omaha, NE, Aug. 11-14, 2005.
64. O. A. El Sawy and B. Nanus, "Towards the design of robust information systems," J. Manage. Inf. Syst., vol. 5, no. 4, pp. 33-54, 1989.
65. B. A. Nixon, "Managing performance requirements for information systems," in Proc. 1st Int. Workshop Softw. Perform., Santa Fe, NM, 1998, pp. 131-144.
66. N. S. Rosa, G. R. R. Justo, and P. R. F. Cunha, "A framework for building non-functional software architectures," in Proc. SAC, Las Vegas, NV, 2001, pp. 141-147.
67. L. M. Cysneiros and J. Leita, "Non-functional requirements: From elicitation to modelling languages," in Proc. ICSE, Orlando, FL, 2002, pp.699-700.
68. J. K. Pinto, "Project management 2002," Res. Technol. Manage., vol. 45, no. 2, pp. 22-37, Mar./Apr. 2002.
69. D. M. Kienzle and W. A. Wulf, "A practical approach to security assessment," in Proc. New Security Paradigms Workshop, Cumbria, U.K., 1997, pp. 5-16.
70. N. S. Borenstein, "Power, ease of use and cooperative work in a practical multimedia message system," Int. J. Man-Mach. Stud., vol. 34, no. 2, pp. 229-259, Feb. 1991.
71. B. Whitworth and E. Whitworth, "Reducing spam by closing the social-technical gap," Computer, vol. 37, no. 10, pp. 38-45, Oct. 2004.
72. A. Moreira, J. Araujo, and I. Brita, "Crosscutting quality attributes for requirements engineering," in Proc. SEKE, Ischia, Italy, 2002, pp. 167-174.
73. W. H. De Lone and E. R. McLean, "Information systems success: The quest for the dependent variable," Inf. Syst. Res., vol. 3, no. 1, pp. 60-95, Mar. 1992.
74. I. Benbasat and R. W. Zmud, "The identity crisis within the IS discipline: Defining and communicating the discipline's core properties," MIS Q., vol. 27, no. 2, pp. 183-194, Jun. 2003.
75. T. L. Saaty, "A scaling method for priorities in hierarchical structures," J. Math. Psychol., vol. 15, no. 3, pp. 234-281, 1977.
76. T. L. Saaty, The Analytic Hierarchy Process. New York: McGraw-Hill, 1980.
77. Q. Zhang, J. Chen, and P. Chong, "Decision consolidation: Criteria weight determination using multiple preference formats," Decis. Support Syst., vol. 38, no. 2, pp. 247-258, Nov. 2004.
78. B. Whitworth and R. Felton, "Measuring disagreement in groups facing limited choice problems," Database Adv. Inf. Syst., vol. 30, no. 3/4, pp. 22-33, 1999.
79. T. L. Saaty and L. G. Vargas, Models, Methods, Concepts & Applications of the Analytic Hierarchy Process. Boston, MA: Kluwer, 2001.
80. W. G. Chismar and S. Wiley-Patton, "Does the extended technology acceptance model apply to physicians?" in Proc. 36th Hawaii Int. Conf. Syst. Sci., Big Island, HI, 2003, p. 160.
81. E. Mahinda and B. Whitworth, "The web of system performance: Extending the TAM model," in Proc. AMCIS, Omaha, NE, Aug. 11-14, 2005.
82. E. Tenner, Why Things Bite Back. New York: Vintage Books, 1997.
83. C. Sylla and B. Arnize, "A method for quality precoordination in a quality assurance information system," IEEE Trans. Eng. Manage., vol. 38, no. 3, pp. 245-256, Aug. 1991.
84. C. Sylla and J. Wen, "A conceptual framework for evaluation of information technology investments," Int. J. Technol. Manage., vol. 24, no. 2/3, pp. 236-261, 2002.
85. S. Manes, "Private lives? Not ours!" PC World, vol. 18, no. 6, p. 312, Jun. 2000.
86. B. Whitworth and A. deMoor, "Legitimate by design: Towards trusted virtual community environments," Behav. Inf. Technol., vol. 22, no. 1, pp. 31-51, 2003.
87. R. L. Keeney and H. Raiffa, Decisions With Multiple Objectives: Preferences and Value Tradeoffs. New York: Wiley, 1976.
88. C. Alexander, Notes on the Synthesis of Form. Cambridge, MA: Harvard Univ. Press, 1964.
89. J. S. David, W. E. McCarthy, and B. S. Sommer, "Agility - The key to survival of the fittest," Commun. ACM, vol. 46, no. 5, pp. 65-69, May 2003.
90. R. Koch, Flexibility or Performance? Harlan, IA: Scientific Amer., Aug. 2005, p. 58.