Rigor and relevance: The application of the critical incident technique to investigate email usage

Journal of Organizational Computing and Electronic Commerce

Volumn 20, Issue 2, 2010, Pages 182-207

  Serenko, Alexander ^a   Turel, Ofir ^b  

^a LAKEHEAD UNIVERSITY   (Canada)

^b CALIFORNIA STATE UNIVERSITY   (United States)

Author keywords

Critical incident technique; Email; User survey

Indexed keywords

EID: 77951695429     PISSN: 10919392     EISSN: None     Source Type: Journal    
DOI: 10.1080/10919391003711050     Document Type: Article

References (93)

1. R. L. Baskerville and A. T. Wood-Harper, "A critical perspective on action research as a method for information systems research," Journal of Information Technology, vol. 11, pp. 235-246, 1996.
2. K. C. Desouza, O. A. E. Sawy, R. D. Galliers, C. Loebbecke, and R. T. Watson, "Beyond rigor and relevance towards responsibility and reverberation: Information systems research that really matters," Communications of the Association for Information Systems, vol. 17, pp. 341-353, 2006.
3. J. Benamati, M. A. Serva, D. F. Galletta, A. Harris, and F. Niederman, "The slippery slope of MIS academia: A discussion of the quest for relevance in our discipline," Communications of the Association for Information Systems, vol. 18, pp. 657-675, 2007.
4. N. Kock, P. Gray, R. Hoving, H. Klein, M. Myers, and J. Rockart, "IS research relevance revisited: Subtle accomplishment, unfulfilled promise, or serial hypocrisy?" Communications of the Association for Information Systems, vol. 8, pp. 330-346, 2002.
5. I. Benbasat and R. W. Zmud, "Empirical research in information systems: The practice of relevance," MIS Quarterly, vol. 23, pp. 3-16, 1999.
6. J. M. Pearson, A. Pearson, and J. P. Shim, "The relevancy of information systems research: The practitioner's view," Information Resources Management Journal, vol. 18, pp. 50-67, 2005.
7. A. Serenko, M. Cocosila, and O. Turel, "The state and evolution of information systems research in Canada: A scientometric analysis," Canadian Journal of Administrative Sciences, vol. 25, pp. 279-294, 2008.
8. P. R. Varadarajan, "Musing on relevance and rigor of scholarly research in marketing," Journal of the Academy of Marketing Science, vol. 31, pp. 368-376, 2003.
9. P. Shrivastava, "Rigor and practical usefulness of research in strategic management," Strategic Management Journal, vol. 8, pp. 77-92, 1987.
10. A. McGahan, "Academic research that matters to managers: On zebras, dogs, lemmings, hammers, and turnips," Academy of Management Journal, vol. 50, pp. 748-753, 2007.
11. C. Gopinath and R. C. Hoffman, "The relevance of strategy research-practitioner and academic viewpoints," Journal of Management Studies, vol. 32, pp. 575-594, 1995.
12. L. Booker, N. Bontis, and A. Serenko, "The relevance of knowledge management and intellectualcapitalresearch," Knowledge and Process Management,vol.15,pp.235-246,2008.
13. J. D. Daniels, "Relevance in International Business Research: A need for more linkages," Journal of International Business Studies, vol. 22, pp. 177-186, 1991.
14. R. L. Baskerville and M. Myers, Special Issue on Action Research in Information Systems: MakingISresearchrelevanttopractice-foreword,"MISQuarterly,vol.28,pp.329-335,2004.
15. J. C. Flanagan, "The critical incident technique," Psychological Bulletin, vol. 5, pp. 327-358, 1954.
16. D. D. Gremler, "The Critical Incident Technique in service research," Journal of Service Research, vol. 7, pp. 65-89, 2004.
17. A. Serenko, "The use of interface agents for email notification in critical incidents," International Journal of Human-Computer Studies, vol. 64, pp. 1084-1098, 2006.
18. R. Khare, "The spec's in the mail," IEEE Internet Computing, vol. 2, pp. 82-86, 1998.
19. N. Ducheneaut and V. Bellotti, "E-mail as habitat: An exploration of embedded personal information management," Interactions, vol. 8, pp. 30-38, 2001.
20. R. Weber, "The grim reaper: The curse of e-mail," MIS Quarterly, vol. 28, pp. iii-xiii, 2004.
21. K. Dow, A. Serenko, O. Turel, and J. Wong, "Antecedents and consequences of user satisfaction with e-mail systems," International Journal of e-Collaboration, vol. 2, pp. 46-64, 2006.
22. B.-E. Andersson and S.-G. Nilsson, "Studies in the reliability and validity of the critical incident technique," Journal of Applied Psychology, vol. 48, pp. 398-403, 1964.
23. J. Koenemann-Belliveau, J. M. Carroll, M. B. Rosson, and M. K. Singley, "Comparative usability evaluation: Critical incidents and critical threads," in Proc. of the ACM Conference on Human Factors in Computing Systems, Boston, Massachusetts, 1994.
24. D. M. Thomas and R. P. Bostrom, "Making knowledge work in virtual teams," Communications of the ACM, vol. 50, pp. 85-90, 2007.
25. R. T. Cenfetelli, "Inhibitors and enablers as dual factor concepts in technology usage," Journal of the Association for Information Systems, vol. 5, pp. 472-492, 2004.
26. H. Cowie, P. Naylor, I. Rivers, P. K. Smith, and B. Pereira, "Measuring workplace bullying," Aggression and Violent Behavior, vol. 7, pp. 33-51, 2002.
27. M. L. Radford, "The Critical Incident Technique and the qualitative evaluation of the connecting libraries and schools project," Library Trends, vol. 55, pp. 46-64, 2006.
28. M. A. Jones, "Entertaining shopping experiences: An exploratory investigation," Journal of Retailing and Consumer Services, vol. 6, pp. 129-139, 1999.
29. S. M. Keaveney, "Customer switching behavior in service industries: An exploratory study," Journal of Marketing, vol. 59, pp. 71-82, 1995.
30. K. E. Mitchell, G. M. Alliger, and R. Morfopoulos, "Toward an ADA-appropriate job analysis," Human Resource Management Review, vol. 7, pp. 5-26, 1997.
31. S. Muylle, R. Moenaert, and M. Despontin, "The conceptualization and empirical validation of web site user satisfaction," Information & Management, vol. 41, pp. 543-560, 2004.
32. A. Wong, "Partnering through cooperative goals in supply chain relationships," Total Quality Management, vol. 10, pp. 786-792, 1999.
33. C. Tay and S. Ang,"User competence in information technology:A critical incident analysis," in Proc. of the IEEE Region 10's Ninth Annual International Conference, Singapore, 1994.
34. J. C. Castillo, H. R. Hartson, and D. Hix, "Remote usability evaluation: Can users report their own critical incidents?," in Proc. of the Conference on Human Factors in Computing Systems, Los Angeles, CA, 1998.
35. R. Hackney, S. Jones, and A. Losch, "Towards an e-Government efficiency agenda: The impact of information and communication behaviour on e-Reverse auctions in public sector procurement," European Journal of Information Systems, vol. 16, pp. 178-191, 2007.
36. G. A. Klein, R. Calderwood, and D. MacGregor, "Critical decision method for eliciting knowledge," IEEE Transactions on Systems, Man, and Cybernetics, vol. 19, pp. 462-472, 1989.
37. P. S. Goodman and E. D. Darr, "Computer-aided systems and communities: Mechanisms for organizational learning in distributed environments," MIS Quarterly, vol. 22, pp. 417-440, 1998.
38. J. Schluter, P. Seaton, and W. Chaboyer, "Critical incident technique: A user's guide for nurse researchers," Journal of Advanced Nursing, vol. 61, pp. 107-114, 2008.
39. W. W. Ronan and G. P. Latham, "The reliability and validity of the Critical Incident Technique: A closer look," Studies in Personnel Psychology, vol. 6, pp. 53-64, 1974.
40. K.-C. Wang, A.-T. Hsieh, and T.-C. Huan, "Critical service features in group package tour: An exploratory research," Tourism Management, vol. 21, pp. 177-189, 2000.
41. C. Urquhart, A. Light, R. Thomas, A. Barker, A. Yeoman, J. Cooper, C. Armstrong, R. Fenton, R. Lonsdale, and S. Spink, "Critical incident technique and explicitation interviewing in studies of information behavior," Library & Information Science Research, vol. 25, pp. 63-88, 2003.
42. H.-L. Changa and C.-H. Yang, "Explore airlines' brand niches through measuring passengers' repurchase motivation - an application of Rasch measurement," Journal of Air Transport Management, vol. 14, pp. 105-112, 2008.
43. M. J. Bitner, B. H. Booms, and M. S. Tetreault, "The service encounter: Diagnosing favorable and unfavorable incidents," Journal of Marketing, vol. 54, pp. 71-84, 1990.
44. B. L. Johnson, Jr., and J. R. Fauske, "Principals and the political economy of environmental enactment," Educational Administration Quarterly, vol. 36, pp. 159-185, 2000.
45. M. B. Miles and A. M. Huberman, Qualitative data analysis: An expanded source book, 2 ed. Thousand Oaks: Sage Publications, 1994.
46. K. Krippendorff, Content analysis: An introduction to its methodology. Beverly Hills, CA: Sage Publications, 1980.
47. M. Myers, "Qualitative research in information systems," MIS Quarterly Discovery, Third edition. Available online at http://www.misq.org/discovery/MISQD_isworld, 1998.
48. I. Benbasat, D. K. Goldstein, and M. Mead, "The case research strategy in studies of information systems," MIS Quarterly, vol. 11, pp. 369-386, 1987.
49. G. W. Ryan and H. R. Bernard, "Data management and analysis methods," in Handbook of qualitative research, N. K. Denzin and Y. S. Lincoln, Eds., 2 ed. Thousand Oaks, CA: Sage Publications, pp. 769-802, 2000.
50. R. W. Budd and R. K. Thorp, An introduction to content analysis, including annotated bibliography. Iowa City, Iowa: University of Iowa School of Journalism, 1963.
51. R. W. Budd, R. K. Thorp, and L. Donohew, Content analysis of communications. New York: The Macmillan Company, 1967.
52. R. P. Weber, Basic content analysis, 2nd ed. Newbury Park, CA: Sage Publications, 1990.
53. B. G. Glaser and A. L. Strauss, The discovery of grounded theory: Strategies for qualitative research. Chicago: Aldine Pub. Co, 1967.
54. J. W. Creswell, Research design: Qualitative, quantitative, and mixed methods approaches, 2nd ed. Thousand Oaks, CA: Sage Publications, 2003.
55. F. D. Davis, "Perceived usefulness, perceived ease of use and user acceptance of information technology," MIS Quarterly, vol. 13, pp. 319-340, 1989.
56. F. D. Davis, R. P. Bagozzi, and P. R. Warshaw, "User acceptance of computer technology: A comparison of two theoretical models," Management Science, vol. 35, pp. 982-1003, 1989.
57. V. Venkatesh and F. D. Davis, "A theoretical extension of the Technology Acceptance Model: Four longitudinal field studies," Management Science, vol. 46, pp. 186-204, 2000.
58. T. J. Strader, S. N. Ramaswami, and P. A. Houle, "Perceived network externalities and communication technology acceptance," European Journal of Information Systems, vol. 16, pp. 54-65, 2007.
59. I. Benbasat and R. W. Zmud, "The identity crisis within the IS discipline: Defining and communicating the discipline's core properties," MIS Quarterly, vol. 27, pp. 183-194, 2003.
60. H. Lieberman, E. Rosenzweig, and P. Singh, "Aria: An agent for annotating and retrieving images," IEEE Computer, vol. 34, pp. 57-62, 2001.
61. A. Serenko, "Are interface agents scapegoats? Attributions of responsibility in human-agent interaction," Interacting with Computers, vol. 19, pp. 293-303, 2007.
62. J.-D. Ruvini and J.-M. Gabriel, "Do users tolerate errors from their assistant?: Experiments with an e-mail classifier," in Proc. of the 7th International Conference on Intelligent User Interfaces, San Francisco, CA, 2002.
63. D. L. Goodhue, "Development and measurement validity of a task-technology fit instrument for user evaluations of information systems," Decision Sciences, vol. 29, pp. 105-138, 1998.
64. A. Bhattacherjee, "Understanding information systems continuance: An expectation- confirmation model," MIS Quarterly, vol. 25, pp. 351-370, 2001.
65. D. Gefen, E-commerce: The role of familiarity and trust, Omega, vol.28, pp.725-737, 2000.
66. E. Walther, B. Nagengast, and C. Trasselli, "Evaluative conditioning in social psychology: Facts and speculations," Cognition & Emotion, vol. 19, pp. 175-196, 2005.
67. J. De Houwer, S. Thomas, and F. Baeyens, "Associative learning of likes and dislikes: A review of 25 years of research on human evaluative conditioning," Psychological Bulletin, vol. 127, pp. 853-869, 2001.
68. K. R. R. Lascelles and G. C. L. Davey, "Successful differential evaluative conditioning using simultaneous and trace conditioning procedures in the picture-picture paradigm," Quarterly Journal of Experimental Psychology, vol. 59, pp. 482-492, 2006.
69. I. Martin and A. B. Levey, "Evaluative conditioning," Advances in Behaviour Research and Therapy, vol. 1, pp. 57-102, 1978.
70. A. B. Levey and I. Martin, "Classical conditioning of human 'evaluative' responses," Behaviour Research and Therapy, vol. 13, pp. 221-226, 1975.
71. K. J. Stewart, "Trust transfer on the World Wide Web," Organization Science, vol. 14, pp. 5-17, 2003.
72. P. A. Pavlou and D. Gefen, "Psychological contract violation in online marketplaces: Antecedents, consequences, and moderating role," Information Systems Research, vol. 16, pp. 372-399, 2005.
73. O. Turel, Y.F. Yuan, and C. E. Connelly, "In justice wetrust:Predicting user acceptanceofe-customer services," Journal of Management Information Systems, vol. 24, pp. 123-151, 2008.
74. D. A. Adams, R. R. Nelson, and P. A. Todd, "Perceived usefulness, ease of use, and usage of information technology: A replication," MIS Quarterly, vol. 16, pp. 227-247, 1992.
75. D. A. Adams, P. A. Todd, and R. R. Nelson, "A comparative evaluation of the impact of electronic and voice mail on organizational communication," Information & Management, vol. 24, pp. 9-21, 1993.
76. W. W. Chin, B. L. Marcolin, and P. R. Newsted, "A partial least squares latent variable modeling approach for measuring interaction effects: Results from a Monte Carlo simulation study and an electronic-mail emotion/adoption study," Information Systems Research, vol. 14, pp. 189-217, 2003.
77. C. C. Debrand and J. J. Johnson, "Gender differences in email and instant messaging: A study of undergraduate business information systems students," Journal of Computer Information Systems, vol. 48, pp. 20-30, 2008.
78. C. A. Froehle and A. V. Roth, "New measurement scales for evaluating perceptions of the technology-mediated customer service experience," Journal of Operations Management, vol. 22, pp. 1-21, 2004.
79. D. Gefen and D. Straub, "Gender differences in the perception and use of e-mail: An extension to the technology acceptance model," MIS Quarterly, vol. 21, pp. 389-400, 1997.
80. K. Higa, O. R. L. Sheng, B. Shin, and A. J. Figueredo, "Understanding relationships among teleworkers' e-mail usage, e-mail richness perceptions, and e-mail productivity perceptions under a software engineering environment," IEEE Transactions on Engineering Management, vol. 47, pp. 163-173, 2000.
81. A. H. Huang, S. Y. Hung, and D. C. Yen, "An exploratory investigation of two internet-based communication modes," Computer Standards & Interfaces, vol. 29, pp. 238-243, 2007.
82. L. J. Huang, M. T. Lu, and B. K. Wong, "The impact of power distance on email acceptance: Evidence from the PRC," Journal of Computer Information Systems, vol. 44, pp. 93-101, 2003.
83. S. Y. Hung, A. H. Huang, D. C. Yen, and C.-M. Chang, "Comparing the task effectiveness of instant messaging and electronic mail for geographically dispersed teams in Taiwan," Computer Standards & Interfaces, vol. 29, pp. 626-634, 2007.
84. E. Karahanna and M. Limayem, E-mail and V-mail usage: Generalizing across technologies,"Journal of Organizational Computing and Electronic Commerce,vol.10,pp.49-66,2000.
85. W. J. Kettinger and V. Grover, "The use of computer-mediated communication in an interorganizational context," Decision Sciences, vol. 28, pp. 513-555, 1997.
86. B. A. Olaniran, "A model of group satisfaction in computer-mediated communication and face-to-face meetings," Behariour & Information Technology, vol. 15, pp. 24-36, 1996.
87. H. P. Shih, "Technology-push and communication-pull forces driving message-based coordination performance" Journal of Strategic Information Systems, vol. 15, pp. 105-123, 2006.
88. D. Straub, "The effect of culture on IT diffusion-e-mail and fax in Japan and the United States," Information Systems Research, vol. 5, pp. 23-47, 1994.
89. S. W. Sussman and W. S. Siegal, "Informational influence in organizations: An integrated approach to knowledge adoption," Information Systems Research, vol. 14, pp. 47-65, 2003.
90. B. Szajna, "Empirical evaluation of the revised Technology Acceptance Model," Management Science, vol. 42, pp. 85-92, 1996.
91. L. K. Trevino and J. Webster, "Flow in computer-mediated communication-electronic mail and voice mail evaluation and impacts," Communication Research, vol. 19, pp. 539-573, 1992.
92. B. van den Hooff, "Electronic coordination and collective action: Use and effects of electronic calendaring and scheduling" Information & Management, vol. 42, pp. 103-114, 2004.
93. J. Webster and L. K. Trevino, "Rational and social theories as complementary explanations of communication media choices: Two policy-capturing studies," Academy of Management Journal, vol. 38, pp. 1544-1572, 1995.