Interactions between system evaluation and theory testing: A demonstration of the power of a multifaceted approach to information systems research

Journal of Management Information Systems

Volumn 22, Issue 4, 2006, Pages 207-235

  Cao, Jinwei ^a   Crews, Janna M ^b   Lin, Ming ^c   Deokar, Amit ^c   Burgoon, Judee K ^c,d   Nunamaker Jr , Jay F ^c  

^a UNIVERSITY OF DELAWARE   (United States)

^b UNIVERSITY OF NEVADA   (United States)

^c UNIVERSITY OF ARIZONA   (United States)

^d Center for the Management of Information   (United States)

Author keywords

IS research framework; Research activity; Research method; Research paradigm

Indexed keywords

EDUCATION; RESEARCH; SYSTEMS ANALYSIS;

COMPUTER-BASED TRAINING SYSTEM; INFORMATION SYSTEMS RESEARCH FRAMEWORK; RESEARCH PARADIGMS; THEORY TESTING;

MANAGEMENT INFORMATION SYSTEMS;

EID: 33748588701     PISSN: 07421222     EISSN: None     Source Type: Journal    
DOI: 10.2753/MIS0742-1222220408     Document Type: Article

References (36)

1. Benbasat, I. An analysis of research methodologies. In W.F. McFarlan (ed.), Information Systems Research Challenge. Boston: Harvard Business School Press, 1984, pp. 47-85.
2. Black, T.R. Understanding Social Science Research. London: Sage, 2002.
3. Brooke, J. SUS: A "quick and dirty" usability scale. In P.W. Jordan, B. Thomas, B.A. Weerdmeester, and I.L. McClelland (eds.), Usability Evaluation in Industry. London: Taylor & Francis, 1996, pp. 189-194.
4. Cao, J.; Crews, JM.; Lin, M.; Burgoon, J.K.; and Nunamaker, J.F., Jr. Can people be trained to better detect deception? Instructor-led vs. Web-based training. In D. Galletta and J. Ross (eds.), The Ninth Americas Conference on Information Systems. Atlanta: Association for Information Systems, 2003, pp. 599-607 (available at aisel.isworld.org/ Publications/AMCIS/2003/03CA01.pdf).
5. Cao, J.; Crews, J.M.; Lin, M.; Burgoon, J.K.; and Nunamaker, J.F., Jr. Designing Agent99 Trainer: A learner-centered, Web-based training system for deception detection. In H. Chen, R. Miranda, D.D. Zeng, C. Demchak, J. Schroeder, and T. Madhusudan (eds.), The First NSF/NIJ Symposium on Intelligence and Security Informatics. Berlin and Heidelberg: Springer-Verlag, 2003, pp.358-365.
6. Cao, J.; Crews, J.M.; Nunamaker, J.F., Jr.; Burgoon, J.K.; and Lin, M. User experience with Agent99 Trainer: A usability study. In R.H. Sprague Jr. (ed.), Proceedings of the Thirty-Seventh Annual Hawaii International Conference on System Sciences. Los Alamitos, CA: IEEE Computer Society Press, 2004, (available at csdl.computer.org/comp/proceedings/hicss/2004/ 2056/01/205610040babs.htm).
7. Cao, J.; Lin, M.; Deokar, A.; Burgoon, J.K.; Crews, J.M.; and Adkins, M. Computer-based training for deception detection: What users want. In H. Chen, R. Moore, D.D. Zeng, and J. Leavitt (eds.), The Second Symposium on Intelligence and Security Informatics. Berlin and Heidelberg: Springer-Verlag, 2004, pp. 163-175.
8. Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13, 3 (1989), pp. 319-340.
9. Frank, M.G., and Feeley, T.H. To catch a liar: Challenges for research in lie detection training. Journal of Applied Communication Research, 31, 1 (February 2003), 58-75.
10. Galliers, R.D., and Land, F.F. Choosing appropriate information systems research methodologies. Communications of the ACM, 30, 11 (November 1987), 900-902.
11. George, J.F.; Biros, D.P.; Adkins, M.; Burgoon, J.K.; and Nunamaker, J.F., Jr. Testing various modes of computer-based training for deception detection. In H. Chen, R. Moore, D.D. Zeng, and J. Leavitt (eds.), The Second Symposium on Intelligence and Security Informatics. Berlin and Heidelberg: Springer-Verlag, 2004, pp. 411-417.
12. George, J.E; Marett, K.; Burgoon, J.K.; Crews, J.M.; Cao, J.; Lin, M.; and Biros, D.P. Training to detect deception: An experimental investigation. In R.H. Sprague Jr. (ed.), Proceedings of the Thirty-Seventh Annual Hawaii International Conference on System Sciences. Los Alamitos, CA: IEEE Computer Society Press, 2004 (available at csdl.computer.org/comp/proceedings/hicss/2004/2056/01/ 205610023aabs.htm).
13. George, J.F.; Biros, D.P.; Burgoon, J.K.; Nunamaker, J.F., Jr.; Lin, M.; Adkins, M.; Kruse, J.; Cao, J.; Marett, K.; and Crews, J.M. An experimental investigation of e-learning. Working Paper Series UNR001-2005, University of Nevada, Reno, 2005.
14. Hevner, A.R., and March, S.T. The information systems research cycle. IEEE Computer, 36, 11 (2003), 111-113.
15. Hevner, A.R.; March, S.T.; Park, J.; and Ram, S. Design science in information systems research. MIS Quarterly, 28, 1 (2004), 75-105.
16. Hirschheim, R. Information systems epistemology: An historical perspective. In R. Galliers (ed.), Information Systems Research: Issues, Methods and Practical Guidelines. Oxford: Blackwell Scientific, 1992, pp. 28-60.
17. Hirschheim, R., and Klein, H.K. Crisis in the IS field? A critical reflection on the state of the discipline. Journal of the AIS, 4, 5 (October 2003), 237-293.
18. Kaplan, B., and Duchon, D. Combining qualitative and quantitative methods in information systems research: A case study. MIS Quarterly, 12, 4 (December 1988), 570-586.
19. Keen, P. MIS research: Current status, trends and needs. In R. Buckingham, R. Hirschheim, F. Land, and C. Tully (eds.), Information Systems Education: Recommendations and Implementation. Cambridge: Cambridge University Press, 1987, pp. 1-13.
20. Lee, A.S. Integrating positivist and interpretive approaches to organizational research. Organization Science, 2, 4 (November 1991), 342-365.
21. Lewis, J. IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction, 7, 1 (1995), 57-78.
22. Lin, M.; Crews, J.M.; Cao, J.; Nunamaker, J.F., Jr.; and Burgoon, J.K. Agent99 Trainer: Designing a Web-based multimedia training system for deception detection knowledge transfer. In D. Galletta and J. Ross (eds.), The Ninth Americas Conference on Information Systems. Atlanta: Association for Information Systems, 2003, pp. 2564-2572 (available at aisel.isworld.org/Publications/AMCIS/2003/03HE12.pdf)
23. March, S.T., and Smith, G.F. Design and natural science research on information technology. Decision Support Systems, 15, 4 (1995), 251-266.
24. Markus, L.M. Electronic mail as the medium of managerial choice. Organization Science, 5, 4 (November 1994), 502-527.
25. McGrath, J.E.; Martin, J.; and Kulka, R.A. Judgment Calls in Research. Beverly Hills, CA: Sage, 1982.
26. Miller, G.R., and Stiff, J.B. Deceptive Communication. Newbury Park, CA: Sage, 1993.
27. Mingers, J. Combining IS research methods: Towards a pluralist methodology. Information Systems Research, 12, 3 (September 2001), 240-259.
28. Mingers, J. The paucity of multimethod research: A review of the information systems literature. Information Systems Journal, 13, 3 (2003), 233-249.
29. Moore, G.C., and Benbasat, I. Development of an instrument to measure the perceptions of adopting an information technology innovation. Information Systems Research, 2, 3 (1991), 173-191.
30. Nandhakumar, J., and Jones, M. Too close for comfort? Distance and engagement in interpretive information systems research. Information Systems Journal, 7, 2 (1997), 109-131.
31. Nielsen, J. Usability Engineering. Boston: Academic Press, 1993.
32. Nunamaker, J.F., Jr. Build and learn, evaluate and learn. Informatica, 1, 1 (1992), 1-6.
33. Nunamaker, J.F., Jr.; Chen, M.; and Purdin, T.D.M. Systems development in information systems research. Journal of Management Information Systems, 7, 3 (Winter 1990-1991), 89-106.
34. Orlikowski, W.J., and Baroudi, J.J. Studying information technology in organizations: Research approaches and assumptions. Information Systems Research, 2, 1 (1991), 1-28.
35. Shaw, M. Prospect for an engineering discipline of software. IEEE Software, 7, 1 (1990), 15-24.
36. Trauth, E.M., and Jessup, L.M. Understanding computer-mediated discussions: Positivist and interpretive analyses of group support system use. MIS Quarterly, 24, 1 (March 2000), 43-79.