Designing decision aids to promote the development of expertise

Journal of Information Systems

Volumn 26, Issue 1, 2012, Pages 7-34

  Rose, Jacob M ^a   McKay, Britton A ^b   Norman, Carolyn Strand ^c   Rose, Anna M ^a  

^a UNIVERSITY OF NEW HAMPSHIRE   (United States)

^b GEORGIA SOUTHERN UNIVERSITY   (United States)

^c VIRGINIA COMMONWEALTH UNIVERSITY   (United States)

Author keywords

Decision aids; Expertise; Fraud risk assessment; Knowledge structures

Indexed keywords

EID: 84861724480     PISSN: 08887985     EISSN: 15587959     Source Type: Journal    
DOI: 10.2308/isys-10188     Document Type: Article

References (80)

1. Allen, R., D. Hermanson, T. Kozloski, and R. Ramsey. 2006. Auditor risk assessment: Insights from the academic literature. Accounting Horizons 20 (2): 157-177.
2. American Institute of Certified Public Accountants (AICPA). 2003. Consideration of Fraud in a Financial Statement Audit (Supersedes SAS No. 82). Statement on Auditing Standards No. 99. New York, NY: AICPA.
3. Anderson, J. 1983. The Architecture of Cognition. Cambridge, MA: Harvard University Press.
4. Arnold, V., N. Clark, P. Collier, S. Leech, and S. Sutton. 2004. Explanation provision and use in an intelligent decision aid. Intelligent Systems in Accounting, Finance and Management 12: 5-27.
5. Asare, S., and A. Wright. 2004. The effectiveness of alternative risk assessment and program planning tools in a fraud setting. Contemporary Accounting Research 21 (2): 325-352.
6. Baron, R., and D. Kenney. 1986. The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology 51 (6): 1173-1182.
7. Barrick, J., and B. Spilker. 2003. The relations between knowledge, search strategy, and performance in unaided and aided information search. Organizational Behavior and Human Decision Processes 90 (1): 1-18.
8. Bedard, J., and S. Biggs. 1991. The effect of domain-specific experience on evaluation of management representations in analytical procedures. Auditing: A Journal of Practice & Theory 10 (Supplement): 77-90.
9. Bell, T., and J. Carcello. 2000. A decision aid for assessing the likelihood of fraudulent financial reporting. Auditing: A Journal of Practice & Theory 19 (1): 170-184.
10. Bernardo, A. 1994. Problem-specific information and the development of problem-type schemata. Journal of Experimental Psychology 20: 379-395.
11. Bierstaker, J., J. Bedard, and S. Biggs. 1999. The role of problem representation shifts in auditor decision processes in analytical procedures. Auditing: A Journal of Practice & Theory 18 (1): 18-36.
12. Birnberg, J., and M. Shields. 1984. The role of attention and memory in accounting decisions. Accounting, Organizations and Society 9 (3/4): 365-382.
13. Bonner, S., R. Libby, and M. Nelson. 1997. Audit category knowledge as a precondition to learning from experience. Accounting, Organizations and Society 22 (5): 387-410.
14. Bonner, S., and N. Pennington. 1991. Cognitive processes and knowledge as determinants of auditor expertise. Journal of Accounting Literature 10: 1-50.
15. Bonner, S., and P. Walker. 1994. The effects of instruction and experience on the acquisition of auditing knowledge. The Accounting Review 69 (1): 157-178.
16. Borthick, A., M. Curtis, and R. Sriram. 2006. Accelerating the acquisition of knowledge structure to improve performance in internal control reviews. Accounting, Organizations and Society 31 (4/5): 323-342.
17. Chase, W., and H. Simon. 1973. Perception in chess. Cognitive Psychology 4: 55-81.
18. Chi, M., M. Bassok, M. Lewis, P. Reimann, and R. Glaser. 1989. Self-explanations: How students study and use examples in learning to solve problems. Cognitive Science 13: 145-182.
19. Chi, M., R. Glaser, and E. Rees. 1982. Expertise in problem solving. In Advances in the Psychology of Human Intelligence, edited by Sternberg, R. Hillsdale, NJ: Lawrence Erlbaum.
20. Choo, F., and M. Curtis. 2000. Structural assessment in accounting research. Journal of Accounting Literature 19: 131-157.
21. Christ, M. 1993. Evidence on the nature of audit planning problem representations: An examination of auditor free recalls. The Accounting Review 68 (2): 304-322.
22. Cooke, N. J. 1994. Varieties of knowledge elicitation techniques. International Journal of Human- Computer Studies 41: 801-849.
23. Cummins, D. 1992. Role of analogical reasoning in the induction of problem categories. Journal of Experimental Psychology: Learning, Memory, and Cognition 18: 1103-1124.
24. Davis, F., and M. Yi. 2004. Improving computer skill training: Behavior modeling, symbolic mental rehearsal, and the role of knowledge structures. Journal of Applied Psychology 89 (3): 509-523.
25. Day, E., W. Arthur, Jr., and D. Gettman. 2001. Knowledge structures and the acquisition of a complex skill. Journal of Applied Psychology 86 (5): 1022-1033.
26. Dowling, C., and S. Leech. 2006. Audit Support Systems and Decision Aids: Current Practice and Opportunities for Future Research. Proceedings of the 7th International Research Symposium on Accounting Information Systems, Milwaukee, WI.
27. Earley, C. 2001. Knowledge acquisition in auditing: Training novice auditors to recognize cue relationships in real estate valuation. The Accounting Review 76 (1): 81-97.
28. Earley, C. 2002. The differential use of information by experienced and novice auditors in the performance of ill-structured audit tasks. Contemporary Accounting Research 19 (4): 595-614.
29. Eining, M., and P. Dorr. 1991. The impact of expert system usage on experimental learning in an auditing setting. Journal of Information Systems (Spring): 1-16.
30. Frederick, D. 1991. Auditors' representation and retrieval of internal control knowledge. The Accounting Review 66 (2): 240-258.
31. Glaser, R., and M. Chi. 1988. The Nature of Expertise. Hillsdale, NJ: Lawrence Erlbaum.
32. Goldsmith, T., and D. Davenport. 1990. Assessing structural similarity of graphs. In Pathfinder Associative Networks: Studies in Knowledge Organization, edited by Schvaneveldt, R. Norwood, NJ: Ablex Publishing Corp.
33. Goldsmith, T., P. Johnson, and W. Acton. 1991. Assessing structural knowledge. Journal of Educational Psychology 83 (1): 88-96.
34. Hammersley, J. 2006. Pattern identification and industry-specialist auditors. The Accounting Review 81 (2): 309-336.
35. Hornik, S., and B. M. Ruf. 1997. Expert system usage and knowledge acquisition: An empirical assessment of analogical reasoning in the evaluation of internal controls. Journal of Information Systems (Fall): 57-76.
36. Johnson, V., and S. Kaplan. 1996. Auditors' decision-aided probability assessments: An analysis of the effects of list length and response format. Journal of Information Systems 10 (2): 87-101.
37. Johnson-Laird, P. 1983. Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness. Cambridge, MA: Harvard University Press.
38. Kachelmeier, S., and W. Messier, Jr. 1990. An investigation of the influence of a nonstatistical decision aid on auditor sample size decisions. The Accounting Review 65 (1): 209-226.
39. Knapp, C., and M. Knapp. 2001. The effects of experience and explicit fraud risk assessment in detecting fraud with analytical procedures. Accounting, Organizations and Society 26 (1): 25-37.
40. Kopp, L., and E. O'Donnell. 2005. The influence of a business-process focus on category knowledge and internal control evaluation. Accounting, Organizations and Society 30 (5): 423-434.
41. Kozlowski, S. W. J., S. Gully, K. Brown, E. Salas, E. Smith, and E. Nason. 2001. Effects of training goals and goal orientation traits on multidimensional training outcomes and performance adaptability. Organizational Behavior and Human Decision Processes 85 (1): 1-31.
42. Kraiger, K., and J. Cannon-Bowers. 1995. Measuring knowledge organization as a method for assessing learning during training. Human Factors 37 (4): 804-816.
43. Kraiger, K., K. Ford, and E. Salas. 1993. Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology 78 (2): 311-328.
44. Libby, R. 1995. The role of knowledge and memory in audit judgment. In Judgment and Decision Making Research in Accounting and Auditing, edited by Ashton, R., and A. Ashton, Cambridge, MA: Cambridge University Press.
45. Libby, R., and J. Luft. 1993. Determinants of judgment performance in accounting settings: Ability, knowledge, motivation, and environment. Accounting, Organizations, and Society 18 (5): 425-450.
46. Loebbecke, J., M. Eining, and J. Willingham. 1989. Auditors' experience with material irregularities: Frequency, nature, and detectability. Auditing: A Journal of Practice & Theory 9 (1): 1-28.
47. Maletta, M. J., and T. Kida. 1993. The effect of risk factors on auditors' configural information processing. The Accounting Review 68 (3): 681-691.
48. Mascha, M. F. 2001. The effect of task complexity and expert system type on the acquisition of procedural knowledge: Some new evidence. International Journal of Accounting Information Systems (2) 2: 103-124.
49. Messier, W. 1995. Research in and development of audit-decision aids. In Judgment and Decision Making Research in Accounting and Auditing, edited by Ashton, R., and A. Ashton, Cambridge, MA: Cambridge University Press.
50. Murphy, D. S. 1990. Expert system use and the development of expertise in auditing: A preliminary investigation. Journal of Information Systems (Fall): 18-35.
51. Odom, M., and P. Dorr. 1995. The impact of elaboration-based expert system interfaces on de-skilling: An epistemological issue. Journal of Information Systems 9: 1-18.
52. Pei, B., and J. Reneau. 1990. The effects of memory structure on using rule-based expert systems for training: A framework and an empirical test. Decision Sciences (Spring): 263-286.
53. Pei, B., J. Steinbart, and J. Reneau. 1994. The effects of judgment strategy and prompting on using rulebased expert systems for knowledge transfer. Journal of Information Systems 8 (Spring): 21-42.
54. Pincus, K. 1989. The efficacy of a red flags questionnaire for assessing the possibility of fraud. Accounting, Organizations, and Society 14: 153-163.
55. Rose, J. 2002. Behavioral decision aid research: Decision aid use and effects. In Researching Accounting as an Information Systems Discipline, edited by Arnold, V., and S. Sutton. Sarasota, FL: American Accounting Association.
56. Rose, J., A. Rose, and B. McKay. 2007. Measurement of knowledge structures acquired through instruction, experience, and decision aid use. International Journal of Accounting Information Systems 8 (2): 118-137.
57. Rose, J., and C. Wolfe. 2000. The effects of system design alternatives on the acquisition of tax knowledge from a computerized tax decision aid. Accounting, Organizations and Society 25: 285-306.
58. Rouse, W., and N. Morris. 1986. On looking into the black box: Prospects and limits in the search for mental models. Psychological Bulletin 100: 349-363.
59. Schvaneveldt, R. 1990. Pathfinder Associative Networks: Studies in Knowledge Organization. Norwood, NJ: Ablex Publishing Corp.
60. Shelton, S., O. Whittington, and D. Landsittle. 2001. Auditing firms' risk assessment practices. Accounting Horizons 15 (1): 19-34.
61. Smedley, G., and S. Sutton. 2007. The effect of alternative procedural explanation types on procedural knowledge acquisition during knowledge-based systems use. Journal of Information Systems 21: 27-51.
62. Smith, J., S. Tiras, and S. Vichitlekarn. 2000. The interaction between internal control assessment and substantive testing in audits for fraud. Contemporary Accounting Research 17 (2): 327-356.
63. Solomon, I., M. Shields, and O. Whittington. 1999. What do industry-specialist auditors know? Journal of Accounting Research 37 (1): 191-208.
64. Steinbart, P., and W. Accola. 1994. The effects of explanation type and user involvement on learning and satisfaction with expert systems. Journal of Information Systems 8: 1-17.
65. Sumfleth, E. 1988. Knowledge of terms and problem-solving in chemistry. International Journal of Science Education 10: 45-60.
66. Sweller, J. 1993. Some cognitive processes and their consequences for the organization and presentation of information. Australian Journal of Psychology 45: 1-8.
67. Sweller, J., and G. Cooper. 1985. The use of worked examples as a substitute for problem solving in learning algebra. Cognition and Instruction 2: 59-89.
68. Taricani, E., and R. Clariana. 2006. A technique for automatically scoring open-ended concept maps. Education Technology Research and Development Association for Educational Communications and Technology 54 (1): 65-82.
69. Tarmizi, R., and J. Sweller. 1988. Guidance during mathematical problem solving. Journal of Educational Psychology 80: 424-436.
70. Taylor, M. 2000. The effects of industry specialization on auditors' inherent risk assessments and confidence judgments. Contemporary Accounting Research 17 (4): 693-712.
71. Todd, P., and I. Benbasat. 1992. The use of information in decision making: An experimental investigation of the impact of computer-based decision aids. MIS Quarterly 16 (3): 373-393.
72. Todd, P., and I. Benbasat. 1994. The influence of decision aids on choice strategies: An experimental analysis of the role of cognitive effort. Organizational Behavior and Human Decision Processes 60: 36-74.
73. Trigwell, K., and R. Sleet. 1990. Improving the relationship between assessment results and student understanding. Assessment and Evaluation in Higher Education 15: 190-197.
74. Trumpower, D., and T. Goldsmith. 2004. Structural enhancement of learning. Contemporary Educational Psychology 29 (4): 426-446.
75. Vera-Mũnoz, S., W. Kinney, and S. Bonner. 2001. The effects of domain experience and task presentation format on accountants' information relevance assurance. The Accounting Review 76 (3): 405-429.
76. Weber, R. 1980. Some characteristics of the free recall of computer controls by EDP auditors. Journal of Accounting Research 18: 214-241.
77. Wilks, T., and M. Zimbelman. 2004. Decomposition of fraud risk assessments and auditors' sensitivity to fraud cues. Contemporary Accounting Research 21 (3): 719-745.
78. Yi, M., and F. Davis. 2003. Developing and validating an observational learning model of computer software training and skill acquisition. Information Systems Research 14 (2): 146-169.
79. Zhu, X., and H. Simon. 1987. Learning mathematics from examples and by doing. Cognition and Instruction 4: 137-166.
80. Zimbelman, M. 1997. The effects of SAS No. 82 on auditors' attention to fraud risk factors and audit planning decisions. Journal of Accounting Research (Supplement): 75-97.