Detecting errors in data: Clarification of the impact of base rate expectations and incentives

Omega

Volumn 29, Issue 5, 2001, Pages 391-404

  Klein, Barbara D ^a  

^a UNIVERSITY OF MICHIGAN DEARBORN   (United States)

Author keywords

Data quality; End user computing; Error detection

Indexed keywords

COMPUTATION THEORY; HUMAN COMPUTER INTERACTION;

BASE RATE; DATA ERRORS; DATA QUALITY; DETECTION PERFORMANCE; DIRECT EXPERIENCE; EFFECT OF BASE; END USER COMPUTING; ORGANISATIONAL; PROBABILISTIC JUDGMENTS; THEORY OF ERRORS;

ERROR DETECTION;

EID: 0043194041     PISSN: 03050483     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0305-0483(01)00029-9     Document Type: Article

References (58)

1. Laudon K.C. Data quality and due process in large interorganizational record systems. Communications of the ACM. 29(1):1986;4-11.
2. Redman T.C. Data quality for the information age. 1996;Artech House, Inc. Norwood, MA.
3. Paradice D.B., Fuerst W.L. An MIS data quality methodology based on optimal error detection. Journal of Information System. 5(1):1991;48-66.
4. Orr K. Data quality and systems. Communications of the ACM. 41(2):1998;66-71.
5. Klein B.D., Goodhue D.L., Davis G.B. Can humans detect errors in data?: impact of base rates, incentives, and goals. MIS Quarterly. 21(2):1997;169-194.
6. Davis G.B., Neter J., Palmer R.R. An experimental study of audit confirmation. Journal of Accountancy. 123(6):1967;36-44.
7. Ricketts J.A. Powers-of-ten information biases. MIS Quarterly. 14(1):1990;63-77.
8. Klein BD, Goodhue DL, Davis GB. Conditions for the detection of data errors in organizational settings: preliminary results from a field study. Proceedings of the 1996 Conference on Information Quality, 1996, p. 24-52.
9. Koehler J.J. The base rate fallacy reconsidered: descriptive, normative, and methodological challenges. Behavioral and Brain Sciences. 19(1):1996;1-53.
10. Davis G.B., Olson M.H. Management information systems: conceptual foundations, structure, and development. 1985;McGraw-Hill Book Company, New York, NY.
11. Fox C., Levitin A., Redman T. The notion of data and its quality dimensions. Information Processing & Management. 30(1):1993;9-19.
12. Huh Y.U., Keller F.R., Redman T.C., Watkins A.R. Data quality. Information and Software Technology. 32(8):1990;559-565.
13. Wang R.Y., Strong D.M. Beyond accuracy: what data quality means to data consumers. Journal of Management Information Systems. 12(4):1996;5-34.
14. Ham J., Losell D., Smieliauskas W. An empirical study of error characteristics in accounting populations. The Accounting Review. 60(3):1985;387-406.
15. Johnson J.R., Leitch R.A., Neter J. Characteristics of errors in account receivable and inventory audits. The Accounting Review. 56(2):1981;270-293.
16. Svanks M.I. Integrity analysis. Information and Software Technology. 30(10):1988;595-605.
17. Ballou D.P., Pazer H.L. Cost/quality tradeoffs for control procedures in information systems. OMEGA: International Journal of Management Science. 15(6):1987;509-521.
18. Ballou D.P., Pazer H.L., Belardo S., Klein B. Implications of data quality for spreadsheet analysis. Data Base. 18(3):1987;13-19.
19. Ballou D.P., Tayi G.K. Methodology for allocating resources for data quality enhancement. Communications of the ACM. 32(3):1989;320-329.
20. Ballou D.P., Pazer H.L. Modeling data and process quality in multi-input, multi-output information systems. Management Science. 31(2):1985;150-162.
21. Ballou D.P., Pazer H.L. Designing information systems to optimize the accuracy-timeliness tradeoff. Information Systems Research. 6(1):1995;51-72.
22. Bansal A., Kauffman R.J., Weitz R.R. Comparing the modeling performance of regression and neural networks as data quality varies: a business value approach. Journal of Management Information Systems. 10(1):1993;11-32.
23. Gaba A., Winkler R.L. Implications of errors in survey data: a Bayesian model. Management Science. 38(7):1992;913-925.
24. O'Leary D.E. The impact of data accuracy on system learning. Journal of Management Information Systems. 9(4):1993;83-98.
25. Klein B.D. How do actuaries use data containing errors?: models of error detection and error correction. Information Resources Management Journal. 10(4):1997;27-36.
26. Baker E.M., Schuck J.R. Theoretical note: use of signal detection theory to clarify problems in evaluating performance in industry. Organizational Behavior and Human Performance. 13(3):1975;307-317.
27. Ballou D.P., Pazer H.L. The impact of inspector fallibility on the inspection policy in serial production systems. Management Science. 28(4):1982;387-399.
28. Ballou D.P., Pazer H.L. Process improvement versus enhanced inspection in optimized systems. International Journal of Production Research. 23(6):1985;1233-1245.
29. Ballou D.P., Pazer H.L. Designing inspection strategies for uncertain environments. Decision Sciences. 18(2):1987;217-233.
30. McNicol D. A primer of signal detection theory. 1972;George Allen & Unwin Ltd. London.
31. Thompson S.C. Detection of social cues: a signal detection theory analysis. Personality & Social Science Psychology Bulletin. 4(3):1978;452-455.
32. Koppell S. Decision latencies in recognition memory: a signal detection theory analysis. Journal of Experimental Psychology: Human Learning & Memory. 3(4):1977;445-457.
33. Craig A. Signal detection theory and probability matching apply to vigilance. Human Factors. 29(6):1987;645-652.
34. Green D.M., Swets J.A. Signal detection theory and psychophysics. 1966;Wiley, New York, NY.
35. Pastore R.E., Scheirer C.J. Signal detection theory: considerations for general application. Psychological Bulletin. 81(12):1974;945-958.
36. Swets J.A. Measuring the accuracy of diagnostic systems. Science. 240(4857):1988;1285-1294.
37. Davies D.R., Parasuraman R. The psychology of vigilance. 1981;Academic Press, London.
38. Campbell JP. Modeling the performance prediction problem in industrial and organizational psychology. In: Dunnette MD, Hough LM, editors. Handbook of industrial and organizational psychology, 2nd ed. Palo Alto CA: Consulting Psychologists Press, 1990. p. 687-732.
39. Cryer E.H., Bettman J.R., Payne J.W. The impact of accuracy and effort feedback and goals on adaptive decision behavior. Journal of Behavioral Decision Making. 3(1):1990;1-16.
40. Guzzo R.A., Jette R.D., Katzell R.A. The effects of psychologically based intervention programs on worker productivity: a meta-analysis. Personnel Psychology. 38(2):1985;275-291.
41. Jenkins DC. Financial incentives. In: Locke EA, editor. Generalizing from laboratory to field settings. Lexington, MA: Lexington Books, 1986. p. 167-80.
42. Locke, EA, Feren, DB, McCaleb VM, Shaw KN, Denny AT. The relative effectiveness of four methods of motivating employee performance. In: Duncan K, Gruneberg M, Wallis D, editors. Changes in working life. New York, NY: Wiley, 1980. p. 363-88.
43. Gigerenzer G., Hell W., Blank H. Presentation and content: the use of base rates as a continuous variable. Journal of Experimental Psychology: Human Perception and Performance. 14(3):1988;513-525.
44. Kahneman D., Tversky A. On the psychology of prediction. Psychological Review. 80(4):1973;237-251.
45. Nisbett R.E., Borgida E. Attribution and the psychology of prediction. Journal of Personality and Social Psychology. 32(5):1975;932-943.
46. Christensen-Szalanski J.J.J., Beach L.R. Experience and the base-rate fallacy. Organization Behavior and Human Performance. 29(2):1982;270-278.
47. Christensen-Szalanski J.J.J., Bushyhead J.B. Physicians' use of probabilistic information in a real clinical setting. Journal of Experimental Psychology: Human Perception and Performance. 7(4):1981;928-935.
48. Manis M., Dovalina I., Avis N.E., Cardoze S. Base rates can affect individual predictions. Journal of Personality and Social Psychology. 38(2):1980;231-248.
49. Ginossar Z., Trope Y. Problem solving in judgment under uncertainty. Journal of Personality and Social Psychology. 52(3):1987;464-473.
50. Grether D.M. Bayes rule as a descriptive model: the representativeness heuristic. The Quarterly Journal of Economics. 95(3):1980;537-557.
51. Kassin S.M. Base rates and prediction: the role of sample size. Personality and Social Psychology Bulletin. 5(2):1979;210-213.
52. Roy M.C., Lerch F.J. Overcoming ineffective mental representations in base-rate problems. Information Systems Research. 7(2):1996;233-247.
53. Norman D.A. A comparison of data obtained with different false-alarm rates. Psychological Review. 71(1):1965;243-246.
54. Pollack I., Norman D.A., Galanter E. An efficient non-parametric analysis of recognition memory. Psychonomic Science. 1(1):1964;327-328.
55. Yates J.F. Judgment and decision making. 1990;Prentice-Hall, Inc. Englewood Cliffs, NJ.
56. Neter J., Wasserman W., Kutner M.H. Applied linear statistical models. 1990;Irwin, Homewood, IL.
57. McClave J.T., Benson P.G. Statistics for business and economics. 1994;Dellen Publishing Company, San Francisco, CA.
58. Butt J. Frequency judgments in an auditing-related task. Journal of Accounting Research. 26:1988;315-330.