Applying control chart methods to enhance data quality

Technometrics

Volumn 56, Issue 1, 2014, Pages 29-41

  Jones Farmer, L Allison ^a   Ezell, Jeremy D ^a   Hazen, Benjamin T ^b  

^a AUBURN UNIVERSITY   (United States)

^b USAF   (United States)

Author keywords

Attributes control chart; Data analytics; Data production process; Process improvement; Quality management

Indexed keywords

EID: 84894589633     PISSN: 00401706     EISSN: 15372723     Source Type: Journal    
DOI: 10.1080/00401706.2013.804437     Document Type: Article

References (92)

1. Arnold, S. E. (1992), "InformationManufacturing: The Road to Database Quality, " Database, 15, 32-39.
2. Ballou, D. P., and Pazer, H. L. (1985), "Modeling Data and Process Quality in Multi-Input, Multi-Output Information Systems, " Management Science, 31, 150-162.
3. Ballou, D. P., Wang, R., Pazer, H., and Tayi, G. K. (1998), "Modeling InformationManufacturing Systems to Determine Information Product Quality, " Management Science, 44, 462-484.
4. Batini, C., Cappiello, C., Francalanci, C., and Maurino, A. (2009), "Methodologies for Data Quality Assessment and Improvement, " Association for Computing Machinery Computing Surveys, 41, 1-52.
5. Blake, R., and Mangiameli, P. (2011), "The Effects and Interactions of Data Quality and Problem Complexity on Classification, " Association for Computing Machinery Journal of Data and Information Quality, 2, 1-28.
6. Borror, C. M., and Champ, C. W. (2001), "Phase I Control Charts for Independent Bernoulli Data, " Quality and Reliability Engineering International, 17, 391-396.
7. Bose, R. (2009), "Advanced Analytics: Opportunities and Challenges, " Industrial Management + Data Systems, 109, 155.
8. Breslin, M. (2004), "Data Warehousing Battle of the Giants: Comparing the Basics of the Kimball and Inmon Models, " Business Intelligence Journal, 9, 6-20.
9. Chakraborti, S., and Human, S. (2006), "Parameter Estimation and Performance of the-Chart for Attributes Data, " IEEE Transactions on Reliability, 55, 559-566.
10. Chinnam, R. B. (2002), "Support Vector Machines for Recognizing Shifts in Correlated and Other Manufacturing Processes, " International Journal of Production Research, 40, 4449-4466.
11. Cohen, J., Cohen, P., West, S. G., and Aiken, L. S. (2003), Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences (3rd ed.), Mahwah, NJ: Lawrence Earlbaum Associates, Inc.
12. Cook, D. F., and Chiu, C. C. (1998), "Using Radial Basis Function Neural Networks to Recognize Shifts in Correlated Manufacturing Process Parameters, " IIE Transactions, 30, 227-234.
13. Coronel, C., Morris, S., and Rob, P. (2011), Database Systems: Design, Implementation, and Management, Boston, MA: Cengage Learning.
14. Davenport, T. H., and Prusak, L. (2000), Working Knowledge: How Organizations Manage What They Know, Boston, MA: Harvard Business Press.
15. Deming, W. E., and Geoffrey, L. (1941), "On Sample Inspection in the Processing of Census Returns, " Journal of the American Statistical Association, 36, 351-360.
16. Deng, H., Runger, G. C., and Tuv, E. (2012), "Systems Monitoring with Real Time Contrasts" Journal of Quality Technology, 44, 9-27.
17. Duncan, A. J. (1950), "AChi-Square Chart for Controlling a Set of Percentages, " Industrial Quality Control, 7, 11-15.
18. Eching, S. O., and Snyder, R. L. (2004), "Statistical Control Charts for Quality Control of Weather Data for Reference Evapotranspiration Estimation, " in ISHS Acta Horticulturae IV International Symposium on Irrigation of Horticultural Crops, pp. 189-196.
19. Emery, J. C. (1969), Organizational Planning and Control Systems: Theory and Management, New York, NY: Macmillan.
20. Even, A., and Shankaranarayanan, G. (2009), "Dual Assessment ofData Quality in Customer Databases, " Journal of Data and Information Quality, 1, 1-29.
21. Fraley, C., and Raftery, A. E. (2002), "Model-Based Clustering, Discriminant Analysis, and Density Estimation, " Journal of the American Statistical Association, 97, 611-631.
22. Garvin, D. A. (1984), "What Does 'Product Quality' Really Mean?, " Sloan Management Review, 26, 25-43.
23. Garvin, D. A. (1987), "Competing on the Eight Dimensions of Quality, " Harvard Business Review, 65, 101-109.
24. Gomes, P., Farinha, J., and Trigueiros, M. J. (2007), "A Data Quality Metamodel Extension to Cwm, " in Australian Computer Society, Inc., 4th Asia-Pacific Conference on Conceptual Modeling, pp. 17-26.
25. Haug, A., and Arlbjørn, J. S. (2011), "Barriers toMaster Data Quality, " Journal of Enterprise Information Management, 24, 288-303.
26. Haug, A., Arlbjørn, J. S., and Pedersen, A. (2009), "A Classification Model of Erp System Data Quality, " Industrial Management & Data Systems, 109, 1053.
27. Huang, K., Lee, Y., andWang, R.Y. (1999), Quality Information and Knowledge, Saddle River, NJ: Prentice Hall.
28. Huh, Y. U., Keller, F. R., Redman, T. C., and Watkins, A. R. (1990), "Data Quality, " Information and Software Technology, 32, 559-565.
29. Hwang, W., Runger, G., and Tuv, E. (2007), "Multivariate Statistical Process Control With Artificial Contrasts, " IIE Transactions, 39, 659-669.
30. IBM (2011), "Yale School of Management and Ibm Collaborate to Prepare Students with Analytics Skills for the Next Generation of Jobs, " PR Newswire Association LLC. com/news-releases/yale-school-of-management-And- ibm-collaborate-Toprepare-students-with-Analytics-skills-for-The-next- generation-of-jobs-120 836949.html
31. Inmon, W. H. (1992), Building the Data Warehouse, New York, NY: Wiley.
32. Jobe, J. M., and Pokojovy, M. (2009), "A Multistep, Cluster-Based Multivariate Chart for Retrospective Monitoring of Individuals, " Journal of Quality Technology, 41, 323-339.
33. Jones-Farmer, L. A., Jordan, V., and Champ, C. W. (2009), "Distribution-Free Phase I Control Charts for Subgroup Location, " Journal of Quality Technology, 41, 304-316.
34. Jones, L. A., Woodall, W. H., and Conerly, M. D. (1999), "Exact Properties of Demerit Control Charts, " Journal of Quality Technology, 31, 207-216.
35. Kahn, B. K., Strong, D. M., and Wang, R. Y. (2002), "Information Quality Benchmarks: Product and Service Performance, " Communications of the Association for Computing Machinery, 45, 184-192.
36. Kalakota, R. (2012), "Gartner Says-Bi andAnalytics a $12.2Bln Market, "Business Analytics 3.0 [online], available at http://practicalanalytics.wordpress. com/2011/04/24/gartner-says-bi-And- Analytics-A-10-5-bln-market/
37. Kimball, R., Ross, M., Thorthwaite, W., Becker, B., and Mundy, J. (1998), The Data Warehouse Lifecycle Toolkit, New York, NY: Wiley-India.
38. Laudon, K. C. (1986), "Data Quality and Due Process in Large Interorganizational Record Systems, " Communications of the Association for Computing Machinery, 29, 4-11.
39. Lee, Y. W., Pipino, L., Strong, D. M., and Wang, R. Y. (2004), "Process-Embedded Data Integrity, " Journal of Database Management, 15, 87(17).
40. Lee, Y. W., Strong, D. M., Kahn, B. K., and Wang, R. Y. (2002), "Aimq: A Methodology for Information Quality Assessment, " Information & Management, 40, 133-146.
41. Lenz, H-J., and Borowski, E. (2010), "Business Data Quality Control-A Step by Step Procedure, " in Frontiers in Statistical Quality Control (Vol. ), eds. H-J. Lenz, W. Schmid and P-T. Wilrich, Heidelberg: Springer, pp. 371-383.
42. Li, J., Tsung, F., and Zou, C. (2012), "Directional Control Schemes for Multivariate Categorical Processes, " Journal of Quality Technology, 44, 136-154.
43. Lohr, S. (2009), "For Today's Graduate, Just One Word: Statistics, " NYTimes.com [online], available at http://www.nytimes.com/2009/08/06/
44. technology/06stats.html?hpw
45. Lu, X. S., Xie, M., Goh, T. N., and Lai, C. D. (1998), "Control Chart for Multivariate Attribute Processes, " International Journal of Production Research, 36, 3477-3489.
46. March, S. T., and Hevner, A. R. (2007), "Integrated Decision Support Systems:A DataWarehousing Perspective, " Decision Support Systems, 43, 1031-1043.
47. Marcucci, M. (1985), "Monitoring Multinomial Processes, " Journal of Quality Technology, 17, 86-91.
48. McLachlan, G., and Peel, D. (2000), Finite Mixture Models, New York, NY: Wiley.
49. McNurlin, B. C., and Sprague, R. H. (2006), Information Systems Management in Practice (7th ed.), Upper Saddle River, NJ: Pearson Prentice Hall.
50. Montgomery, D. C., and Woodall, W. H. (2008), "An Overview of Six Sigma, " International Statistical Review, 76, 329-346.
51. Montgomery, D. M. (2013), Introduction to Statistical Quality Control (7th ed.), New York: Wiley.
52. Morey, R. C. (1982), "Estimating and Improving the Quality of Information in a Mis, " Communications of the Association for Computing Machinery, 25, 337-342.
53. Muth'en, B., du Toit, S. H. C., and Spisic, D. (1997), "Robust Inference Using Weighted Least Squares and Quadratic Estimating Equations in Latent Variable Modeling With Categorical and Continuous Outcomes, " accepted for publication in Psychometrika, preprint available at http://pages.gseis.ucla.edu/faculty/muthen/articles/Article 075.pdf
54. Nedumaran, G., and Pignatiello, Jr., J. J. (2005), "On Constructing Retrospective-X Control Chart Limits, " Quality and Reliability Engineering International, 21, 81-89.
55. Nelson, L. S. (1987), "A Chi-Square Control Chart for Several Proportions, " Journal of Quality Technology, 19, 229-231.
56. Neter, J. (1952), "Some Applications of Statistics for Auditing, " Journal of the American Statistical Association, 47, 6-24.
57. Nunnally, B., and Thoele, B. (2007), "Logistics Analysis, " Air Force Journal of Logistics, 31, 124-127.
58. Oracle Corporation. (2012), Oracle Warehouse Builder, Redwood Shores, CA: Oracle Corporation.
59. Parssian, A. (2006), "Managerial Decision Support With Knowledge of Accuracy and Completeness of the Relational Aggregate Functions, " Decision Support Systems, 42, 1494-1502.
60. Patel, H. I. (1973), "Quality Control Methods for Multivariate Binomial and Multivariate Poisson Distributions, " Technometrics, 15, 103-112.
61. Pautke, R., and Redman, T. (1990), "Techniques to Control and Improve Quality of Data Large Databases, " in the Proceedings of the Statistics Canada Symposium 90: Measurement and Improvement of Data Quality, pp. 319-333.
62. Pierchala, C. E., Surti, J., Peytcheva, E., Groves, R. M., Kreuter, F., Kohler, U., Chipperfield, J. O., Steel, D. G., Graham, P., and Young, J. (2009), "Control Charts as a Tool for Data Quality Control, " Journal of Official Statistics, 25, 167-191.
63. Pipino, L. L., Lee, Y. W., and Wang, R. Y. (2002), "Data Quality Assessment, " Communications of the Association for ComputingMachinery, 45, 211-218.
64. Pitt, L. F., Watson, R. T., and Kavan, C. B. (1995), "Service Quality: A Measure of Information System Effectiveness, " Management Information Systems Quarterly, 19, 173-188.
65. Redman, T. C. (1992), Data Quality: Management and Technology, New York, NY: Bantam Books.
66. Redman, T. C. (1996), Data Quality for the Information Age, Norwood, MA: Artech House Publishers.
67. Redman, T. C. (2001), Data Quality: The Field Guide, Boston, MA: Digital Press.
68. Redman, T. C. (2008), "To Solve This Data-Driven Crises, We Need Better Data, " Harvard Business School Press: Discussion Starter [online]. Available at http://blogs.hbr.org/cs/2008/09/we need better data to solve t.html\
69. Reynolds, Jr., M. R., and Stoumbos, Z. G. (1999), "A Cusum Chart for Monitoring a Proportion When Inspecting Continuously, " Journal of Quality Technology, 31, 87-108.
70. Ronen, B., and Spiegler, I. (1991), "Information as Inventory: A New Conceptual View, " Information & Management, 21, 239-247.
71. Ryan, A. G., Wells, L. J., and Woodall, W. H. (2011), "Methods of Monitoring Multiple Proportions When Inspecting Continuously, " Journal of Quality Technology, 43, p. 237.
72. Scannapieco, M., and Catarci, T. (2002), "Data Quality Under a Computer Science Perspective, " Archivi & Computer, 2, 1-15.
73. Shankaranarayanan, G., and Even, A. (2004), "Managing Metadata in Data Warehouses: Pitfalls and Possibilities, " Communications of the Association for Information Systems, 14, 13.
74. Sparks, R., and OkuGami, C. (2010), "Data Quality: Algorithims for Automatic Detection of Unusual Measurements, " in Frontiers in Statistical Quality Control (Vol. 10), eds. H-J. Lenz, W. Schmid and P-T.Wilrich, Heidelberg: Springer, pp. 371-383.
75. Sullivan, J. H. (2002), "Detection of Multiple Change Points From Clustering Individual Observations, " Journal of Quality Technology, 34, 371-383.
76. Sun, R., and Tsung, F. (2003), "A Kernel-Distance-Based Multivariate Control Chart Using Support Vector Methods, " International Journal of Production Research, 41, 2975-2989.
77. Tayi, G.K., and Ballou, D.P. (1998), "Examining Data Quality, " Communications of the ACM, 42, 54-57.
78. Thissen, U., Swierenga, H., De Weijer, A., Wehrens, R., Melssen, W., and Buydens, L. (2005), "Multivariate Statistical Process Control Using Mixture Modelling, " Journal of Chemometrics, 19, 23-31.
79. Topalidou, E., and Psarakis, S. (2009), "Review of Multinomial and Multiattribute Quality Control Charts, " Quality and Reliability Engineering International, 25, 773-804.
80. Vetterli, T., Vaduva, A., and Staudt, M. (2000), "Metadata Standards for Data Warehousing: Open InformationModelVs.CommonWarehouse Metadata, " Association for Computing Machinery Special Interest Group on Management of Data Record, 29, 68-75.
81. Wand, Y., andWang, R. Y. (1996), "Anchoring Data Quality Dimensions in Ontological Foundations, " Communications of the Association for Computing Machinery, 39, 86-95.
82. Wang, R.Y. (1998), "AProduct Perspective onTotal Data Quality Management, " Communications of the Association for Computing Machinery, 41, 58-65.
83. Wang, R. Y., and Kon, H. B. (1993), "Towards Total Data Quality Management (Tdqm), " in Information Technology in Action: Trends and Perspectives, ed. R. Y. Wang, Englewood Cliffs, NJ: Prentice-Hall.
84. Wang, R. Y., Storey, V. C., and Firth, C. P. (1995), "A Framework for Analysis of Data Quality Research, " IEEE Transactions on Knowledge and Data Engineering, 7, 623-640.
85. Wang, R. Y., and Strong, D. M. (1996), "Beyond Accuracy: What Data Quality Means to Data Consumers, " Journal of Management Information Systems, 12, 5-33.
86. Warth, J., Kaiser, G., and Kügler, M. (2011), "The Impact of Data Quality and Analytical Capabilities on Planning Performance: Insights From the Automotive Industry, " in 10th International Conference on Wirtschaftsinformatik, Zurich, Switzerland, pp. 322-331.
87. Watts, S., Shankaranarayanan, G., and Even, A. (2009), "Data Quality Assessment in Context: A Cognitive Perspective, " Decision Support Systems, 48, 202-211.
88. Wixom, B. H., and Watson, H. J. (2001), "An Empirical Investigation of the Factors Affecting Data Warehousing Success, " Management Information Systems Quarterly, 25, 17-41.
89. Yang, C-H., and Hillier, F. S. (1970), "Mean and Variance Control Chart Limits Based on a Small Number of Subgroups, " Journal of Quality Technology, 2, 9-16.
90. Yang, Z., Xie, M., Kuralmani, V., and Tsui, K-L. (2002), "On the Performance of Geometric Charts With Estimated Control Limits, " Journal of Quality Technology, 34, 448-458.
91. Zhang, H., Albin, S. L., Wagner, S. R., Nolet, D. A., and Gupta, S. (2010), "Determining Statistical Process Control Baseline Periods in Long Historical Data Streams, " Journal of Quality Technology, 42, 21-35.
92. Zhang, M., Peng, Y., Schuh, A., Megahed, F. M., and Woodall, W. H. (2012), "Geometric ChartsWith Estimated Control Limits, " Quality and Reliability Engineering International, 29, 209-223.