Using data mining techniques to discover bias patterns in missing data

Journal of Data and Information Quality

Volumn 2, Issue 1, 2010, Pages

  Tremblay, Monica Chiarini ^a   Dutta, Kaushik ^a   Vandermeer, Debra ^a  

^a FLORIDA INTERNATIONAL UNIVERSITY   (United States)

Author keywords

Data quality; Missing data; Pattern discovery

Indexed keywords

ASSOCIATION RULE MINING; ATTRIBUTE VALUES; DATA MINING TECHNIQUES; DATA QUALITY; DATA REPOSITORIES; DATA SETS; DATA VALUES; DECISION MAKERS; KNOWLEDGE DISCOVERY AND DATA MININGS; MISSING DATA; SYSTEMATIC BIAS;

ASSOCIATIVE PROCESSING; DECISION MAKING; FILTRATION;

DATA MINING;

EID: 78651565386     PISSN: 19361955     EISSN: 19361963     Source Type: Journal    
DOI: 10.1145/1805286.1805288     Document Type: Article

References (35)

1. AGRAWAL, R. AND SRIKANT, R. 1994. Fast algorithms for mining association rules in large databases. In Proceedings of the 20th International Conference on Very Large Data Bases. M.J. J.B. Bocca, and C. Zaniolo Eds., Morgan Kaufmann Publishers Inc., San Francisco, CA, 487-499.
2. BARBARA, D., DUMOUCHEL, W., FALOUTSOS, C., HASS, P.J., HELLERSTEIN, J. M., IOANNIDIS, Y. E., JAGADISH, H. V., JOHNSON, T., NG, R., POOSALA, V., ROSS, K.A., AND SEVCIK, K. C. 1997. The New Jersey data reduction report. IEEE Data Engin. Bull. 20, 3-45.
3. BREIMAN, L., FRIEDMAN, J. H., OLSHEN, R. A., AND STONE, C. J. 1984. Classification and Regression Trees. Wadsworth International.
4. CSIRIK, J., FRENK, J.B.G., LABBE, M., AND ZHANG, S. 1990. Heuristics for 0-1 min-knapsack problem erasmus. University of Rotterdam - Econometric Institute, Rotterdam.
5. DASH, M., LIU, H., AND YAO, J. 1997. Dimensionality reduction of unsupervised data. In Proceedings of the 9th International Conference on Tools with Artificial Intelligence (ICTAI). IEEE Computer Society, 532.
6. EVEN, A. AND SHANKARANARAYANAN, G. 2007. Utility-driven assessment of data quality. Data Base Advances Inform. Syst. 38, 76-93.
7. FAYYAD, U., PIATETSKY-SHAPIRO, G., AND SMITH, P. 1996. The KDD process for extracting useful knowledge from volumes of data. Comm. ACM 39, 27-34.
8. FISHER, C. W., CHENGALUR-SMITH, I., AND BALLOU, D. P. 2003. The impact of experience and time on the use of data quality information in decision making. Inform. Syst. Resear. 14, 170-188.
9. HAN, J. AND KAMBER, M. 2001. Data Mining: Concepts and Techniques. Morgan Kaufmann, San Francisco, CA.
10. HEINRICH, B., KAISER, M., AND KLIER, M. 2007. How to measure data quality? A metric-based approach. In Proceedings ofthe International Conference on Information Systems (ICIS).
11. HORTON, N. J. AND KLEINMAN, K. P. 2007. Much ado about nothing: A comparison of missing data methods and software to fit incomplete data regression models. Amer. Statist. 61, 79-90.
12. JAIN, A. K. AND DUBES, R. C. 1988. Algorithms for Clustering Data. Prentice Hall, Englewood Cliffs, NJ.
13. JUNG, W., OLFMAN, L., RYAN, T., AND PARK, Y. T. 2005. An experimental study of the effects of contextual data quality and task complexity on decision performance, 149-154.
14. LI, J., SHEN, H., AND TOPOR, R. W. 2001. Mining Optimal Class Association Rule Set. In Proceedings of the 5th Pacific-Asia Conference on Knowledge Discovery and Data Mining.D. W.-L. Cheung, G. J. Williams, and Q. Li Eds., Springer-Verlag, 364-375.
15. LORENCE, D. P. 2003. The perils of data misreporting. Comm. ACM 46, 85-88.
16. MAHNIC, V. 2001. Data quality: A prerequisite for successful data warehouse implementation. Informatica Slovene Soc. Informatika 25, 183-188.
17. MARTELLO, S. AND TOTH, P. 1991. Heuristic algorithms for the multiple knapsack problem. Comput. 27, 93-112.
18. MCKNIGHT, P. E., MCKNIGHT, K. M., SIDANI, S., AND FIGUEREDO, A. J. 2007. Missing Data: A Gentle Introduction. Guilford Press, New York.
19. MICROSOFT. 2005. Microsoft SQL server 2005 sample data warehouse.
20. NETER, J.AND WASSERMAN, W. 1974. Applied Linear Statistical Models; Regression, Analysis of Variance, and Experimental Designs. R. D. Irwin, Homewood, Ill.
21. ORDONEZ, C., SANTANA, C. A., AND BRAAL, L. 2000. Discovering interesting association rules in medical data. In Proceedings of the ACM SIGMOD Workshop on Research Issues on Data Mining and Knowledge Discovery. 78-85.
22. PARSSIAN, A. 2006. Managerial decision support with knowledge of accuracy and completeness of the relational aggregate functions. Decis. Supp. Syst. 42, 1494-1502.
23. PARSSIAN, A., SARKAR, S., AND JACOB, V. S. 2004. Assessing data quality for information products: Impact for selection, projection, and cartesian product. Manage.Sci.50, 967-982.
24. QUINLAN, J. R. 1993. C4.5: Programs for Machine Learning. Morgan Kaufmann.
25. RUBIN, D. B. 1976. Inference and missing data. Biometrika 63, 581-592.
26. SCHEFFER, T. 2001. Finding Association Rules That Trade Support Optimally against Confidence. In Proceedings of the 5th European Conference on Principles of Data Mining and Knowledge Discovery. 424-435.
27. SHANKARANARAYAN, G., ZIAD, M., AND WANG, R. Y. 2003. Managing data quality in dynamic decision environments: An information product approach. J. Datab. Manage. 14, 14-32.
28. SHEN, J.-J. AND CHEN, M.-T. 2003. A recycle technique of association rule for missing value completion. In Proceedings ofthe 7th International Conference on Advanced Information Networking and Applications. IEEE Computer Society, 526.
29. STRONG, D. M., LEE, Y. W., AND WANG, R. Y. 1997. Data quality in context. Comm. ACM 40, 104-110.
30. SUN, S. AND YEN, J. 2005. Information supply chain: A unified framework for information-sharing. In Intelligence and Security Informatics. Springer, 422-428.
31. TROCHIM, W. M. K. 1999. The Research Methods Knowledge Base. Cornell University, Ithaca.
32. WANG, R.Y., REDDY, M.P., AND HENRY, B. K. 1995a. Toward quality data: An attribute-based approach. Decis. Supp. Syst. 13, 349-372.
33. WANG, R. Y., STOREY, V. C., AND FIRTH, C. P. 1995b. A framework for analysis of data quality research. IEEE Trans. Knowl. Data Engin. 7, 623-640.
34. WANG, R.Y. AND STRONG, D. M. 1996. Beyond accuracy: What data quality means to data consumers. J. Manag. Inform. Syst. 12, 5-34.
35. WITTEN, I. H. AND FRANK, E. 2005. Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, San Francisco.