The effects and interactions of data quality and problem complexity on data mining

Proceedings of the 2008 International Conference on Information Quality, ICIQ 2008

Volumn , Issue , 2008, Pages

  Blake, Roger H ^a   Mangiameli, Paul ^b  

^a UNIVERSITY OF MASSACHUSETTS BOSTON   (United States)

^b UNIVERSITY OF RHODE ISLAND   (United States)

Author keywords

Business Intelligence and IQ; Data Warehouses and Data Mining; IQ Concepts; Measures; Metrics; Models; Tools

Indexed keywords

CONCEPTUAL MODEL; DATA QUALITY; INTERACTION EFFECT; IQ CONCEPTS; KEY DETERMINANTS; MEASURES; METRICS; PROBLEM COMPLEXITY; RESEARCH CHALLENGES;

DATA REDUCTION; DATA WAREHOUSES; MODELS; RESEARCH; TOOLS;

DATA MINING;

EID: 84871571829     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. P. Atzeni, Conceptual modeling-er 2004: Er 2004: 23rd international conference on conceptual modeling, shanghai, china, november 8-12, 2004: Proceedings, Springer, 2004.
2. D.P. Ballou and H.L. Pazer, "Modeling data and process quality in multi-input, multi-output information systems," Management Science, vol. 31, no. 2, 1985, pp. 150-162.
3. D.P. Ballou and H.L. Pazer, "Modeling completeness versus consistency tradeoffs in information decision contexts," IEEE Transactions on Knowledge and Data Engineering, vol. 15, no. 1, 2003, pp. 240- 243.
4. R.A. Dillard, "Using data quality measures in decision-making algorithms," IEEE Intelligent Systems and Their Applications, vol. 7, no. 6, 1992, pp. 63-72.
5. C. Fisher, E. Lauria, and C. Matheus, "In search of an accuracy metric " in Proceedings of International Conference on Information Quality, Cambridge, MA, 2007.
6. M. Ge and M. Helfert, "A framework to assess decision quality using information quality dimensions," in Proceedings of Proceedings of the 2006 International Conference on Information Quality, Cambridge, MA, 2006.
7. M. Ge and M. Helfert, "A review of information quality research," in Proceedings of International Conference on Information Quality, Cambridge, MA, 2007.
8. P. Gomes, J. Farinha, and M.J. Trigueiros, "A data quality metamodel extension to cwm," Proceedings of the fourth Asia-Pacific conference on conceptual modeling-, vol. 67, 2007, pp. 17-26.
9. J.M. Juran, Juran on quality by design: The new steps for planning quality into goods and services, Free Press, 1992.
10. B.D. Klein, D.L. Goodhue, and G.B. Davis, "Can humans detect errors in data? Impact of base rates, incentives, and goals," MIS Quarterly, vol. 21, no. 2, 1997, pp. 169-194.
11. R. Kohavi, N.J. Rothleder, and E. Simoudis, "Emerging trends in business analytics," Communications of the ACM, vol. 45, no. 8, 2002, pp. 45-48.
12. K. Lakshminarayan, S.A. Harp, and T. Samad, "Imputation of missing data in industrial databases," Applied Intelligence, vol. 11, no. 3, 1999, pp. 259-275.
13. W.Z. Liu, A.P. White, S.G. Thompson, and M.A. Bramer, "Techniques for dealing with missing values in classification," Lecture Notes in Computer Science, vol. 1280, 1997, pp. 527-536.
14. J. Maddox, "Complicated measures of complexity," Nature, vol. 344, no. 6268, 1990, pp. 705.
15. S.T. March and A.R. Hevner, "Integrated decision support systems: A data warehousing perspective," Decision Support Systems, vol. 43, no. 3, 2007, pp. 1031-1043.
16. T.M. Mitchell, Machine learning. , Mac Graw Hill, 1997.
17. A. Motro and I. Rakov, "Estimating the quality of databases," Flexible query answering systems, Vol. Volume 1495/1998, Springer, 1998.
18. T. Oates and D. Jensen, " The effects of training set size on decision tree complexity," in Proceedings of Proceedings of the Fourteenth International Conference on Machine Learning, 1997, Morgan Kaufmann Publishers Inc., pp. 254-262.
19. C. Ordonez and J. García-García, "Referential integrity quality metrics," Decision Support Systems, vol. 44, no. 2, 2008, pp. 495-508.
20. A. Parssian, "Managerial decision support with knowledge of accuracy and completeness of the relational aggregate functions," Decision Support Systems, vol. 42, no. 3, 2006, pp. 1494-1502.
21. A. Parssian, S. Sarkar, and V.S. Jacob, "Assessing data quality for information products: Impact of selection, projection, and cartesian product," Management Science, vol. 50, no. 7, 2004, pp. 967.
22. L.L. Pipino, Y.W. Lee, and R.Y. Wang, "Data quality assessment," Communications of the ACM, vol. 45, no. 4, 2002, pp. 211-218.
23. J.R. Quinlan, "Induction of decision trees," Machine Learning, vol. 1, no. 1, 1986, pp. 81-106.
24. T.C. Redman, "Data: An unfolding quality disaster," DM Review, vol. 6, 2004, pp.
25. G. Shankaranarayanan and Y. Cai, "Supporting data quality management in decision-making," Decision Support Systems, vol. 42, no. 1, 2006, pp. 302-317.
26. Y. Su and Z. Jin, "Assessment and improvement of data and information quality," in L. Al-Hakim, ed., Information quality management: Theory and applications, Idea Group Inc., 2007.
27. J. Taylor and N. Raden, Smart (enough) systems: How to deliver competitive advantage by automating hidden decisions, Prentice Hall Professional Technical Reference, 2007.
28. Y. Wand and R.Y. Wang, "Anchoring data quality dimensions in ontological foundations," Communications of the ACM, vol. 39, no. 11, 1996, pp. 86-95.
29. R.Y. Wang, M.P. Reddy, and H.B. Kon, "Toward quality data: An attribute-based approach," Decision Support Systems, vol. 13, no. 3-4, 1995, pp. 349-372.
30. R.Y. Wang, V.C. Storey, and C.P. Firth, "A framework for analysis of data quality research," Knowledge and Data Engineering, IEEE Transactions on, vol. 7, no. 4, 1995, pp. 623-640.
31. R.Y. Wang, M. Ziad, and Y.W. Lee, Data quality, Kluwer Academic Publishers, 2000.
32. I.H. Witten and E. Frank, Data mining: Practical machine learning tools and techniques, Morgan Kaufmann, 2005.
33. H. Xiong, G. Pandey, M. Steinbach, and V. Kumar, "Enhancing data analysis with noise removal," IEEE Transactions on Knowledge and Data Engineering, vol. 18, no. 3, 2006, pp. 304-319.