Linear correlation discovery in databases: A data mining approach

Data and Knowledge Engineering

Volumn 53, Issue 3, 2005, Pages 311-337

  Chiang, Roger H L ^a   Huang Cecil, Chua Eng ^b   Lim, Ee Peng ^c  

^a UNIVERSITY OF CINCINNATI   (United States)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Association measurement; Data mining; Knowledge discovery in database; Linear correlation

Indexed keywords

ALGORITHMS; COGNITIVE SYSTEMS; CORRELATION METHODS; DATA ACQUISITION; DATABASE SYSTEMS; LINEAR EQUATIONS; TRANSFER FUNCTIONS;

ASSOCIATION MEASUREMENT; KNOWLEDGE DISCOVERY IN DATABASES; LINEAR CORRELATION DISCOVERY (LCD); REGRESSION FUNCTIONS;

DATA MINING;

EID: 14544285420     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2004.09.002     Document Type: Article

References (54)

1. R. Agrawal, T. Imielinski, A. Swarni, Mining association rules between sets of items in large databases, in: Proceedings of the 1993 ACM SIGMOD Conference on Management of Data, 1993, pp. 207-216
2. P.D. Scott, A.P.M. Coxon, M.H. Hobbs, R.J. Williams, SNOUT: an intelligent assistant for exploratory data analysis, in: Principles of Data Mining and Knowledge Discovery, First European Symposium, PKDD'97, 1997, pp. 189-199
3. W. Hou Extraction and application of statistical relationships in relational databases IEEE Transactions on Knowledge and Data Engineering 8 6 1996 939 945
4. A.M. Aladwani, A prototype expert system for selecting a multiple comparison test, International Journal of Computer and Engineering Management 6 (1) (1998), (online) http://www.journal.au.edu/ijcem/jan98/
5. C. Böhm, K. Kailing, P. Kröger, A. Zimek, Computing clusters of correlation connected objects, in: ACM SIGMOD Conference on the Management of Data, 2004, pp. 455-466
6. D.J. Hand, Intelligent data analysis: issues and opportunities, in: Proceedings of the Second International Symposium, IDA-97, 1997, pp. 1-14
7. A. Bernstein, F. Provost, Intelligent assistance for the data mining process: an ontology-based approach, IEEE Transactions on Knowledge and Data Engineering, forthcoming
8. A. Bernstein, F. Provost, An intelligent assistant for the knowledge discovery process, in: IJCAI Workshop on Wrappers for Performance Enhancement in Knowledge Discovery in Databases, 2001
9. C. Chua, R.H.L. Chiang, E.-P. Lim, A heuristic method for correlating attribute group pairs in data mining, in: International Workshop on Data Warehousing and Data Mining (DWDM'98), 1998, pp. 29-40
10. C. Chua, R.H.L. Chiang, and E.-P. Lim An intelligent middleware for linear correlation discovery Decision Support Systems 32 4 2002 313 326
11. J.F. Hair Jr., R.E. Anderson, R.L. Tatham, and W. Black Multivariate Data Analysis with Readings fifth ed. 1998 Prentice-Hall
12. W.P. Vogt Dictionary of Statistics and Methodology: A Nontechnical Guide for the Social Sciences 1993 SAGE Publications
13. S. Brin, R. Motwani, C. Silverstein, Beyond market baskets: generalizing association rules to correlations, in: Proceedings of the 1997 ACM SIGMOD International Conference on Management of Data, 1997, pp. 265-276
14. R. Srikant, R. Agrawal, Mining quantitative association rules in large relational tables, in: ACM SIGMOD Conference on Management of Data, 1996, pp. 1-12
15. T.D. Cook, and D.T. Campbell Quasi-Experimentation: Design and Analysis Issues for Field Settings 1979 Houghton Mifflin Company
16. J. Cohen Statistical Power Analysis for the Behavioral Sciences second ed. 1988 Lawrence Erlbaum Associates
17. J.W. Tukey Exploratory Data Analysis 1977 Addison-Wesley
18. C. Glymour, D. Madigau, D. Pregibon, and P. Smyth Statistical themes and lessons for data mining Data Mining and Knowledge Discovery 1 1 1997 11 28
19. P.S.D. Hand, and H. Mannila Principles of Data Mining 2001 MIT Press
20. U. Fayyad, and R. Uthurusamy Data mining and knowledge discovery in databases Communications of the ACM 39 11 1996 24 26
21. U. Fayyad, G. Piatetsky-Shapiro, and P. Smyth From data mining to knowledge discovery in databases AI Magazine 17 3 1996 37 54
22. A. Feelders, H. Daniels, and M. Holsheimer Methodological and practical aspects of data mining Information & Management 37 5 2000 271 281
23. D.V. Huntsberger, and P. Billingsley Elements of Statistical Inference 1987 Allyn and Bacon
24. G.D. Israel, Determining sample size, Fact Sheet PEOD-6, University of Florida(November 1992). { http://hammock.ifas.uf1.edu/txt/fairs/13817 }
25. R.S. Lehman Statistics and Research Design in the Behavioral Sciences 1988 Wadsworth Publishing Company
26. U. Sekaran Research Methods for Business: A Skills Building Approach 1992 John Wiley and Sons
27. J. Neter, W. Wasserman, and M.H. Kutrier Applied Linear Regression Models second ed. 1989 Irwin Homewood
28. R.B. Burns Introduction to Research Methods third ed. 1997 Addison-Wesley
29. J. Jaccard, and M.A. Becker Statistics For the Behavioral Sciences second ed. 1990 Wadsworth Inc.
30. J. Ziman An Introduction to Science Studies: The Philosophical and Social Aspects of Science and Technology 1990 Cambridge University Press
31. L.E. Toothaker Multiple Comparisons for Researchers 1991 SAGE Publications
32. L.E. Toothaker Multiple Comparison Procedures 1993 SAGE Publications
33. F.M. Wolf Meta-Analysis: Quantitative Methods for Research Synthesis, Quantitative Applications in the Social Sciences 1986 SAGE Publications
34. J. Neter, W. Wasserman, and G.A. Whitmore Applied Statistics 1979 Allyn and Bacon Inc.
35. L.C. Lyons, Meta-analysis: methods of accumulating results across research domains, Available at http://wwwl.monumental.com/solomon/MetaAnalysis. html (July 1998)
36. D. Donoho, E. Ramos, PRIMDATA: data sets for use with PRIM-H, (online) http://www.stat.cmu.edu/datasets/ (1982)
37. E.R. Berndt Determinants of wages from the 1985 current population survey The Practice of Econometrics: Classic and Contemporary 1991 Addison-Wesley 193 209 (chapter 5). [online] http://www.stat.cmu.edu/datasets/
38. L.H. Cox, M. Johnson, K. Kafadar, Exposition of statistical graphics technology, in: ASA Proceedings of Statistical Computation Section, 1982, pp.55-56
39. A. Heston, and R. Summers The penn world table (mark 5): an expanded set of international comparisons, 1950-1988 Quarterly Journal of Economics 8 6 1991 327 368
40. T.J. Biblarz, and A.E. Raftery The effects of family disruption on social mobility American Sociological Review 58 1993 97 109
41. V. Greaney, and T. Kelleghan Equality of Opportunity in Irish Schools 1984 Educational Company Dublin
42. March 1995 population survey-classical families, (online) http://www.stat.ucla.edu/data/fpp, 1995
43. R. Kohavi, Scaling up the accuracy of naive-bayes classifiers: a decision-tree hybrid, in: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, 1996, pp. 202-207
44. S.E. Fienberg, U.E. Makov, A.P. Sanil, A Bayesian approach to data disclosure: Optimal intruder behavior for continuous data, Tech. Rep. 11/94, Carnegie-Mellon University, 1994
45. A. Alesina, R. Baqir, and W. Easterly Public goods and ethnic divisions Quarterly Journal of Economics 114 4 1999 1243 1284
46. T. Beck, R. Levine, and N. Loayza Finance and the sources of growth Journal of Financial Economics 58 1-2 2000 261 300
47. J.B. De Long, and L.H. Summers How strongly do developing countries benefit from equipment investment? Journal of Monetary Economics 32 3 1993 395 415
48. StatLib, (online) http://www.stat.cmu.edu/ (1998)
49. C. Blake, E. Keogh, C.J. Merz, UCI repository of machine learning databases, (online) http://www.ics.uci.edu/~mlearn/MLRepository.html, 1998
50. Economic growth research: published articles and data sets arranged by author, (online) http://www.worldbank.org/research/growth/paauthor.htm, 2001
51. L.A. Hayduk Structural Equation Modeling with LISREL 1987 John Hopkins University Press
52. H. Xiong, S. Shekhar, P.-N. Tan, V. Kumar, Exploiting a support-based upper bound of Pearson's correlation coefficient for efficiently identifying strong correlation pairs, in: Proceedings of the Knowledge Discovery in Databases Conference, 2004, pp. 334-343
53. J. Chilson, R. Ng, A. Wagner, R. Zamar, Parallel computation of high dimensional robust correlation and covariance matrices, in: Proceedings of the Knowledge Discovery in Databases Conference, 2004, pp. 533-538
54. M. Kendall, and J.D. Gibbons Rank Correlation Methods fifth ed. 1990 Oxford University Press Oxford, UK