Mind the gap: A generative approach to interpretable feature selection and extraction

Advances in Neural Information Processing Systems

Volumn 2015-January, Issue , 2015, Pages 2260-2268

  Kim, Been ^a   Shah, Julie ^a   Doshi Velez, Finale ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EXTRACTION; INFORMATION SCIENCE;

DATA EXPLORATION; DOMAIN EXPERTS; FEATURE EXTRACTION AND SELECTION; FEATURE SELECTION AND EXTRACTIONS; HYPOTHESIS GENERATION; INTERPRETABILITY; INTERPRETABILITY CRITERION; REAL-WORLD DATASETS;

FEATURE EXTRACTION;

EID: 84965150991     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. G. A. Miller, "The magical number seven, plus or minus two: Some limits on our capacity for processing information", The Psychological Review, pp. 81-97, March 1956.
2. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation", JMLR, pp. 3:993-1022, 2003.
3. H. Zou, T. Hastie, and R. Tibshirani, "Sparse principal component analysis", Journal of Computational and Graphical Statistics, vol. 15, p. 2006, 2004.
4. K. Than and T. B. Ho, "Fully sparse topic models", in ECML-PKDD, pp. 490-505, 2012.
5. S. Williamson, C. Wang, K. Heller, and D. Blei, "The ibp compound dirichlet process and its application to focused topic modeling", ICML, 2010.
6. E. Elhamifar and R. Vidal, "Sparse subspace clustering: Algorithm, theory, and applications", IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 11, pp. 2765-2781, 2013.
7. R. Agrawal, J. Gehrke, D. Gunopulos, and P. Raghavan, "Automatic subspace clustering of high dimensional data for data mining applications", SIGMOD Rec., vol. 27, pp. 94-105, June 1998.
8. B. Kim, C. Rudin, and J. A. Shah, "The Bayesian Case Model: A generative approach for case-based reasoning and prototype classification", in NIPS, 2014.
9. R. K, "Differential diagnosis in primary care", JAMA, vol. 307, no. 14, pp. 1533-1534, 2012.
10. Z. J and Y. KF, "What's the relative risk?: A method of correcting the odds ratio in cohort studies of common outcomes", JAMA, vol. 280, no. 19, pp. 1690-1691, 1998.
11. S. Alelyani, J. Tang, and H. Liu, "Feature selection for clustering: A review.", Data Clustering: Algorithms and Applications, vol. 29, 2013.
12. S. Guérif, "Unsupervised variable selection: when random rankings sound as irrelevancy.", in FSDM, 2008.
13. P. Mitra, C. Murthy, and S. K. Pal, "Unsupervised feature selection using feature similarity", IEEE transactions on pattern analysis and machine intelligence, vol. 24, no. 3, pp. 301-312, 2002.
14. M. Dash and H. Liu, "Feature selection for clustering", in KDD: Current Issues and New Applications, pp. 110-121, 2000.
15. K. Tsuda, M. Kawanabe, and K.-R. Mller, "Clustering with the fisher score", in NIPS, 2003.
16. J. G. Dy and C. E. Brodley, "Feature selection for unsupervised learning", JMLR, pp. 5:845-889, 2004.
17. Y. Guan, J. G. Dy, and M. I. Jordan, "A unified probabilistic model for global and local unsupervised feature selection.", in ICML, pp. 1073-1080, 2011.
18. W. Fan and N. Bouguila, "Online learning of a dirichlet process mixture of generalized dirichlet distributions for simultaneous clustering and localized feature selection.", in ACML, pp. 113-128, 2012.
19. G. Yu, R. Huang, and Z. Wang, "Document clustering via dirichlet process mixture model with feature selection", in KDD, pp. 763-772, ACM, 2010.
20. A. A. Freitas, "Comprehensible classification models: a position paper", ACM SIGKDD Explorations Newsletter, 2014.
21. G. De'ath and K. E. Fabricius, "Classification and regression trees: a powerful yet simple technique for ecological data analysis", Ecology, vol. 81, no. 11, pp. 3178-3192, 2000.
22. M. J. Wainwright and M. I. Jordan, "Graphical models, exponential families, and variational inference", Foundations and Trends in Machine Learning, vol. 1, no. 1-2, pp. 1-305, 2008.
23. M. Lichman, "UCI machine learning repository", 2013.
24. C. Kemp and J. B. Tenenbaum, "The discovery of structural form", PNAS, 2008.
25. F. Doshi-Velez, Y. Ge, and I. Kohane, "Comorbidity clusters in autism spectrum disorders: an electronic health record time-series analysis", Pediatrics, vol. 133, no. 1, pp. e54-e63, 2014.
26. A. Kulesza, Learning with Determinantal Point Processes. PhD thesis, University of Pennsylvania, 2012.
27. A. Kulesza and B. Taskar, "Structured determinantal point processes", in NIPS, 2010.
28. J. Y. Zou and R. P. Adams, "Priors for diversity in generative latent variable models", in NIPS, 2012.
29. N. K. Batmanghelich, G. Quon, A. Kulesza, M. Kellis, P. Golland, and L. Bornn, "Diversifying sparsity using variational determinantal point processes", CoRR, 2014.
30. J. Eisenstein, A. Ahmed, and E. P. Xing, "Sparse additive generative models of text", ICML, 2011.
31. J. Y. Zou, D. J. Hsu, D. C. Parkes, and R. P. Adams, "Contrastive learning using spectral methods", in NIPS, 2013.
32. J. Zhu, A. Ahmed, and E. P. Xing, "Medlda: maximum margin supervised topic models for regression and classification", in ICML, pp. 1257-1264, ACM, 2009.