Deep lattice networks and partial monotonic functions

Advances in Neural Information Processing Systems

Volumn 2017-December, Issue , 2017, Pages 2982-2990

  You, Seungil ^a   Ding, David ^a   Canini, Kevin ^a   Pfeifer, Jan ^a   Gupta, Maya R ^a  

^a GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; PIECEWISE LINEAR TECHNIQUES; STOCHASTIC SYSTEMS;

ALTERNATING LAYERS; COMPUTATIONAL GRAPH; LATTICE NETWORKS; MONOTONIC FUNCTIONS; PIECE-WISE LINEAR FUNCTIONS; REAL-WORLD DATASETS; STATE-OF-THE-ART PERFORMANCE; STOCHASTIC GRADIENT;

CLASSIFICATION (OF INFORMATION);

EID: 85047020173     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. M. R. Gupta, A. Cotter, J. Pfeifer, K. Voevodski, K. Canini, A. Mangylov, W. Moczydlowski, and A. Van Esbroeck. Monotonic calibrated interpolated look-up tables. Journal of Machine Learning Research, 17(109):1-47, 2016.
2. E. K. Garcia and M. R. Gupta. Lattice regression. In Advances in Neural Information Processing Systems (NIPS), 2009.
3. K. Canini, A. Cotter, M. M. Fard, M. R. Gupta, and J. Pfeifer. Fast and flexible monotonic functions with ensembles of lattices. Advances in Neural Information Processing Systems (NIPS), 2016.
4. A. Howard and T. Jebara. Learning monotonic transformations for classification. Advances in Neural Information Processing Systems (NIPS), 2007.
5. L. Lovász. Submodular functions and convexity. In Mathematical Programming The State of the Art, pages 235-257. Springer, 1983.
6. P. Groeneboom and G. Jongbloed. Nonparametric estimation under shape constraints. Cambridge Press, New York, USA, 2014.
7. N. P. Archer and S. Wang. Application of the back propagation neural network algorithm with monotonicity constraints for two-group classification problems. Decision Sciences, 24(1):60-75, 1993.
8. S. Wang. A neural network method of density estimation for univariate unimodal data. Neural Computing & Applications, 2(3):160-167, 1994.
9. H. Kay and L. H. Ungar. Estimating monotonic functions and their bounds. AIChE Journal, 46(12):2426-2434, 2000.
10. C. Dugas, Y. Bengio, F. Bélisle, C. Nadeau, and R. Garcia. Incorporating functional knowledge in neural networks. Journal Machine Learning Research, 2009.
11. A. Minin, M. Velikova, B. Lang, and H. Daniels. Comparison of universal approximators incorporating partial monotonicity by structure. Neural Networks, 23(4):471-475, 2010.
12. H. Daniels and M. Velikova. Monotone and partially monotone neural networks. IEEE Trans. Neural Networks, 21(6):906-917, 2010.
13. J. Sill. Monotonic networks. Advances in Neural Information Processing Systems (NIPS), 1998.
14. W. W. Armstrong and M. M. Thomas. Adaptive logic networks. Handbook of Neural Computation, Section C1.8, IOP Publishing and Oxford U. Press, ISBN 0 7503 0312, 3, 1996.
15. M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, S. Ghemawat, I. Goodfellow, A. Harp, G. Irving, M. Isard, Y. Jia, R. Jozefowicz, L. Kaiser, M. Kudlur, J. Levenberg, D. Mané, R. Monga, S. Moore, D. Murray, C. Olah, M. Schuster, J. Shlens, B. Steiner, I. Sutskever, K. Talwar, P. Tucker, V. Vanhoucke, V. Vasudevan, F. Viégas, O. Vinyals, P. Warden, M. Wattenberg, M. Wicke, Y. Yu, and X. Zheng. TensorFlow: Large-scale machine learning on heterogeneous systems, 2015. Software available from tensorflow.org.
16. D. Kingma and J. Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 2014.
17. M. Ayer, H. D. Brunk, G. M. Ewing, W. T. William, E. Silverman, et al. An empirical distribution function for sampling with incomplete information. The annals of mathematical statistics, 26(4):641-647, 1955.
18. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends® in Machine Learning, 3(1):1-122, 2011.
19. C. Blake and C. J. Merz. UCI repository of machine learning databases, 1998.