Optimal grouping for group minimax hypothesis testing

IEEE Transactions on Information Theory

Volumn 60, Issue 10, 2014, Pages 6511-6521

  Varshney, Kush R ^a   Varshney, Lav R ^b  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b University of Illinois at Urbana Champaign   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HYPOTHESIS TESTING; MINIMAX;

EID: 84907222904     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2014.2346194     Document Type: Conference Paper

References (45)

1. H. L. Van Trees, Detection, Estimation, and Modulation Theory. New York, NY, USA: Wiley, 1968.
2. H. Robbins, "Asymptotically subminimax solutions of compound statistical decision problems, " in Proc. 2nd Berkeley Symp. Math. Statist. Probab., Berkeley, CA, USA, Jul. /Aug. 1950, pp. 131-148.
3. I. J. Good, "Rational decisions, " J. Roy. Statist. Soc. B, vol. 14, no. 1, pp. 107-114, 1952.
4. J. L. Hodges, Jr. and E. L. Lehmann, "The use of previous experience in reaching statistical decisions, " Ann. Math. Statist., vol. 23, no. 3, pp. 396-407, Sep. 1952.
5. L. J. Savage, The Foundations of Statistics. New York, NY, USA: Wiley, 1954.
6. H. Robbins, "The empirical Bayes approach to statistical decision problems, " Ann. Math. Statist., vol. 35, no. 1, pp. 1-20, Mar. 1964.
7. J. R. Blum and J. Rosenblatt, "On partial a priori information in statistical inference, " Ann. Math. Statist., vol. 38, no. 6, pp. 1671-1678, Dec. 1967.
8. B. Vidakovic, " λ-minimax: A paradigm for conservative robust Bayesians, " in Robust Bayesian Analysis, D. Ríos Insua and F. Ruggeri, Eds. New York, NY, USA: Springer-Verlag, 2000, pp. 241-259.
9. F. Ruggeri, "Gamma-minimax inference, " in Encyclopedia of Statistical Sciences, S. Kotz, C. B. Read, N. Balakrishnan, and B. Vidakovic, Eds. Hoboken, NJ, USA: Wiley, 2006.
10. K. R. Varshney and L. R. Varshney, "Quantization of prior probabilities for hypothesis testing, " IEEE Trans. Signal Process., vol. 56, no. 10, pp. 4553-4562, Oct. 2008.
11. K. R. Varshney, "Bayes risk error is a Bregman divergence, " IEEE Trans. Signal Process., vol. 59, no. 9, pp. 4470-4472, Sep. 2011.
12. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression. Boston, MA, USA: Kluwer, 1992.
13. R. M. Gray and D. L. Neuhoff, "Quantization, " IEEE Trans. Inf. Theory, vol. 44, no. 6, pp. 2325-2383, Oct. 1998.
14. S. Graf and H. Luschgy, Foundations of Quantization for Probability Distributions. Berlin, Germany: Springer-Verlag, 2000.
15. K. R. Varshney and L. R. Varshney, "Multilevel minimax hypothesis testing, " in Proc. IEEE Int. Workshop Statist. Signal Process., Nice, France, Jun. 2011, pp. 109-112.
16. M. Wolfenson and T. L. Fine, "Bayes-like decision making with upper and lower probabilities, " J. Amer. Statist. Assoc., vol. 77, no. 377, pp. 80-88, Mar. 1982.
17. C. Hildreth, "Bayesian statisticians and remote clients, " Econometrica, vol. 31, no. 3, pp. 422-438, Jul. 1963.
18. J. O. Berger, "The robust Bayesian viewpoint, " Dept. Statist., Purdue Univ., West Lafayette, IN, USA, Tech. Rep. 82-9, Apr. 1982.
19. L. R. Pericchi and P. Walley, "Robust Bayesian credible intervals and prior ignorance, " Int. Statist. Rev., vol. 59, no. 1, pp. 1-23, Apr. 1991.
20. D. Bertsimas, D. B. Brown, and C. Caramanis, "Theory and applications of robust optimization, " SIAM Rev., vol. 53, no. 3, pp. 464-501, Jul. 2011.
21. L. R. Varshney, J. B. Rhim, K. R. Varshney, and V. K. Goyal, "Categorical decision making by people, committees, and crowds, " in Proc. Inf. Theory Appl. Workshop, La Jolla, CA, USA, Feb. 2011.
22. A. Banerjee, X. Guo, and H. Wang, "On the optimality of conditional expectation as a Bregman predictor, " IEEE Trans. Inf. Theory, vol. 51, no. 7, pp. 2664-2669, Jul. 2005.
23. A. Banerjee, S. Merugu, I. S. Dhillon, and J. Ghosh, "Clustering with Bregman divergences, " J. Mach. Learn. Res., vol. 6, pp. 1705-1749, Oct. 2005.
24. F. Nielsen, "Hypothesis testing, information divergence and computational geometry, " in Proc. Geometric Sci. Inf., Paris, France, Aug. 2013, pp. 241-248.
25. ∞distortion, " IEEE Signal Process. Lett., vol. 6, no. 2, pp. 25-27, Feb. 1999.
26. N. Sarshar and X. Wu, "Minimax multiresolution scalar quantization, " in Proc. Data Compression Conf., Snowbird, UT, USA, Mar. 2004, pp. 52-61.
27. P. Venkitasubramaniam, L. Tong, and A. Swami, "Minimax quantization for distributed maximum likelihood estimation, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Toulouse, France, May 2006, pp. III-652-III-655.
28. Y. A. Reznik, "An algorithm for quantization of discrete probability distributions, " in Proc. Data Compression Conf., Snowbird, UT, USA, Mar. 2011, pp. 333-342.
29. A. N. Kolmogorov and V. M. Tihomirov, " ε-entropy and ε-capacity of sets in functional spaces, " Amer. Math. Soc. Translations, vol. 17, pp. 277-364, 1961.
30. R. Nock and F. Nielsen, "Fitting the smallest enclosing Bregman balls, " in Proc. Eur. Conf. Mach. Learn., Porto, Portugal, Oct. 2005, pp. 649-656.
31. F. Nielsen, J. -D. Boissonnat, and R. Nock, "Bregman Voronoi diagrams: Properties, algorithms and applications, " INRIA Sophia Antipolis Méditerranée, Valbonne, France, Tech. Rep. 6154, Mar. 2007.
32. J. -D. Boissonnat, F. Nielsen, and R. Nock, "Bregman Voronoi diagrams, " Discrete Comput. Geometry, vol. 44, no. 2, pp. 281-307, Sep. 2010.
33. R. A. Wijsman, "Continuity of the Bayes risk, " Ann. Math. Statist., vol. 41, no. 3, pp. 1083-1085, Jun. 1970.
34. A. V. Trushkin, "Sufficient conditions for uniqueness of a locally optimal quantizer for a class of convex error weighting functions, " IEEE Trans. Inf. Theory, vol. IT-28, no. 2, pp. 187-198, Mar. 1982.
35. K. B. Stolarsky, "Generalizations of the logarithmic mean, " Math. Mag., vol. 48, no. 2, pp. 87-92, Mar. 1975.
36. B. C. Dietel and R. A. Gordon, "Using tangent lines to define means, " Math. Mag., vol. 76, no. 1, pp. 52-61, Feb. 2003.
37. J. Jiao, L. Zhang, and R. D. Nowak, "Minimax-optimal bounds for detectors based on estimated prior probabilities, " IEEE Trans. Inf. Theory, vol. 58, no. 9, pp. 6101-6109, Sep. 2012.
38. J. B. Rhim, L. R. Varshney, and V. K. Goyal, "Quantization of prior probabilities for collaborative distributed hypothesis testing, " IEEE Trans. Signal Process., vol. 60, no. 9, pp. 4537-4550, Sep. 2012.
39. J. B. Rhim, L. R. Varshney, and V. K. Goyal, "Distributed decision making by categorically-thinking agents, " in Decision Making and Imperfection, T. V. Guy, M. Kárný, and D. H. Wolpert, Eds. Berlin, Germany: Springer-Verlag, 2013.
40. G. Gül and A. M. Zoubir. (Jun. 2013). Robust Distributed Detection. Available: http://arxiv.org/pdf/1306.3618
41. P. D. Grünwald and A. P. Dawid, "Game theory, maximum entropy, minimum discrepancy and robust Bayesian decision theory, " Ann. Statist., vol. 32, no. 4, pp. 1367-1433, Aug. 2004.
42. J. B. Rhim, L. R. Varshney, and V. K. Goyal, "Conflict in distributed hypothesis testing with quantized prior probabilities, " in Proc. Data Compression Conf., Snowbird, UT, USA, Mar. 2011, pp. 313-322.
43. G. Loomes and R. Sugden, "Regret theory: An alternative theory of rational choice under uncertainty, " Econ. J., vol. 92, no. 368, pp. 805-824, Dec. 1982.
44. Y. C. Eldar, A. Ben-Tal, and A. Nemirovski, "Linear minimax regret estimation of deterministic parameters with bounded data uncertainties, " IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2177-2188, Aug. 2004.
45. S. Bayram, S. Gezici, and H. V. Poor, "Noise enhanced hypothesistesting in the restricted Bayesian framework, " IEEE Trans. Signal Process., vol. 58, no. 8, pp. 3972-3989, Aug. 2010.