Statistical inference under multiterminal data compression

IEEE Transactions on Information Theory

Volumn 44, Issue 6, 1998, Pages 2300-2324

  Sun Han, Te ^a,c   Amari, Shun Ichi ^a   Han, T S ^b   Amari, S ^b  

^a IEEE   (Japan)

^b UNIVERSITY OF ELECTRO COMMUNICATIONS   (Japan)

^c RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

Author keywords

Covariance; Fisher information; Hypothesis testing; Niultiterniinal data compression; Parameter estimation; Pattern classification; Probability of error; Rate constraint; Statistical inference; Universal coding

Indexed keywords

CONSTRAINT THEORY; ENCODING (SYMBOLS); INFORMATION THEORY; PARAMETER ESTIMATION; PATTERN RECOGNITION; PROBABILITY;

COVARIANCE; FISHER INFORMATION; HYPOTHESIS TESTING; MULTITERMINAL DATA COMPRESSION; RATE CONSTRAINT; STATISTICAL INFERENCE; UNIVERSAL CODING;

DATA COMPRESSION;

EID: 0032182895     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.720540     Document Type: Article

References (48)

1. T. Berger, "Decentralized estimation and decision theory," presented at the IEEE 7th Spring Workshop on Information Theory, Mt. Kisco, NY, Sept. 1979.
2. J. Rissanen, "Universal coding, information, prediction and estimation," IEEE Trans. Inform. Theory, vol. IT-30, pp. 629-636, 1984.
3. R. Ahlswede and I. Csiszâr, "Hypothesis testing with communication constraints," IEEE Trans. Inform. Theory, vol. IT-32, pp. 533-542, July 1986.
4. T. S. Han, "Hypothesis testing with multiterminal data compression," IEEE Trans. Inform. Theory, vol. IT-33, pp. 759-772, Nov. 1987.
5. T. S. Han and K. Kobayashi, "Exponential-type error probabilities for multiterminal hypothesis testing," IEEE Trans. Inform. Theory, vol. 35, pp. 2-14, Jan. 1989.
6. H. M. H. Shalaby and A. Papamarcou, "Multiterminal detection with zero-rate data compression," IEEE Trans. Inform. Theory, vol. 38, pp. 254-267, Mar. 1992.
7. R. Ahlswede, P. Gâcs, and J. Körner, "Bounds on conditional probabilities with applications in mult-user communication," Z.fiir Wahrscheinlichkeitstheorie und ver wandte Gebiete, vol. 34, pp. 157-177, 1976;
8. correction, ibid. vol. 39, pp. 353-354, 1977.
9. K. Marton, "A simple proof of the blowing-up lemma," IEEE Trans. Inform. Theory, vol. IT-32, pp. 445-46, May 1986.
10. S. Amari and T. S. Han, "Statistical inference under multiterminal rate restrictions: A differential geometric approach," IEEE Trans. Inform. Theory, vol. 35, pp. 217-227, Mar. 1989.
11. H. M. H. Shalaby and A. Papamarcou, "Error exponent for distributed detection of Markov sources," IEEE Trans. Inform. Theory, vol. 40, pp. 397-08, Mar. 1994.
12. T. S. Han, H. Shimokawa, and S. Amari, "Error bound of hypothesis testing with data compression," in Proc. IEEE Int. Symp. Information Theory (Trondheim, Norway, 1994), p. 29.
13. Z. Zhang and T. Berger, "Estimation via compressed information," IEEE Trans. Inform. Theory, vol. 34, pp. 198-211, Mar. 1988.
14. S. Amari, "Fisher information under restriction of Shannon information in multi-terminal situations," Ann. Inst. Statist. Math., vol. 41, no. 4, pp. 623-648, 1989.
15. R. Ahlswede and M. Burnashev, "On minimax estimation in the presence of side information about remote data," Ann. Statist., vol. 18, no. 1, pp. 141-171, 1990.
16. T. S. Han and S. Amari, "Parameter estimation with multiterminal data compression," IEEE Trans. Inform. Theory, vol. 41, pp. 1802-1833, Nov. 1995.
17. C. R. Rao, Linear Statistical Inference and its Applications, 2nd ed. New York: Wiley, 1973.
18. J. Körner and K. Marton, "How to encode the modulo 2 sum of two binary sources," IEEE Trans. Inform. Theory, vol. IT-25, pp. 219-221, 1979.
19. T. S. Han and K. Kobayashi, "A dichotomy of functions F(X, Y) of correlated sources (X,Y) from the viewpoint of the achievable rate region," IEEE Trans. Inform. Theory, vol. IT-33, pp. 69-76, Jan. 1987.
20. I. Csiszàr and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic, 1981.
21. T. M. Cover and J. Thomas, Elements of Information Theory. New York: Wiley, 1991.
22. P. Billingsley, Probability and Measure, 3rd ed. New York: Wiley, 1995.
23. S. Amari, Differential Geometrical Methods in Statistics (Lecture Notes in Statistics, no. 28). Berlin-Heidelberg: Springer, 1985.
24. S. Amari and H. Nagaoka, Introduction to Information Geometry, Iwanami Press, Applied Mathematics Series (in Japanese), 1995; English translation to be published by Amer. Math. Soc. and Oxford Univ. Press, 1998.
25. F. Kanaya and T. S. Han, "The asymptotics of posterior entropy and error probability for Bayesian estimation," IEEE Trans. Inform. Theory, vol. 41, pp. 1988-1995, Nov. 1995.
26. R. A. Wiggins and E. A. Robinson, "Recursive solution to the multichannel filtering problem," J. Geo-Phys. Res., vol. 70, no. 8, pp. 1885-1891, 1965.
27. R. R. Tenney and N. R. Sandeil, Jr.,"Detection with distributed sensors," IEEE Trans. Aerosp. Electron. Syst.. vol. AES-17, pp. 501-510, 1981.
28. S. D. Stearns, "Optimal detection using multiple sensors," in P roc. 1982 Carnahan Conf. Crime Countermeasures, 1982.
29. L. K. Ekchian and R. R. Tenny, " Detection networks," in Proc. 21th IEEE Conf. Decision and Control (Orlando, FL, 1982), pp. 686-691.
30. H. J. Kushner and A. Pacut, "A simulation study of a decentralized detection problem," IEEE Trans. Autonmat. Contr., vol. AC-27, pp. 1116-1119, 1982.
31. D. Teneketzis, "The debentralized Wald problem," in IEEE 1982 Int. Large-Scale Systems Symp. (Virginia Beach, 1982), pp. 423-30.
32. D. Teneketzis and P. Varaiya, "The decentralized quickest detection problem," IEEE Trans. Automat. Contr., vol. AC-29, no. 7, pp. 641-64, 1984.
33. J. Tsitsiklis and M. Athins, "On the complexity of distributed decision problems," IEEE Trans. Automat. Contr., vol. AC-30, no. 5, pp. 440-46, 1985.
34. Z. Chair and P. K. Varshney, "Optimal data fusion in multiple sensor detection systems," IEEE Trans. Aerosp. Electron. Syst., vol. AES-22, pp. 98-101, 1986.
35. R. Srinivasan, "Distributed radar detection theory," Proc. Inst. Elec. Eng., vol. 133, pt. F, no. 1, pp. 55-60, 1986.
36. F. A. Sadjadi, "Hypothesis testing in a distributed environment," IEEE Trans. Aerosp. Electron. Syst., vol. AES-22, pp. 134-137, 1986.
37. J. J. Chao and C. C. Eee, "A distributed detection scheme based on soft local decisions," in Proc. 24th Anna. Allerton Conf. Communicayion, Control and Computing, 1986, pp. 974-983.
38. S. C. A. Thomopoulos, R. Viswanathan, and D. P. Bougoulias, "Optimal decision fusion in multiple sensor systems," IEEE Trans. Aerosp. Electron Syst., vol. AES-23, pp. 644-653, 1987.
39. V. Alalo, R. Viswanathan, and S. C. A. Thomopoulos, "A study of distributed detection with correlated sensor noise," presented at Globecom 87, 1987.
40. T. J. Flynn and R. M. Gray, "Encoding of correlated observations," IEEE Trans. Inform. Theory, vol. IT-33, pp. 773-787, Nov. 1987.
41. B. Picinbono and P. Duvaut, " Optimal quantization for detection," IEEE Trans. Commun., vol. 36, pp. 1254-1258, Nov. 1988.
42. M. M. Al-Ibrahim and P. K. Varshney, "Non-parametric sequential detection for multi sensor data," in Proc. 1989 Johns Hopkins Conf. Information Sciences and Systems, 1989, pp. 157-162.
43. N. Sayiner and R. Viswanathan, "Distributed detection in jamming environment," IEEE Trans.Aerosp. Electron Syst., 1990.
44. D. Kazakos, V. Vannicola, and M. C. Wicks, "Signal detection," in Proc. 1989 Johns Hopkins Conf. Information Sciences and Systems, 1989, pp. 180-185.
45. H. R. Hashemi and I. B. Rhodes, "Decentralized sequential detection," IEEE Trans. Inform. Theory, vol. IT-35, pp. 509-520, May 1989.
46. I. Y. Hoballah and P. K. Varshney, "An information theoretic approach to the distributed detection problem," IEEE Trans. Inform. Theory, vol. 35, pp. 988-994, 1989.
47. "Distributed Bayesian signal detection," IEEE Trans. Inform. Theory, vol. 35, pp. 995-1000, 1989.
48. T. S. Han and K. Kobayashi, "Multiterminal filtering for decentralized detection systems," IEICE Trans. Commun., vol. E75-B, no. 6, pp. 437-44, 1992.