Sequential signal encoding from noisy measurements using quantizers with dynamic bias control

IEEE Transactions on Information Theory

Volumn 47, Issue 3, 2001, Pages 978-1002

  Papadopoulos, Haralabos C ^a   Wornell, Gregory W ^b,c   Oppenheim, Alan V ^b,c  

^a UNIVERSITY OF MARYLAND   (United States)

^b Department of Electrical Engineering and Computer Science   (United States)

^c IEEE   (United States)

Author keywords

Data fusion; Distributed estimation; Dithering; Maximum likelihood (ML); Quantization; Stochastic resonance; Wireless networks

Indexed keywords

ANALOG TO DIGITAL CONVERSION; BANDWIDTH COMPRESSION; DATA HANDLING; FEEDBACK CONTROL; MAXIMUM LIKELIHOOD ESTIMATION; OPTIMIZATION; RANDOM PROCESSES; SIGNAL FILTERING AND PREDICTION; SIGNAL NOISE MEASUREMENT; VECTOR QUANTIZATION; WIRELESS TELECOMMUNICATION SYSTEMS;

DATA FUSION; DIGITIZED INFORMATION; DYNAMIC BIAS CONTROL; LOW BANDWIDTH INFORMATION; QUANTIZED NOISY MEASUREMENTS; SEQUENTIAL SIGNAL ENCODING;

SIGNAL ENCODING;

EID: 0035269507     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.915654     Document Type: Article

References (82)

1. Z. Chair P. K. Varshney Optimal data fusion in multiple sensor detection systems IEEE Trans. Aerosp. Electron. Syst. AES-22 98 101 Jan. 1986
2. R. T. Antony Database support to data fusion automation Proc. IEEE 85 39 53 Jan. 1997 5 12063 554207
3. B. S. Rao H. F. Durrant-Whyte J. A. Sheen A fully decentralized multi-sensor system for tracking and surveillance Int. J. Robot. Res. 12 1 20 44 Feb. 1993
4. M. Yeddanapudi Y. Bar-Shalom K. R. Pattipati IMM estimation for multitarget-multisensor air traffic surveillance Proc. IEEE 85 80 94 Jan. 1997 5 12063 554210
5. R. Chellappa Q. Zheng P. Burlina C. Shekhar K. B. Eom On the positioning of multisensor imagery for exploitation and target recognition Proc. IEEE 85 120 138 Jan. 1997 5 12063 554213
6. R. Viswanathan P. K. Varshney Distributed detection with multiple sensors̵Part I: Fundamentals Proc. IEEE 85 54 63 Jan. 1997 5 12063 554208
7. E. B. Hall A. E. Wessel G. L. Wise Some aspects of fusion in estimation theory IEEE Trans. Inform. Theory 37 420 422 Mar. 1991 18 2501 75268
8. R. M. Gray T. G. Stockham Jr. Dithered quantizers IEEE Trans. Inform. Theory 39 805 812 May 1993 18 6498 256489
9. A. P. Dempster N. M. Laird D. B. Rubin Maximum likelihood from incomplete data via the EM algorithm Ann. Roy. Statist. Soc. 39 1 38 Dec. 1977
10. H. C. Papadopoulos Sequential signal encoding and estimation for wireless sensor networks Proc. IEEE Int. Symp. Information Theory Proc. IEEE Int. Symp. Information Theory Sorrento Italy 2000-June 6966 18755 866733
11. L. Schuchman Dither signals and their effect on quantization noise IEEE Trans. Commun. Technol. COM-12 162 165 Dec. 1964
12. A. Gersho Principles of quantization IEEE Trans. Circuits Syst. CAS-25 427 436 July 1978
13. T. M. Cover J. A. Thomas Elements of Information Theory 1991 Wiley New York
14. A. Papoulis Probability, Random Variables, and Stochastic Processes 3rd 1991 McGraw-Hill New York
15. M. Kam X. Zhu P. Kalata Sensor fusion for mobile robot navigation Proc. IEEE 85 108 119 Jan. 1997 5 12063 554212
16. B. S. Rao H. F. Durrant-Whyte J. A. Sheen A fully decentralized multi-sensor system for tracking and surveillance Int. J. Robot. Res. 12 1 20 44 Feb. 1993
17. M. Yeddanapudi Y. Bar-Shalom K. R. Pattipati IMM estimation for multitarget-multisensor air traffic surveillance Proc. IEEE 85 80 94 Jan. 1997 5 12063 554210
18. R. Chellappa Q. Zheng P. Burlina C. Shekhar K. B. Eom On the positioning of multisensor imagery for exploitation and target recognition Proc. IEEE 85 120 138 Jan. 1997 5 12063 554213
19. R. Viswanathan P. K. Varshney Distributed detection with multiple sensors̵Part I: Fundamentals Proc. IEEE 85 54 63 Jan. 1997 5 12063 554208
20. E. B. Hall A. E. Wessel G. L. Wise Some aspects of fusion in estimation theory IEEE Trans. Inform. Theory 37 420 422 Mar. 1991 18 2501 75268
21. R. S. Blum S. A. Kassam Optimum distributed detection of weak signals in dependent sensors IEEE Trans. Inform. Theory 38 1066 1079 May 1992 18 3697 135646
22. J. N. Tsitsiklis Decentralized detection by a large number of sensors Math. Contr. Sig. Syst. 1 2 167 182 1988
23. P.-N. Chen A. Papamarkou Error bounds for parallel distributed detection under the Neyman-Pearson criterion IEEE Trans. Inform. Theory 41 528 533 Mar. 1995 18 8486 370163
24. D. Warren P. Willett Optimal decentralized detection for conditionally independent sensors Amer. Contr. Conf. 1326 1329 Amer. Contr. Conf. 1989
25. R. S. Blum S. A. Kassam H. V. Poor Distributed detection with multiple sensors̵Part II: Advanced topics Proc. IEEE 85 64 79 Jan. 1997 5 12063 554209
26. K. C. Chou A. S. Willsky A. Benveniste Multiscale recursive estimation, data fusion, and regularization IEEE Trans. Automat. Contr. 39 464 478 Mar. 1994 9 6964 280746
27. D. A. Castanon D. Teneketzis Distributed estimation algorithms for nonlinear systems IEEE Trans. Automat. Contr. AC-30 418 425 May 1985
28. M. M. Daniel A. S. Willsky A multiresolution methodology for signal-level fusion and data assimilation with applications to remote sensing Proc. IEEE 85 164 180 Jan. 1997 5 12063 554216
29. H. V. Poor J. B. Thomas Applications of Ali̵Silvey distance measures in the design of generalized quantizers for binary decision systems IEEE Trans. Commun. COM-25 893 900 Sept. 1977
30. Z.-Q. Luo J. N. Tsitsiklis Data fusion with minimal communication IEEE Trans. Inform. Theory 40 1551 1563 Sept. 1994 18 7860 333867
31. M. DeWeese W. Bialek Information flow in sensory neurons Nuovo Cimento Soc. Ital. Fys. 17D 7‚ 733 741 July̵Aug. 1995
32. J. K. Douglass L. Wilkens E. Pantazelou F. Moss Noise enhancement of information transfer in crayfish mechanoreceptors by stochastic resonance Nature 365 337 340 Sept. 1993
33. J. Levin J. Miller Broadband neural encoding in the cricket sensory system enhanced by stochastic resonance Nature 380 6570 165 168 Mar. 1996
34. T. Berger Rate Distortion Theory Prentice-Hall Series in Information and System Sciences 1971 Prentice-Hall NJ, Englewood Cliffs
35. J. K. Wolf J. Ziv Transmission of noisy information to a noisy receiver with minimum distortion IEEE Trans. Inform. Theory IT-16 406 411 July 1970
36. J. M. Morris The performance of quantizers for a class of noise-corrupted signal sources IEEE Trans. Commun. COM-24 184 189 Feb. 1976
37. Y. Ephraim R. M. Gray A unified approach for encoding clean and noisy sources by means of waveform and autoregressive model vector quantization IEEE Trans. Inform. Theory 34 826 834 July 1988 18 498 9780
38. T. J. Flynn R. M. Gray Encoding of correlated observations IEEE Trans. Inform. Theory IT-33 773 787 Nov. 1987
39. M. Longo T. D. Lookabaugh R. M. Gray Quantization for decentralized hypothesis testing under communication constraints IEEE Trans. Inform. Theory 36 241 255 Mar. 1990 18 1889 52470
40. V. V. Veeravalli T. Basar H. V. Poor Decentralized sequential detection with a fusion center performing the sequential test IEEE Trans. Inform. Theory 39 433 442 Mar. 1993 18 5543 212274
41. H. R. Hashemi I. B. Rhodes Decentralized sequential detection IEEE Trans. Inform. Theory 35 509 520 May 1989 18 1333 30973
42. R. M. Gray S. Boyd T. Lookabaugh Low rate distributed quantization of noisy observations Proc. Allerton Conf. Communication, Control and Computing 354 358 Proc. Allerton Conf. Communication, Control and Computing Urbana-Champaign IL 1985
43. T. Berger Z. Zhang H. Viswanathan The CEO problem IEEE Trans. Inform. Theory 42 887 902 May 1996 18 10454 490552
44. R. A. Wannamaker S. P. Lipshitz J. Vanderkooy A theory of nonsubtractive dither IEEE Trans. Signal Processing 48 499 516 Feb. 2000 78 17842 823976
45. R. Zamir T. Berger Multiterminal source coding with high resolution IEEE Trans. Inform. Theory 45 106 117 1999 18 16128 746775
46. H. C. Papadopoulos Efficient digital encoding and estimation of noisy signals May 1998 Ph.D. dissertation MA, Cambridge
47. R. Benzi A. Sutera A. Vulpiani The mechanism of stochastic resonance J. Phys. A14 L453 L457 1981
48. Z. Gingl L. B. Kiss F. Moss Non-dynamical stochastic resonance: Theory and experiments with white and arbitrarily colored noise Europhys. Lett. 29 3 191 196 Jan. 1995
49. H. L. Van Trees Detection, Estimation and Modulation Theory̵Part I 1968 Wiley New York
50. L. R. Roberts Picture coding using pseudo-random noise IRE Trans. Inform. Theory IT-8 145 154 Feb. 1962
51. S. P. Lipshitz R. A. Wannamaker J. Vanderkooy Quantization and dither: A theoretical survey J. Audio Eng. Soc. 40 5 355 375 May 1992
52. R. M. Gray T. G. Stockham Jr. Dithered quantizers IEEE Trans. Inform. Theory 39 805 812 May 1993 18 6498 256489
53. H. C. Papadopoulos Sequential signal encoding and estimation for wireless sensor networks Proc. IEEE Int. Symp. Information Theory Proc. IEEE Int. Symp. Information Theory Sorrento Italy 2000-June 6966 18755 866733
54. L. Schuchman Dither signals and their effect on quantization noise IEEE Trans. Commun. Technol. COM-12 162 165 Dec. 1964
55. A. Gersho Principles of quantization IEEE Trans. Circuits Syst. CAS-25 427 436 July 1978
56. Z. Chair P. K. Varshney Optimal data fusion in multiple sensor detection systems IEEE Trans. Aerosp. Electron. Syst. AES-22 98 101 Jan. 1986
57. R. T. Antony Database support to data fusion automation Proc. IEEE 85 39 53 Jan. 1997 5 12063 554207
58. M. Kam X. Zhu P. Kalata Sensor fusion for mobile robot navigation Proc. IEEE 85 108 119 Jan. 1997 5 12063 554212
59. R. S. Blum S. A. Kassam Optimum distributed detection of weak signals in dependent sensors IEEE Trans. Inform. Theory 38 1066 1079 May 1992 18 3697 135646
60. P.-N. Chen A. Papamarkou Error bounds for parallel distributed detection under the Neyman-Pearson criterion IEEE Trans. Inform. Theory 41 528 533 Mar. 1995 18 8486 370163
61. D. Warren P. Willett Optimal decentralized detection for conditionally independent sensors Amer. Contr. Conf. 1326 1329 Amer. Contr. Conf. 1989
62. R. S. Blum S. A. Kassam H. V. Poor Distributed detection with multiple sensors̵Part II: Advanced topics Proc. IEEE 85 64 79 Jan. 1997 5 12063 554209
63. K. C. Chou A. S. Willsky A. Benveniste Multiscale recursive estimation, data fusion, and regularization IEEE Trans. Automat. Contr. 39 464 478 Mar. 1994 9 6964 280746
64. D. A. Castanon D. Teneketzis Distributed estimation algorithms for nonlinear systems IEEE Trans. Automat. Contr. AC-30 418 425 May 1985
65. M. M. Daniel A. S. Willsky A multiresolution methodology for signal-level fusion and data assimilation with applications to remote sensing Proc. IEEE 85 164 180 Jan. 1997 5 12063 554216
66. H. V. Poor J. B. Thomas Applications of Ali̵Silvey distance measures in the design of generalized quantizers for binary decision systems IEEE Trans. Commun. COM-25 893 900 Sept. 1977
67. Z.-Q. Luo J. N. Tsitsiklis Data fusion with minimal communication IEEE Trans. Inform. Theory 40 1551 1563 Sept. 1994 18 7860 333867
68. J. K. Douglass L. Wilkens E. Pantazelou F. Moss Noise enhancement of information transfer in crayfish mechanoreceptors by stochastic resonance Nature 365 337 340 Sept. 1993
69. J. Levin J. Miller Broadband neural encoding in the cricket sensory system enhanced by stochastic resonance Nature 380 6570 165 168 Mar. 1996
70. J. K. Wolf J. Ziv Transmission of noisy information to a noisy receiver with minimum distortion IEEE Trans. Inform. Theory IT-16 406 411 July 1970
71. J. M. Morris The performance of quantizers for a class of noise-corrupted signal sources IEEE Trans. Commun. COM-24 184 189 Feb. 1976
72. Y. Ephraim R. M. Gray A unified approach for encoding clean and noisy sources by means of waveform and autoregressive model vector quantization IEEE Trans. Inform. Theory 34 826 834 July 1988 18 498 9780
73. T. J. Flynn R. M. Gray Encoding of correlated observations IEEE Trans. Inform. Theory IT-33 773 787 Nov. 1987
74. M. Longo T. D. Lookabaugh R. M. Gray Quantization for decentralized hypothesis testing under communication constraints IEEE Trans. Inform. Theory 36 241 255 Mar. 1990 18 1889 52470
75. V. V. Veeravalli T. Basar H. V. Poor Decentralized sequential detection with a fusion center performing the sequential test IEEE Trans. Inform. Theory 39 433 442 Mar. 1993 18 5543 212274
76. H. R. Hashemi I. B. Rhodes Decentralized sequential detection IEEE Trans. Inform. Theory 35 509 520 May 1989 18 1333 30973
77. T. Berger Z. Zhang H. Viswanathan The CEO problem IEEE Trans. Inform. Theory 42 887 902 May 1996 18 10454 490552
78. R. A. Wannamaker S. P. Lipshitz J. Vanderkooy A theory of nonsubtractive dither IEEE Trans. Signal Processing 48 499 516 Feb. 2000 78 17842 823976
79. R. Zamir T. Berger Multiterminal source coding with high resolution IEEE Trans. Inform. Theory 45 106 117 1999 18 16128 746775
80. H. L. Van Trees Detection, Estimation and Modulation Theory̵Part I 1968 Wiley New York
81. L. R. Roberts Picture coding using pseudo-random noise IRE Trans. Inform. Theory IT-8 145 154 Feb. 1962
82. S. P. Lipshitz R. A. Wannamaker J. Vanderkooy Quantization and dither: A theoretical survey J. Audio Eng. Soc. 40 5 355 375 May 1992