Study of two error functions to approximate the Neyman-Pearson detector using supervised learning machines

IEEE Transactions on Signal Processing

Volumn 57, Issue 11, 2009, Pages 4175-4181

  Jarabo Amores, María Pilar ^a   Rosa Zurera, Manuel ^a   Gil Pita, Roberto ^a   Lopez Ferreras, Francisco ^a  

^a UNIVERSITY OF ALCALÁ   (Spain)

Author keywords

Bayes optimal discriminant function; Learning machine; Minkowski error; Neural network; Neyman Pearson (NP) detector; Sum of squares error

Indexed keywords

BAYES OPTIMAL DISCRIMINANT FUNCTION; LEARNING MACHINE; MINKOWSKI ERROR; NEYMAN-PEARSON (NP) DETECTOR; SUM-OF-SQUARES ERROR;

EDUCATION; NEURAL NETWORKS; SUPERVISED LEARNING;

DETECTORS;

EID: 70350514137     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2009.2025077     Document Type: Article

References (36)

1. J. Neyman and K. Pearson, "On the problem of the most efficient test of statistical hypotheses," Philosph. Trans. Roy. Soc. London A, Math. Phys. Sci., vol. 231, pp. 492-510, Feb. 1933.
2. T. Furon, J. Josse, and S. le Squin, "Some theoretical aspects of water-marking detection," in Proc. SPIE, Jan. 2006, vol. 6072, pp. 553-564.
3. T. Ng and H. Garg, "Maximum-Likelihood detection in DWT domain image watermarking using Laplacian modeling," IEEE Signal Process. Lett. vol. 12, pp. 285-288, Apr. 2005.
4. I. Gu, N. Ernberg, E. Styvaktakis, and M. Bollen, "A statistical-based sequential method for fast online detection of fault-induced voltage dips," IEEE Trans. Power Del., vol. 19, pp. 497-504, Apr. 2004.
5. J. Chamberland and V. Veeravalli, "Decentralized detection in sensor networks," IEEE Trans. Signal Process., vol. 51, no. 2, pp. 407-416, Feb. 2003.
6. P. Sebastiani, E. Gussoni, I. Kohane, and M. Ramoni, "Statistical challenges in functional genomics," Stat. Sci., vol. 18, pp. 33-60, Feb. 2003.
7. S. Dudoit, J. Fridlyand, and T. Speed, "Comparison of discrimination methods for the classification of tumors using gene expression data," J. Amer. Stat. Assoc., vol. 97, pp. 77-87, Mar. 2002.
8. Y. Sung, L. Tong, and H. Poor, "Neyman-Pearson detection of Gauss-Markov signals in noise: Closed-form error exponent and properties," IEEE Trans. Inf. Theory, vol. 52, pp. 1354-1365, Apr. 2006.
9. H. V. Trees, Detection, Estimation, and Modulation Theory. New York: Wiley, 1968, vol. 1.
10. A. Cannon, J. Howse, D. Hush, and C. Scovel, "Learning with the Neyman-Pearson and min-max criteria," Los Alamos National Lab., Tech. Rep. LA-UR-02-2951, Jun. 2002.
11. C. Scott and R. Nowak, "A Neyman-Pearson approach to statistical learning," IEEE Trans. Inf. Theory, vol. 51, pp. 3806-3819, Nov. 2005.
12. D. Andina, J. Sanz-González, and J. Jiménez-Pajares, "A comparison of criterion functions for a neural network applied to binary detection," in Proc. IEEE Int. Conf. Neural Netw., Dec. 1995, vol. 1, pp. 492-495.
13. D. Andina, J. Sanz-González, and O. Rodríguez-Martín, "Performance improvements for a neural network detector," in Proc. IEEE Int. Conf. Neural Netw., Dec. 1995, vol. 1, pp. 492-495.
14. A. Burian, P. Kuosmanen, and J. Saarinen, "Neural detectors with variable threshold," in Proc. ISCAS, Jun. 1999, vol. 5, pp. 599-602.
15. R. Vicen-Bueno, M. Rosa-Zurera, M. Jarabo-Amores, and R. Gil-Pita, "NN-Based detector for known targets in coherent Weibull clutter," Lecture Notes in Computer Science, vol. 4224, pp. 522-529, Sep. 2006.
16. R. Vicen-Bueno, M. Jarabo-Amores, D. Mata-Moya, M. Rosa-Zurera, and R. Gil-Pita, "Low complexity MLP-based radar detector: Influence of the training algorithm and the MLP size," Lecture Notes in Computer Science, vol. 4507, pp. 630-637, Jun. 2007.
17. V. Ramamurti, S. S. Rao, and P. P. Gandhi, "Neural detectors for signals in non-Gaussian noise," in Proc. Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), Apr. 1993, vol. 1, pp. 481-484.
18. P. Gandhi and V. Ramamurti, "Neural networks for signal detection in non-Gaussian noise," IEEE Trans. Signal Process., vol. 45, no. 11, pp. 2846-2851, Nov. 1997.
19. D. Munro, O. Ersoy, M. Bell, and J. Sadowsky, "Neural network learning of low-probability events," IEEE Trans. Aerosp. Electron. Syst., vol. 32, pp. 898-910, Jul. 1996.
20. D. Ruck, S. Rogers, M. Kabrisky, M. Oxley, and B. Suter, "The multilayer perceptron as an approximation to a Bayes optimal discriminant function," IEEE Trans. Neural Netw., vol. 1, pp. 296-298, Dec. 1990.
21. D. Casasent and X. Chen, "New training strategies for RBF neural networks for X-ray agricultural product inspection," Pattern Recognit., vol. 36, pp. 535-547, Feb. 2003.
22. D. Casasent and X. Chen, "Radial basis function neural networks for nonlinear Fisher discrimination and Neyman Pearson classification," Neural Netw., vol. 16, pp. 529-535, Jun.-July 2003.
23. P. Jarabo-Amores, R. Gil-Pita, M. Rosa-Zurera, and F. López-Ferreras, "MLP and RBFN for detecting white Gaussian signals in white Gaussian interference," Lecture Notes in Computer Science, vol. 2687, pp. 790-797, Jun. 2003.
24. M. Davenport, R. Baraniuk, and C. Scott, "Controling false alarms with support vector machines," in Proc. Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), May 2006, vol. 5, pp. 589-592.
25. S. Haykin and D. Thomson, "Signal detection in a nonstationary environment reformulated as an adaptive pattern classification problem," IEEE Trans. Signal Process., vol. 85, no. 11, pp. 2325-2344, Nov. 1998.
26. A. M. Fernandes, A. B. Utkin, A. V. Lavrov, and R. M. Vilar, "Development of neural network committee machines for automatic forest fire detection using Lidar," Pattern Recognit., vol. 37, pp. 2039-2047, Oct. 2004.
27. D. Mata-Moya, P. Jarabo-Amores, R. Vicen-Bueno, M. Rosa-Zurera, and F. López-Ferreras, "Neural network detectors for composite hypothesis tests," Lecture Notes in Computer Science, vol. 4224, pp. 298-305, Sep. 2006.
28. D. Mata-Moya, P. Jarabo-Amores, M. Rosa-Zurera, J. Nieto-Borge, and F. López-Ferreras, "Combining MLPs and RBFNNs to detect signals with unknown parameters," IEEE Trans. Instrum. Meas., vol. 58, no. 9, pp. 2989-2995, Sep. 2009.
29. P. Jarabo-Amores, M. Rosa-Zurera, R. Gil-Pita, and F. López-Ferreras, "Sufficient condition for an adaptive system to approximate the Neyman-Pearson detector," in Proc. IEEE Workshop Stat. Signal Process., Jul. 2005, pp. 295-300.
30. C. M. Bishop, Neural Networks for Pattern Recognition, 1st ed. Oxford, U.K.: Oxford Univ. Press, 1995.
31. M. Saerens, P. Latinne, and C. Decaestecker, "Any reasonable cost function can be used for a posteriori probability approximation," IEEE Trans. Neural Netw., vol. 13, pp. 1204-1210, Sep. 2002.
32. J. Slivka and N. Severo, "On the strong law of large numbers," Proc. Amer. Math. Soc., vol. 24, pp. 729-734, Apr. 1970.
33. I. Gelfand and S. Fomin, Calculus of Variations. Mineola, NY: Courier Dover, 2000.
34. R. Weinstock, Calculus of Variations With Applications to Physics and Engineering. New York: McGraw-Hill, 1952.
35. J. L. Sanz-Gonzalez and D. Andina, "Performance analysis of neural network detectors by importance sampling techniques," Neural Process. Lett., vol. 9, pp. 257-269, Jun. 1999.
36. M. Powell, "Restart procedures for the conjugate gradient method," Math. Programm., vol. 12, pp. 241-254, Dec. 1977.