Towards link characterization from content: Recovering distributions from classifier output

IEEE Transactions on Audio, Speech and Language Processing

Volumn 16, Issue 4, 2008, Pages 847-858

  Grothendieck, John ^a   Gorin, Allen ^b  

^a RUTGERS UNIVERSITY   (United States)

^b ARMED FORCES INSTITUTE OF PATHOLOGY   (United States)

Author keywords

Knowledge acquisition; Monte Carlo methods; Speech processing

Indexed keywords

BAYES ESTIMATORS; ERROR PATTERNS; LARGE DATA SETS; LOW FREQUENCIES; PATTERN CLASSIFICATIONS; RARE CLASS; ROOT MEAN SQUARED ERRORS; SPEAKER RECOGNITION; UNCERTAIN KNOWLEDGE;

CLASSIFIERS; KNOWLEDGE ACQUISITION; LEARNING SYSTEMS; LINGUISTICS; QUERY LANGUAGES; SPEECH PROCESSING;

MONTE CARLO METHODS;

EID: 64849113276     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2008.920060     Document Type: Article

References (51)

1. S. Douglas, D. Agarwal, T. Alonso, R. Bell, M. Rahim, D. Swayne, and C. Volinsky, "Mining customer care dialogs for "daily news"," IEEE Trans. Speech Audio Process., vol. 13, no. 5, pp. 652-660, Sep. 2005.
2. A. Gorin, "Coping with information overload," presented at die Int. Symp. Large-Scale Knowledge Res., Tokyo, Japan, 2006.
3. J. Grothendieck. "Tracking changes in language," IEEE Trans. Speech Audio Process., vol. 13, no. 5, pp. 700-711, Sep. 2005.
4. E. Rahme and L. Joseph, "Estimating the prevalence of a rare disease: Adjusted maximum likelihood," J. R. Statist. Soc: Ser. D, vol. 47, no. 1, pp. 149-158, 1998.
5. J. Langford, "Tutorial on practical prediction theory for classification," J. Mach Learn. Res., vol. 6, pp. 273-306, 2005.
6. S. Chib and E. Greenberg, "Understanding the metropolis-hastings algorithm," Amer. Statist., vol. 49, pp. 327-335, 1995.
7. J. Godfrey and E. Holliman, "SWITCHBOARD-1 release 2," Linguistic Data Consortium, LDC97S62, 1997.
8. J. Godfrey, E. Holliman, and J. McDaniel, "SWITCHBOARD: Telephone speech corpus for research and development," Proc. ICASSP, vol. 1, pp. 517-520, 1992.
9. D. Reynolds, W. Campbell, W. Shen, P. Torres-Carasquillo, and A. Adami, "MIT-Lincoln Laboratory System Description NIST SRE 2005," 2005.
10. F. Bimbot, J. Bonastre, C. Fredouille, G. Gravier, I. Magrin-Chagnolleau, S. Meigner, T. Merlin, J. Ortega-Garcia, D. Petrovska-Delacrétaz, and D. A. Reynolds, "A tutorial on text-independent speaker verification," EURASIP J. Appl. Signal Process., vol. 4, pp. 430-451, 2004.
11. A. Rosenberg, J. Hirschberg, M. Bacchiani, S. Parthasarathy, P. Isenhour, and L. Stead, "Caller identification for die SCANMail voicemail browser," Proc. Eurospeech'O I, pp. 2373-2376, 2001.
12. J. Navratil, "Spoken language recognition-A step towards multilinguality in speech processing," IEEE Trans. Audio Speech Process., vol. 9, no. 6, pp. 678-685, Sep. 2001.
13. A. Martin and M. Przybocki, "N1ST 2003 language recognition evaluation," Proc. Eurospeech'03, pp. 1341-1344, 2003.
14. S. E. Tranter and D. A. Reynolds, "An overview of automatic speaker diarization systems," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 5, pp. 1557-1565, Sep. 2006.
15. C. Barras, X. Zhu, S. Meignier, and J.-L. Gauvain, "Multistage speaker diarization of broadcast news," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 5, pp. 1505-1512, Sep. 2006.
16. C. Sutton and A. McCallum, "An introduction to conditional random fields for relational learning," in Introduction to Statistical Relational Learning, L. Getoor and B. Taskar, Eds. Cambridge, MA: MIT Press, 2006.
17. M. Przybocki, "Automatic content extraction Web page," 2000 [Online], Available: http://www.nist.gov/speech/tests/ace
18. G. Doddington, A. Mitchell, M. Przybocki, L. Ramshaw, S. Strassel, and R. Weischedel, "The automatic content extraction (ACE) program tasks, data, and evaluation," Proc. LREC, pp. 837-840, 2004.
19. J. Allan, Ed., Topic Detection and Tracking: Event-Based Information Organization. Norwell, MA: Kluwer, 2002.
20. N. Williams, S. Zander, and G. J. Armitage, "A preliminary performance comparison of five machine learning algorithms for practical IP traffic flow classification," Comput. Commun. Rev., vol. 36, no. 5, pp. 5-16, 2006.
21. S. Sen, O. Spatscheck, and D. Wang, "Accurate, scalable in-network identification of P2P traffic using application signatures," Proc. WWW'04, pp. 512-521, 2004.
22. S. Singh, C. Estan, G. Varghese. and S. Savage, "Automated worm fingerprinting," Proc. OSDI, pp. 45-60, May 2004.
23. K. Shanmugasundaram, N. Memon, A. Savant, and H. Bronnimann, "Fornet: A distributed forensics network," in Proc. 2nd Int. Workshop Math. Methods, Models, Architectures Comput. Netw. Security, 2003, pp. 1-16.
24. S. Dharmapurikar, P. Krishnamurthy, T. S. Sproull, and J. W. Lock - wood, "Deep packet inspection using parallel bloom filters," IEEE Micro, vol. 24, no. 1, pp. 52-61, Jan./Feb. 2004.
25. S. G. Eick. J. W. Lockwood, R. Loui, A. Levine, J. Mauger, D. J. Weushar, A. Ratner, and J. Byrnes, "Hardware accelerated algorithms for semantic processing of document streams," in Proc. IEEE Aerospace Corf., 2006, paper 10.0802.
26. G. Riccardi and A. Gorin, "Spoken language adaptation over time and state in a natural spoken dialog system," IEEE Trans. Speech Audio Process., vol. 8, no. 1, pp. 3-10, Jan. 2000.
27. H. Williams, P. Burney, A. Pembroke, and R. Hay, "Validation of the UK criteria for atopic dermatitis in a population setting," British J. Dermatol, vol. 135, pp. 12-17, 1996.
28. K. Flegal, C. Brownie, and J. Haas, "The effects of exposure misclassification on estimates of relative risk," Amer. J. Epidemiol., no. 123. pp. 736-751, 1986.
29. N. Wald, K. Nanchahal, S. Thompson, and H. Cuckle, "Does breathing other people's tobacco smoke cause lung cancer?," British Med. J., vol. 293, pp. 1217-1222, 1986.
30. S. Walter and L. Irwig, "Estimation of test error rates, disease prevalence, and relative risk from misclassified data: A review," J. Clinical Epidemiol, vol. 41, pp. 923-937, 1988.
31. L. Joseph, T. Gyorkos, and L. Coupal, "Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard," Amer. J. Epidemiol, vol. 141, pp. 263-272, 1995.
32. E. Lehmann and G. Casella, Theory of Point Estimation. New York: Springer, 1998.
33. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning. New York: Springer, 2001.
34. J. Marin, K. Mengersen, and C. Robert, "Bayesian modelling and inference on mixtures of distributions," in Handbook of Statistics 25. New York: Elsevier-Sciences, 2005, ch. 16.
35. D. Montgomery and E. Beck, Introduction to Linear Regression Analysis, lst ed. New York: Wiley, 1982.
36. N. Brummer and J. du Preez, "Application-independent evaluation of speaker detection," Comput. Speech Lang., vol. 20, no. 2-3, pp. 230-275, 2006.
37. A. Gelman, G. Roberts, and W. Gilks, "Efficient metropolis jumping rules," Bayesian Statistics 5, pp. 599-607, 1994.
38. W. Gilks, S. Richardson, and D. Spiegelhalter, Eds., Markov Chain Monte Carlo in Practice. London, U.K.: Chapman & Hall, 1996.
39. H. Haario, E. Saksman, and J. Tamminen, "An adaptive metropolis algorithm," Bernoulli, vol. 7, no. 3, pp. 223-242, 2001.
40. D. Z. Hakkani-Tür, F. Bechet, G. Riccardt, and G. Tur, "Beyond ASR 1-best: Using word confusion networks in spoken language understanding," Comput. Speech Lang., vol. 20, no. 4, pp. 495-514,2006.
41. R. C. Rose, "Environmental robustness in automatic speech recognition," presented at the Robust2004-ISCA and COST278 Workshop Robustness in Conversational Interaction, Aug. 2004.
42. J. Piatt, "Probabilistic outputs for support vector machines and comparison to regularized likelihood methods," in Advances in Large Margin Classifiers, A. Smola, P. Bartlett, B. Scholkopf, and D. Schuurmans, Eds. Cambridge, MA: MIT Press, 1999, pp. 61-74.
43. W. Campbell. D. Reynolds, J. Campbell, and K. Brady, "Estimating and evaluating confidence for forensic speaker recognition," Proc. ICASSP, pp. 18-23, 2005.
44. P. Bartlett and A. Tewari, "Sparseness vs estimating conditional probabilities: Some asymptotic results," Proc. COLT, pp. 564-578, 2004.
45. C. Cortes and M. Mohri, "AUC optimization vs. error rate minimization," in Advances in Neural Information Processing Systems (NIPS-OS). Cambridge, MA: MIT Press, 2004, vol. 16.
46. D. Madigan, A. Genkin, D. Lewis, and D. Fradkin, "Bayesian multinomial logistic regression for author identification," Proc. Maxent '05, pp. 509-516, 2005.
47. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Statist. Soc, vol. 39, pp. 1-38, 1977.
48. W. Press, S. Teukolsky, W. Vetterling, and B. Flannery, Numerical Recipes in C: The Art of Scientific Computing. Cambridge, U.K.: Cambridge Univ. Press, 1992, pp. 161-164.
49. J. Grzesik, "Von neumann's rejection technique reexamination," SIAM Rev., vol. 31, no. 3, pp. 486-4189, 1989.
50. L. Tierney, "Markov chains for exploring posterior distributions (with discussion)," Ann. Statist., vol. 22, pp. 1701-1762, 1994.
51. W. Andrews and J. Hernandez-Cordero, "SREC'05 Output on Switchboard I, private communication," 2006.