Finding keywords amongst noise: Automatic text classification without parsing

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 6601, Issue , 2007, Pages

  Allison, Andrew G ^a   Pearce, Charles E M ^a   Abbott, Derek ^a  

^a UNIVERSITY OF ADELAIDE   (Australia)

Author keywords

Finite mixture distributions; Keywords; Kolmogorov Smirnov; Maximum likelihood; Mixed Poisson process; Word recurrence interval

Indexed keywords

MAXIMUM LIKELIHOOD; POISSON DISTRIBUTION; TEXT PROCESSING;

AUTOMATIC TEXT; FINITE MIXTURE DISTRIBUTIONS; KEYWORDS; KOLMOGOROV-SMIRNOV; MIXED POISSON PROCESS; PARSING;

ACOUSTIC NOISE;

EID: 36248953300     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.724655     Document Type: Conference Paper

References (29)

1. M. Ortuño, P. Carpena, P. Bernaola-Galván, E. Muñoz, and A. M. Somoza, "Keyword detection in natural languages and DNA," Europhys. Lett. 57(5), pp. 759-764, 2002.
2. M. J. Berryman, A. G. Allison, P. Carpena, and D. Abbott, "Signal processing and statistical methods in analysis of text and DNA," in Biomedical Applications of Micro- and Nanoengineering, D. V. Nicolau, ed., 4937, pp. 231-240, SPIE, November 2002.
3. M. J. Berryman, A. Allison, and D. Abbott, "Statistical techniques for text classification based on word recurrence intervals," Fluctuation and Noise Letters 3, pp. L1-L10, March 2003.
4. A. Lang, W. Leaf, and E. Myers, The Iliad of Homer, Lang, Leaf, Myers trans., Random House, 1950.
5. A. Papoulis, Probability, Random Variables and Stochastic Processes, McGraw-Hill, Inc., 1991.
6. R. D. Yates and D. J. Goodman, Probability and Stochastic Processes, John Wiley & Sons, Inc., 1998.
7. P. Z. Peebles, Probability, Random Variables and Random Signal Principles, McGraw-Hill, Inc., 2001.
8. M. Abramowitz and I. Stegun, Handbook of Mathematical Functions, Dover Publications Inc., New York, 9th ed., 1970.
9. E. W. Weisstein, CRC Concise Encyclopedia of Mathematics, CRC Press, New York, 1999.
10. D. V. Huntsberger and P. Billingsley, Elements of Statistical Inference, Allyn and Bacon, Inc., 4th ed., 1977.
11. S. M. Ross, Introduction to probability and statiustics for Engineers and scientists, John Wiley & Sons, New York, 1987.
12. D. W. Wackerly, W. Mendenhall, and R. L. Scheaffer, Mathematical Statistics with Applications, Duxbury Press, 1996.
13. D. Groebner and P. Shannon, Business Statistics, Merrill Publishing Company, 1985.
14. G. Upton and I. Cook, The Oxford Dictionary of Statistics, Oxford University Press, 2002.
15. K. Pearson, "Contribution to the mathematical theory of evolution," Philosophical Transactions of the Royal Society 185(A), pp. 71-110, 1894.
16. P. Albert, "A two-state Markov mixture model for a time series of epileptic seizure counts," Biometrics 47, pp. 1371-1381, Dec. 1991.
17. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical Recipes in C, Cambridge University Press, 1992.
18. S. D. Conte and C. de Boor, Elementary numerical analysis, McGraw-Hill book company, Aukland, third ed.
19. J. R. Norris, Markov chains, Cambridge University Press, 1997.
20. 29 pp. 149-160.
21. G. P. Harmer, "Parrondo's paradox," Statistical Science 14, pp. 206-213, 1999. Parrondo's Games.
22. G. P. Harmer and D. Abbott, "Losing strategies can win by Parrondo's paradox," Nature 402, p. 864, 1999.
23. G. P. Harmer and D. Abbott, "The paradox of Parrondo's games," Proc. Royal Soc, Series A, (Math. Phys. and Eng. Science) 1994(99), pp. 247-259, 2000.
24. 29 pp. 420-425. Parrondo's Games.
25. 29 pp. 426-431.
26. E. T. Jaynes, Probability theory the logic of science, Cambridge University Press, Cambridge, 2003.
27. G. Robinson, "A statistical approach to the spam problem," Linux Journal, pp. 58-64, March 2003.
28. A. F. Chalmers, What is This Thing called Science?, Queensland University Press, St. Lucia, Qld., 3rd ed., 1999.
29. and Int. Conf. Unsolved Problems of Noise and Fluctuations (UPoN'99), 511, American Inst. Phys., 2000.