Detecting short passages of similar text in large document collections

Proceedings of the 2001 Conference on Empirical Methods in Natural Language Processing, EMNLP 2001

Volumn , Issue , 2001, Pages

  Lyon, Caroline ^a   Malcolm, James ^a   Dickerson, Bob ^a  

^a UNIVERSITY OF HERTFORDSHIRE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BROADCAST NEWS; DISTRIBUTIONS OF WORDS; DOCUMENT COLLECTION; NEWS REPORTS; SIMPLE++; WORD TRIGRAMS; WRITTEN DOCUMENTS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 85126922087     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. P Barton, N Davey, R Frank, and D Tansley. 1995. Dynamic competitive learning applied to the clone detection problem. In International Workshop on Applications of Neural Networks to Telecommunications, Stockholm.
2. T C Bell, J G Cleary, and I H Witten. 1990. Text Compression. Prentice Hall.
3. C M Bishop. 1995. Neural Networks for Pattern Recognition. OUP.
4. A Z Broder. 1998. On the resemblance and containment of documents. In Compression and, Complexity of Sequences, IEEE Computer Society.
5. D Gibbon. R Moore, and R Winski. 1997. Handbook of Standards and, Resources for Spoken Language Systems. Mouton do Gruytcr.
6. A Hamilton. J Madison, and J Jay, 1787-1788. The Federalist Papers. www.mcs.net/knautzr/fed/fedi.htm.
7. V Hatzivassiloglou. J Klavans. and E Eskin. 1999. Detecting text similarity over short passages: Exploring linguistic feature combinations via machine learning. In Proc. of EMNLP.
8. A K Jain, R P W Duiri, and J Mao. 2000. Statistical pattern recognition: A review. IEEE Trans, on Pattern Analysis and, Machine Intelligence, 22, 1.
9. K Kukich. 1992. Techniques for automatically correcting words in text. ACM Computing Surveys, December.
10. J Kupice. 1992. Robust part-of-speech tagging using a hidden Markov model. Computer Speech and Language.
11. C Lyon and R Frank. 1997. Using Single Layer Networks for Discrete, Sequential Data: an Example from Natural Language Processing. Neural Computing Applications, 5 (4).
12. C D Manning and H Sclmtze. 1999. Foundations of Statistical Natural Language Processing. MIT.
13. F Mosteller and D L Wallace. 1984. Applied Bayesian and, Classical, Inference: The case of the Federalist papers. Springer-Verlag.
14. H Ney, S Martin, and F Wessel. 1997. Statistical language modelling using leaving-onc-out. In S Young and G Bloothooft, editors, Corpus Ba,sed, Methods in Language and, Speech Processing. Kluwer Academic Publishers.
15. N.Heintze, 1996. Scalable Document Fingerprinting. Bell Laboratories, www.cs.cmu.edu/afs/cs/user/nch/www/koala/.
16. Thomas Phelps and Robert Wilensky, 2000. Robust Hyperlinks: Cheap, Everywhere, Now. Proc. of Digital Documents and Electronic Publishing, www.cs.berkeley.edu/phelps/Robust/papers.html.
17. C E Shannon. 1951. Prediction and Entropy of Printed English. Bell System, Technical Journal, pages 50-64.
18. N Shivakumar and H Garcia-Molina. 1996. Building a scalable and accurate copy detection mechanism. In Proc. of 3rd International Conference on Theory and Practice of Digital Libraries.
19. L Wittgenstein. 1945. Philosphical Investigations. Blackwell, 1992.