Using structural contexts to compress semistructured text collections

Information Processing and Management

Volumn 43, Issue 3, 2007, Pages 769-790

  Adiego, Joaquín ^a   Navarro, Gonzalo ^b   de la Fuente, Pablo ^a  

^a UNIVERSITY OF VALLADOLID   (Spain)

^b UNIVERSITY OF CHILE   (Chile)

Author keywords

Compressed text databases; Semistructured documents; Text compression

Indexed keywords

DATA STRUCTURES; DATABASE SYSTEMS; HEURISTIC METHODS; INFORMATION RETRIEVAL; NATURAL LANGUAGE PROCESSING SYSTEMS; RANDOM ACCESS STORAGE;

COMPRESSED TEXT DATABASES; SEMISTRUCTURED DOCUMENTS; STRUCTURAL CONTEXTS MODEL (SCM); TEXT COMPRESSION;

FILE ORGANIZATION;

EID: 33846470515     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2006.07.001     Document Type: Article

References (35)

1. Adiego, J., Navarro, G., & de la Fuente, P. (2004). Lempel-Ziv compression of structured text. In Proceedings 14th IEEE data compression conference (DCC'04) (pp. 112-121).
2. Adiego, J., Navarro, G., & de la Fuente, P. (in press). Lempel-ziv compression of highly structured documents. Journal of the American Society for Information Science and Technology (JASIST).
3. Bell T., Cleary J., and Witten I. Text compression (1990), Prentice Hall, Englewood Cliffs, NJ
4. Bentley J., Sleator D., Tarjan R., and Wei V. A locally adaptive data compression scheme. Communications of the ACM 29 (1986) 320-330
5. Brisaboa N., Fariña A., Navarro G., and Esteller M. (s,c)-Dense coding: an optimized compression code for natural language text databases. Proceedings of 10th international symposium on string processing and information retrieval (SPIRE 2003). LNCS 2857 (2003), Springer 122-136
6. Burrows, M., & Wheeler, D. (1994). A block sorting lossless data compression algorithm. Technical Report 124, Digital Equipment Corporation.
7. Cheney, J. (2001). Compressing XML with multiplexed hierarchical PPM models. In Proceedings of 11th IEEE data compression conference (DCC'01) (pp. 163-172).
8. Cleary J., and Witten I. Data compression using adaptive coding and partial string matching. IEEE Transactions on Communication 32 (1984) 396-402
9. Dvorský J., Pokorný J., and Snásel V. Word-based compression methods and indexing for text retrieval systems. Proceedings of 2nd East European symposium on advances in databases and information systems (ADBIS'99). LNCS 1691 (1999), Springer 75-84
10. Girardot, M., & Sundaresan, N. (2000). Millau: an encoding format for efficient representation and exchange of XML documents over the WWW. In Proceedings of 9th international World wide Web conference on computer networks (pp. 747-765).
11. Harman, D. (1995). Overview of the Third Text REtrieval Conference. In Proceedings of third Text REtrieval Conference (TREC-3) (pp. 1-19). NIST Special Publication 500-207.
12. Heaps H. Information retrieval - computational and theoretical aspects (1978), Academic Press
13. Horspool, R., & Cormack, G. (1992). Constructing word-based text compression algorithms. In Proceedings of 2nd IEEE data compression conference (DCC'92) (pp. 62-71).
14. Huffman, D. (1952). A method for the construction of minimum-redundancy codes. In Proceedings of the Institute of Radio Engineers, 40(9), 1098-1101.
15. Lam, W., Wood, P., & Levene, M. (2003). XCQ: XML compression and querying system. In Proceedings of 12th international conference on the World wide Web (WWW'03). Poster.
16. Levene, M., & Wood, P. (2002). XML structure compression. In Proceedings of 2nd international workshop on Web dynamics.
17. Liefke, H., & Suciu, D. (2000). XMill: an efficient compressor for XML data. In Proceedings of international ACM conference on management of data (SIGMOD'00) (pp. 153-164).
18. Moffat A. Word-based text compression. Software - Practice and Experience 19 2 (1989) 185-198
19. Moffat, A., & Wan, R. (2001). RE-store: a system for compressing, browsing and searching large documents. In Proceedings of 8th international symposium on string processing and information retrieval (SPIRE'01) (pp. 162-174). IEEE CS Press.
20. Moffat A., and Turpin A. Compression and coding algorithms (2002), Kluwer Academic Publishers
21. Moura E., Navarro G., Ziviani N., and Baeza-Yates R. Fast and flexible word searching on compressed text. ACM Transactions on Information Systems 18 2 (2000) 113-139
22. Navarro G., Moura E., Neubert M., Ziviani N., and Baeza-Yates R. Adding compression to block addressing inverted indexes. Information Retrieval 3 1 (2000) 49-77
23. Shannon C. A mathematical theory of communication. Bell System Technical Journal 27 (1948) 398-403
24. Shkarin, D. (2002). PPM: one step to practicality. In Proceedings of 12th IEEE data compression conference (DCC 2002) (pp. 202-211).
25. Tarhio J. On compression of parse trees. Proceedings of 8th international symposium on string processing and information retrieval (SPIRE'01) (2001), IEEE Computer Society 205-211
26. Tolani, P., & Haritsa, J. (2002). XGRIND: a query-friendly XML compressor. In Proceedings of 18th international conference of data engineering (ICDE'02) (pp. 225-234).
27. Toman, V. (2004). Syntactical compression of XML data. Presented at 16th International conference on advanced information systems engineering (CAiSE'04), Riga, Latvia, June 7-11.
28. Turpin, A., & Moffat, A. (1997). Fast file search using text compression. In Proceedings of the 20th Australian computer science conference (pp. 1-8).
29. Welch T. A technique for high-performance data compression. IEEE Computer 17 6 (1984) 8-19
30. Witten I., Moffat A., and Bell T. Managing gigabytes. 2nd ed. (1999), Morgan Kaufmann Publishers
31. Witten I., Neal R., and Cleary J. Arithmetic coding for data compression. Communications of the ACM 30 6 (1987) 520-541
32. Zipf G. Human behaviour and the principle of least effort (1949), Addison-Wesley
33. Ziviani N., Moura E., Navarro G., and Baeza-Yates R. Compression: a key for next-generation text retrieval systems. IEEE Computer 33 11 (2000) 37-44
34. Ziv J., and Lempel A. An universal algorithm for sequential data compression. IEEE Transactions on Information Theory 23 3 (1977) 337-343
35. Ziv J., and Lempel A. Compression of individual sequences via variable-rate coding. IEEE Transactions on Information Theory 24 5 (1978) 530-536