Automatically maintaining navigation sequences for querying semi-structured web sources

Data and Knowledge Engineering

Volumn 63, Issue 3, 2007, Pages 795-810

  Pan, Alberto ^a   Raposo, Juan ^a   Álvarez, Manuel ^a   Carneiro, Víctor ^a   Bellas, Fernando ^a  

^a UNIVERSITY OF A CORUÑA   (Spain)

Author keywords

Data mining Web based information; Technologies of DBs mediators and wrappers; Web Web based information systems

Indexed keywords

DATA STRUCTURES; HTML; QUERY PROCESSING; SET THEORY; SOFTWARE ENGINEERING; WEB SERVICES;

QUERY EXECUTION; SOFTWARE PROGRAMS; WEB SOURCES;

DATA MINING;

EID: 34548697961     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2007.04.009     Document Type: Article

References (26)

1. M. Álvarez, J. Raposo, F. Cacheda, A. Pan, A Task-specific approach for crawling the deep web, Journal Engineering Letters. Special Issue: Advances in Information Engineering 13 (2) (2006) 204-215.
2. V. Anupan, J. Freire, B. Kumar, D. Lieuwen, Automating Web Navigation with WebVCR, in: Proceedings of the 9th International World Wide Web Conference, 2000, pp. 503-517.
3. A. Arasu, H. García-Molina, Extracting structured data from web pages, in: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, 2003, pp. 337-348.
4. L. Barbosa, J, Freire, Searching for hidden-web databases, in: Proceedings of the ACM WebDB Workshop, 2005, pp. 1-6.
5. A. Bergholz, B. Chidlovskii, Crawling for domain-specific hidden web resources, in: Proceedings of the 4th International Conference on Web Information Systems Engineering (WISE), 2003, pp. 125-133.
6. K.C.-C. Chang, B. He, Z. Zhang, Toward large scale integration: building a metaquerier over databases on the web, in: Proceedings of the Second Conference on Innovative Data Systems Research (CIDR), 2005, pp. 44-55.
7. W. Cohen, P. Ravikumar, S. Fienberg, A comparison of string distance metrics for name-matching tasks, in: Proceedings of IJCAI-03 Workshop on Information Integration on the Web (IIWeb), 2003, pp. 73-78.
8. V. Crescenzi, G. Mecca, P. Merialdo, RoadRunner: towards automatic data extraction from large web sites, in: Proceedings of the 27th International Conference on Very Large Databases (VLDB), 2001, pp. 109-118.
9. E. Dragut, W. Wu, P. Sistla, C. Yu, W. Meng, Merging source query interfaces on web databases, in: Proceedings of the 22nd International Conference on Data Engineering (ICDE), 2006, pp. 679-690.
10. U. Irmak, T. Suel, Interactive wrapper generation with minimal user effort, in: Proceedings of the World Wide Web Conference (WWW), 2006, pp. 553-563.
11. Knoblock C.A., Lerman K., Minton S., and Muslea I. Accurately and reliably extracting data from the web: a machine learning approach. IEEE Data Engineering Bulleting 23 4 (2000) 33-41
12. N. Kushmerick, Regression testing for wrapper maintenance, in: Proceedings of the Sixteenth National Conference on Artificial Intelligence and Innovative Applications of Artificial Intelligence, 1999, pp. 74-79.
13. Kushmerick N. Wrapper induction: efficiency and expressiveness. Artificial Intelligence 118 (2000) 15-68
14. N. Kushmerick, Learning to invoke Web forms, in: Proceedings of Ontologies, Databases and Applications of Semantics (ODBASE) International Conference, 2003, pp. 997-1013.
15. Laender A.H.F., Ribeiro-Neto B.A., Soares da Silva A., and Teixeira J.S. A brief survey of web data extraction tools. ACM SIGMOD Record 31 2 (2002) 84-93
16. Lerman K., Minton S., and Knoblock C. Wrapper maintenance: a machine learning approach. Journal of Artificial Intelligence Research 18 (2003) 149-181
17. S.W. Liddle, D.W. Embley, D.T. Scott, S.H. Yau, Extracting data behind web forms, in: Proceedings of the 28th International Conference on Very Large Databases (VLDB), 2002, pp. 402-413.
18. X. Meng, D. Hu, C. Li, Schema-guided wrapper maintenance for web data extraction, in: Proceedings of the ACM Fifth International Workshop on Web Information and Data Management (WIDM), 2003, pp. 1-8.
19. R. Mohapatra, K. Rajaraman, S. Sam Yuan, Efficient wrapper reinduction from dynamic web sources, in: Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence, 2004, pp. 391-397.
20. A. Pan, J. Raposo, M. Álvarez, J. Hidalgo, A. Viña, Semi-automatic wrapper generation for commercial web sources, in: Proceedings of IFIP WG8.1 Working Conference on Engineering Information Systems in the Internet Context (EISIC), 2002, pp. 265-283.
21. A. Pan, J. Raposo, M. Álvarez, P. Montoto, J. Losada, J. Hidalgo, ITPilot: A toolkit for industrial-strength web data extraction, in: Proceedings of the 2005 IEEE/WIC/ACM International Conference on Web Intelligence (WI) 2005, pp. 798-801.
22. S. Raghavan, H. García-Molina, Crawling the hidden Web, in: Proceedings of the 27th Conference on Very Large Databases, VLDB 2001, pp. 129-138.
23. Raposo J., Pan A., Álvarez M., and Hidalgo J. Automatically maintaining wrappers for web sources. Data & Knowledge Engineering 61 2 (2007) 331-358
24. Wiederhold G. Mediators in the architecture of future information systems. Computer 25 3 (1992) 38-49
25. Zhai Y., and Liu B. Structured data extraction from the web based on partial tree alignment. IEEE Transactions on Knowledge and Data Engineering 18 12 (2006) 1614-1628
26. Z. Zhang, B. He, K.C.-C. Chang, Understanding web query interfaces: best-effort parsing with hidden syntax, in: Proceedings of the 2004 ACM SIGMOD Conference, 2004, pp. 107-118.