A machine learning approach to web page filtering using content and structure analysis

Decision Support Systems

Volumn 44, Issue 2, 2008, Pages 482-494

  Chau, Michael ^a   Chen, Hsinchun ^b  

^a UNIVERSITY OF HONG KONG   (Hong Kong)

^b UNIVERSITY OF ARIZONA   (United States)

Author keywords

Link analysis; Machine learning; Web mining; Web page classification

Indexed keywords

BACKPROPAGATION ALGORITHMS; ENGINEERING RESEARCH; NEURAL NETWORKS; SEARCH ENGINES; WEBSITES;

TOPIC-SPECIFIC SEARCH ENGINES; WEB CONTENT MANAGEMENT;

LEARNING SYSTEMS;

EID: 36249013642     PISSN: 01679236     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dss.2007.06.002     Document Type: Article

References (53)

1. Arasu A., Cho J., Garcia-Molina H., Paepcke A., and Raghavan S. Searching the web. ACM Transactions on Internet Technology 1 1 (2001) 2-43
2. Baujard O., Baujard V., Aurel S., Boyer C., and Appel R.D. Trends in medical information retrieval on the Internet. Computers in Biology and Medicine 28 (1998) 589-601
3. Brin S., and Page L. The anatomy of a large-scale hypertextual web search engine. Proceedings of the 7th International World Wide Web Conference, Brisbane, Australia (Apr 1998)
4. Chai K.M.A., Chieu H.L., and Ng H.T. Bayesian online classifiers for text classification and filtering. Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Tampere, Finland (Aug 2002) 97-104
5. Chakrabarti S., Dom B., and Indyk P. Enhanced hypertext categorization using hyperlink. Proceedings of ACM SIGMOD International Conference on Management of Data, Seattle, Washington, USA (Jun 1998)
6. Chakrabarti S., Dom B.E., Kumar S.R., Raghavan P., Rajagopalan S., Tomkins A., Gibson D., and Kleinberg J. Mining the web's link structure. IEEE Computer 32 8 (1999) 60-67
7. Chakrabarti S., van den Berg M., and Dom B. Focused crawling: a new approach to topic-specific web resource discovery. Proceedings of the 8th International World Wide Web Conference, Toronto, Canada (May 1999)
8. Chau M., and Chen H. Comparison of three vertical search spiders. IEEE Computer 36 5 (2003) 56-62
9. Chau M., and Chen H. Personalized and focused Web spiders. In: Zhong N., Liu J., and Yao Y. (Eds). Web intelligence (2003), Springer-Verlag 197-217
10. Chau M., and Chen H. Incorporating Web analysis into neural networks: an example in hopfield net searching. IEEE Transactions on Systems, Man, and Cybernetics (Part C) 37 3 (2007) 352-358 (May)
11. Chau M., Huang Z., Qin J., Zhou Y., and Chen H. Building a scientific knowledge web portal: the nanoport experience. Decision Support Systems 42 2 (2006) 1216-1238
12. Chen H. Machine learning for information retrieval: neural networks, symbolic learning, and genetic algorithms. Journal of the American Society for Information Science 46 3 (1995) 194-216
13. Chen H., Chung Y., Ramsey M., and Yang C.C. An intelligent personal spider (Agent) for dynamic Internet/Intranet searching. Decision Support Systems 23 (1998) 41-58
14. Chen H., Lally A., Zhu B., and Chau M. HelpfulMed: intelligent searching for medical information over the internet. Journal of the American Society for Information Science and Technology 54 7 (2003) 683-694
15. Cheong F.C. Internet Agents: Spiders, Wanderers, Brokers, and Bots (1996), New Riders Publishing, Indianapolis, Indiana, USA
16. Cho J., Garcia-Molina H., and Page L. Efficient crawling through URL ordering. Proceedings of the 7th International World Wide Web Conference, Brisbane, Australia (Apr 1998)
17. Cohen W.W. Text categorization and relational learning. Proceedings of the 12th International Conference on Machine Learning (ICML'95) (1995), Morgan Kaufmann
18. Cohen W.W., and Singer Y. Context-sensitive learning methods for text categorization. ACM Transactions on Information Systems 17 2 (1999) 141-173
19. Diligenti M., Coetzee F., Lawrence S., Giles C.L., and Gori M. Focused crawling using context graphs. Proceedings of the 26th International Conference on Very Large Databases, VLDB 2000, Cairo, Egypt (2000) 527-534
20. Dumais S.T., Platt J., Heckerman D., and Sahami M. Inductive learning algorithms and representations for text categorization. Proceedings of ACM Conference on Information and Knowledge Management, Bethesda, Maryland (Nov. 1998) 148-155
21. Furnkranz J. Exploiting structural information for text categorization on the WWW. Proceedings of the 3rd Symposium on Intelligent Data Analysis (IDA'99), Amsterdam, Netherlands (1999) 487-497
22. Iwayama M., and Tokunaga T. Cluster-based text categorization: a comparison of category search strategies. Proceedings of the 18th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR'95) (1995) 273-281
23. Joachims T. Text categorization with support vector machines: learning with many relevant features. Proceedings of the European Conference on Machine Learning, Berlin (1998) 137-142
24. Joachims T. Making large-Scale SVM Learning Practical. In: Schölkopf B., Burges C., and Smola A. (Eds). Advances in Kernel Methods- Support Vector Learning (1999), MIT-Press
25. Joachims T., Chistianini N., and Shawe-Taylor J. Composite kernels for hypertext categorization. Proceedings of the 18th International Conference on Machine Learning (ICML'01) (2001)
26. Kleinberg J. Authoritative sources in a hyperlinked environment. Proceedings of the ACM-SIAM Symposium on Discrete Algorithms (1998)
27. Kohavi R. A study of cross-validation and bootstrap for accuracy estimation and model selection. Proceedings of the 14th International Joint Conference on Artificial Intelligence, San Francisco, CA (1995), Morgan Kaufmann 1137-1143
28. Koller D., and Sahami M. Hierarchically classifying documents using very few words. Proceedings of the 14th International Conference on Machine Learning (ICML'97) (1997) 170-178
29. Kumar R., Raghavan P., Rajagopalan S., and Tomkins A. Trawling the Web for emerging cyber-communities. Proceedings of the Eighth WWW Conference, Toronto, Canada (May 1999)
30. Labrou Y., and Finin T. Yahoo! as an ontology: using yahoo! categories to describe documents. Proceedings of the Eighth International Conference on Information and Knowledge Management, Kansas City, Missouri, United States (1999) 180-187
31. Lam S.L.Y., and Lee D.L. Feature reduction for neural network based text categorization. Proceedings of the International Conference on Database Systems for Advanced Applications (DASFAA '99), Hsinchu, Taiwan, Apr 1999 (1999)
32. Lam W., Ruiz M., and Srinivasan P. Automatic text categorization and its application to text retrieval. IEEE Transactions on Knowledge and Data Engineering 11 6 (1999) 865-879
33. Lewis D.D., and Ringuette M. Comparison of two learning algorithms for text categorization. Proceedings of the Third Annual Symposium on Document Analysis and Information Retrieval (SDAIR'94) (1994)
34. Lin S.H., Chen M.C., Ho J.M., and Huang Y.M. ACIRD: intelligent Internet document organization and retrieval. IEEE Transactions on Knowledge and Data Engineering 14 3 (2002) 599-614
35. Lippmann R.P. An introduction to computing with neural networks. IEEE Acoustics Speech and Signal Processing Magazine 4 2 (1987) 4-22
36. Manber U., Smith M., and Gopal B. WebGlimpse: combining browsing and searching. Proceedings of the USENIX 1997 Annual Technical Conference, Anaheim, California (Jan 1997)
37. Masand B., Linoff G., and Waltz D. Classifying news stories using memory based reasoning. Proceeedings of the 15th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR'92) (1992) 59-64
38. McCallum A., Nigam K., Rennie J., and Seymore K. A machine learning approach to building domain-specific search engines. Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI-99) (1999) 662-667
39. Ng H.T., Goh W.B., and Low K.L. Feature selection, perceptron learning, and a usability case study for text categorization. Proceedings of the 20th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR'97) (1997) 67-73
40. Oh H.J., Myaeng S.H., and Lee M.H. A practical hypertext categorization method using links and incrementally available class information. Proceedings of the 23rd Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR'00) (2000) 264-271
41. Porter M.F. An algorithm for suffix stripping. Program 14 3 (1980) 130-137
42. Riloff E., and Lehnert W. Information extraction as a basis for high-precision text classification. ACM Transactions on Information Systems 12 3 (1994) 296-333
43. Stone M. Cross-validation choices and assessment of statistical predictions. Journal of the Royal Statistical Society 36 (1974) 111-147
44. Sun A., Lim E.-P., and Ng W.-K. Performance measurement framework for hierarchical text classification. Journal of the American Society for Information Science and Technology 54 11 (2003) 1014-1028
45. Sumner R.G., Yang K., and Dempsey B.J. An interactive www search engine for user-defined collections. Proceedings of the 3rd ACM Conference on Digital Libraries, Pittsburgh, Pennsylvania, USA (Jun 1998) 307-308
46. van Rijsbergen C.J. Information Retrieval. Second Edition (1979), Butterworths, London
47. Vapnik V. The Nature of Statistical Learning Theory (1995), Springer
48. Vapnik V. Statistical Learning Theory (1998), Wiley, Chichester, GB
49. Wiener E., Pedersen J.O., and Weigend A.S. A neural network approach to topic spotting. Proceedings of the 4th Annual Symposium on Document Analysis and Information Retrieval (SDAIR'95) (1995)
50. Witten I.H., Bainbridge D., and Boddie S.J. Greenstone: open-source DL software. Communications of the ACM 44 5 (2001) 47
51. Yang Y., and Liu X. A re-examination of text categorization methods. Proceedings of the 22nd Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR'99) (1999) 42-49
52. Yang Y., Slattery S., and Ghani R. A study of approaches to hypertext categorization. Journal of Intelligent Information Systems 18 2 (March 2002)
53. Tolle K., and Chen H. Comparing noun phrasing techniques for use with medical digital library tools. Journal of the American Society for Information Science 51 4 (2000) 352-370