An efficient approach of noise removal from web page for effectual web content mining

European Journal of Scientific Research

Volumn 50, Issue 3, 2011, Pages 345-356

  Sivakumar, P ^a   Parvathi, R M S ^b  

^a Annai Mathammal Sheela Engineering College   (India)

^b Sengunthar College of Engineering for Women   (India)

Author keywords

Duplicate blocks; Keyword redundancy; Linkword percentage; Titleword relevancy; Web cleaning; Web content mining; Web mining

Indexed keywords

EID: 79953805803     PISSN: 1450216X     EISSN: 1450202X     Source Type: Journal    
DOI: None     Document Type: Article

References (28)

1. Deng Cai1, Shipeng Yu, Ji-Rong Wen and Wei-Ying Ma, "Extracting Content Structure for Web Pages based on Visual Representation", In Proceedings of the 5th Asia-Pacific Web Conference on Web Technologies and Applications, pp. 406-417, Xian, China, 2003.
2. G. Poonkuzhali, K.Thiagarajan, K.Sarukesi and G.V.Uma, "Signed Approach for Mining Web Content Outliers", World Academy of Science, Engineering and Technology, Vol.56, pp. 820-824, 2009.
3. Malik Agyemang, Ken Barker and Rada S. Alhajj, "Mining Web Content Outliers using Structure Oriented Weighting Techniques and N-Grams", In Proceedings of the ACM Annual Symposium on Applied Computing, pp. 482-487, New Mexico, March 2005.
4. G. Poonkuzhali, K.Thiagarajan and K.Sarukesi, "Elimination of Redundant Links in Web Pages-Mathematical Approach", World Academy of Science, Engineering and Technology, No.52, pp. 562, April 2009.
5. Changjun Wu, Guosun Zeng and Guorong Xu, "A Web Page Segmentation Algorithm for Extracting Product Information", In Proceedings of the IEEE International Conference on Information Acquisition, pp. 1374-1379, Weihai, China, August 2006.
6. Renata Ivancsy and Istvan Vajk, "Frequent Pattern Mining in Web Log Data", Acta Polytechnica Hungarica, Journal of Applied Sciences at Budapest Tech Hungary, Special Issue on Computational Intelligence, Vol. 3, No. 1, pp.77-99, 2006.
7. Qiang Yang, Haining Henry Zhang, "Web Log Mining For Predictive Web Caching", IEEE Transactions on Knowledge and Data Engineering, Vol. 15, No. 4, pp. 1050-1053, 2003.
8. Raymond Kosala and Hendrik Blockeel, "Web Mining Research: A Survey", ACM SIGKDD Explorations, Vol. 2, No.1, pp. 1-15, 2000.
9. Mitra Nasri, Saeed Shariati and Mohammad Abdollahi Azgomi, "Performance Modeling of a Distributed Web Crawler using Stochastic Activity Networks", Communications in Computer and Information Science (CCIS), Springer-Verlag, Vol. 9, pp.535-542, ISSN: 1865-0929, 2008.
10. Bing Liu and Kevin Chen-Chuan-Chang, "Editorial: Special Issue on Web Content Mining", ACM SIGKDD Explorations Newsletter, Vol.6, No.2, pp. 1-4, 2004.
11. Yan Fu, Dongqing Yang, Shiwei Tang, Tengjiao Wang and Jun Gao, "Using XPath to Discover Informative Content Blocks of Web Pages", In Proceedings of the Third International Conference on Semantics, Knowledge and Grid (SKG 2007), pp. 450-453, October 29-31, Shan Xi, China, 2007.
12. Hui Guo and Amanda Stent, "Taxonomy Based Data Extraction from Multi-Item Web Pages", In Proceedings of Workshop on Web Content Mining with Human Language Technologies at the International Semantic Web Conference (ISWC), 2006.
13. Zhiwang Zhang and Yong Shi, "The Characteristic Analysis of Web User Clusters Based on Frequent Browsing Patterns", Lecture Notes in Computer Science, Vol. 4488, pp. 490-493, 2007.
14. A. K. Tripathy and A. K. Singh, "An Efficient Method of Eliminating Noisy Information in Web Pages for Data Mining", In Proceedings of the Fourth International Conference on Computer and Information Technology (CIT'04), pp. 978-985, September 14-16, Wuhan, China, 2004.
15. Zhao Cheng-li and Yi Dong-yun, "A Method of Eliminating Noises in Web Pages by Style Tree Model and Its Applications", Wuhan University Journal of Natural Sciences, Vol.9, No.5, pp. 611-616, 2004.
16. Manisha Marathe, S. H. Patil, G. V. Garje and M. S. Bewoor, "Extracting Content Blocks from Web Pages", International Journal of Recent Trends in Engineering (IJRTE), Vol.2, No.4, pp. 62-64, November 2009.
17. Sandip Debnath, Prasenjit Mitra and C. Lee Giles, "Automatic Extraction of Informative Blocks from Web Pages", In Proceedings of the ACM symposium on applied computing, pp. 1722-1726, Santa Fe, New Mexico, 2005.
18. Ruihua Song, Haifeng Liu, Ji-Rong Wen and Wei-Ying Ma, "Learning Block Importance Models for Web Pages", In Proceedings of the 13th International Conference on World Wide Web, pp. 203-211, 2004. (Pubitemid 40752755)
19. Ruihua Song, Haifeng Liu, Ji-Rong Wen and Wei-Ying Ma, "Learning Important Models for Web Page Blocks based on Layout and Content Analysis", ACM SIGKDD Explorations Newsletter, Vol. 6, No. 2, pp. 14-23, 2004.
20. Byeong Ho Kang and Yang Sok Kim, "Noise Elimination from The Web Documents By Using URL Paths and Information Redundancy", In Proceedings of the International Conference on Information & Knowledge Engineering, pp. 135-141, June 26-29, Las Vegas, Nevada, US, 2006.
21. W. Chisholm, G. Vanderheiden, and I. Jacobs, "Techniques for Web Content Accessibility Guidelines 1.0", W3C Note, 2000.
22. Lan Yi and Bing Liu, "Web Page Cleaning for Web Mining Through Feature Weighting", In Proceedings of the 18th International Joint Conference on Artificial Intelligence,Vol.18, pp. 43-50, August 09-15, Acapulco, Mexico, 2003.
23. Lan Yi, Bing Liu and Xiaoli Li, "Eliminating Noisy Information in Web Pages for Data Mining", In Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 296-305, August 24-27, Washington, DC, USA, 2003.
24. Chao Wang, Jie Lua, and Guangquan Zhanga, "Mining Key Information of Web Pages: A Method and Its Application", Expert Systems with Applications, Vol.33, No.2, pp.425-433, August 2007. (Pubitemid 46157268)
25. Yan Guo, Huifeng Tang, Linhai Song, Yu Wang and Guodong Ding, "ECON: An Approach to Extract Content from Web News Page", In Proceedings of the 12th International Asia-Pacific Web Conference (APWEB), pp. 314-320, April 06-08, Buscan, Korea, 2010.
26. Moses S. Charikar, "Similarity Estimation Techniques From Rounding Algorithms", In Proceedings of the 34th Annual Symposium on Theory of Computing (STOC 2002), pp. 380-388, Montreal, Quebec, Canada, 2002. (Pubitemid 35009398)
27. Gurmeet Singh Manku, Arvind Jain and Anish Das Sarma, "Detecting Near-Duplicates for Web Crawling", In Proceedings of the 16th International Conference on World Wide Web, pp. 141-150, May 8-12, Banff, Alberta, Canada, 2007. (Pubitemid 47582246)
28. N. Kushmerick Ed, "Adaptive Text Extraction and Mining (Working Notes)", In Proceedings of the Seventeenth International Joint Conference on Artificial Intelligent (IJCAI-2001), Seattle, Washington, 2001.