Efficient monitoring algorithm for fast news alerts

IEEE Transactions on Knowledge and Data Engineering

Volumn 19, Issue 7, 2007, Pages 950-961

  Sia, Ka Cheung ^a,b   Cho, Junghoo ^a,b   Cho, Hyun Kyu ^a,c  

^a IEEE

^b University of California   (United States)

^c Electronics and Telecommunications Research Institute (ETRI)   (South Korea)

Author keywords

Alert services; Information search and retrieval; Online information services; Performance evaluation; User profiles

Indexed keywords

ALERT SERVICES; INFORMATION SEARCH; ONLINE INFORMATION SERVICES; PERFORMANCE EVALUATION; USER PROFILES;

ALGORITHMS; INFORMATION SERVICES; ONLINE SYSTEMS; USER INTERFACES; WEBSITES; XML;

INFORMATION RETRIEVAL;

EID: 34249792130     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2007.1041     Document Type: Article

References (41)

1. M. Altmel and J.M. Franklin, "Efficient Filtering of XML Documents for Selective Dissemination of Information," Proc. Int'l Conf. Very Large Data Bases (VLDB '00), 2000.
2. Bloglines, http://www.bloglines.com, 2006.
3. Blogpulse, http://www.blogpulse.com, 2006.
4. B.E. Brewington and G. Cybenko, "How Dynamic Is the Web," Proc. Int'l World Wide Web Conf. (WWW '00), 2000.
5. A.Z. Broder, M. Najork, and J.L. Wiener, "Efficient URL Caching for World Wide Web Crawling," Proc. Int'l World Wide Web Conf. (WWW '03), 2003.
6. J. Chen, D.J. DeWitt, F. Tian, and Y. Wang, "NiagaraCQ: A Scalable Continuous Query System for Internet Databases," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD '00), 2000.
7. J. Cho and H. Garcia-Molina, "Synchronizing a Database to Improve Freshness," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD '00), 2000.
8. J. Cho and H. Garcia-Molina, "Parallel Crawlers," Proc. Int'l World Wide Web Conf. (WWW '02), May 2002.
9. J. Cho and H. Garcia-Molina, "Effective Page Refresh Policies for Web Crawlers," ACM Trans. Database Systems (TODS), vol. 28, no. 4, 2003.
10. J. Cho and H. Garcia-Molina, "Estimating Frequency of Change," ACM Trans. Internet Technology (TOIT), vol. 3, no. 3, Aug. 2003.
11. J. Cho and A. Ntoulas, "Effective Change Detection Using Sampling," Proc. Int'l Conf. Very Large Data Bases (VLDB '02), 2002.
12. J. Chu-Carroll, J. Prager, K. Czuba, D. Ferrucci, and P. Duboue, "Semantic Search via XML Fragments: A High-Precision Approach to IR," Proc. Int'l Conf. Research and Development in Information Retrieval (SIGIR '06), 2006.
13. E.G. Coffman Jr., Z. Liu, and R.R. Weber, "Optimal Robot Scheduling for Web Search Engines," J. Scheduling, vol. 1, no. 1, 1998.
14. P. Deolasee, A. Katkar, A. Panchbudhe, K. Ramamritham, and P. Shenoy, "Adaptive Push-Pull: Disseminating Dynamic Web Data," Proc. Int'l World Wide Web Conf. (WWW '01), 2001.
15. J. Edwards, K. McCurley, and J. Tomlin, "An Adaptive Model for Optimizing Performance of an Incremental Web Crawler," Proc. Int'l World Wide Web Conf. (WWW '00), 2000.
16. F. Fabret, A. Jacobsen, F. Llirbat, J. Pereira, and K. Ross, "Filtering Algorithms and Implementation for Very Fast Publish/Subscribe Systems," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD '01), 2001.
17. A. Gal and J. Eckstein, "Managing Periodically Updated Data in Relational Databases: A Stochastic Modeling Approach," J. ACM, vol. 48, no. 6, pp. 1141-1183, 2001.
18. Google Alerts, http://www.google.com/alerts, 2006.
19. Google Sitemaps Protocol Beta, https://www.google.com/webmasters/ sitemaps/docs/en/about.html, 2006.
20. D. Gruhl, R. Guha, D. Liben-Nowell, and A. Tomkins, "Information Diffusion through Blogspace," Proc. Int'l World Wide Web Conf. (WWW '04), 2004.
21. K. Hosanagar, "A Utility Theoretic Approach to Determining Optimal Wait Time in Distributed Information Retrieval," Proc. Int'l Conf. Research and Development in Information Retrieval (SIGIR '05), 2005.
22. T. Joachims, "Optimizing Search Engines Using Clickthrough Data," Proc. Int'l Conf. Knowledge Discovery and Data Mining (SIGKDD '02), 2002.
23. D.R. Karger and D. Quan, "What Would It Mean to Blog on the Semantic Web," Proc. Int'l Semantic Web Conf., 2004.
24. R. Lempel and S. Moran, "Preditive Caching and Prefetching of Query Results in Search Engines," Proc. Int'l World Wide Web Conf. (WWW '03), 2003.
25. L. Liu, C. Pu, and W. Tang, "Continual Queries for Internet Scale Event-Driven Information Delivery," IEEE Trans. Knowledge and Data Eng., vol. 11, pp. 610-628, 1999.
26. J. Lu and J. Callan, "Federated Search of TeX-Based Digital Libraries in Hierarchical Peer-to-Peer Networks," Proc. European Conf. Information Retrieval (ECIR '05), 2005.
27. D. Merrill, "Mashups: The New Breed of Web App," http://www.128.ibm.com/developerworks/library/x-mashups.html, 2006.
28. H. Nottelmann and N. Fuhr, "Evaluating Different Methods of Estimating Retrieval Quality for Resource Selection," Proc. Int'l Conf. Research and Development in Information Retrieval (SIGIR '03), 2003.
29. C. Olston and J. Widom, "Best-Effort Cache Synchronization with Source Cooperation," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD '02), 2002.
30. S. Pandey and C. Olston, "User-Centric Web Crawling," Proc. Int'l World Wide Web Conf. (WWW '05), 2005.
31. S. Pandey, K. Ramamritham, and S. Chakrabarti, "Monitoring the Dynamic Web to Respond to Continuous Queries," Proc. Int'l World Wide Web Conf. (WWW '03), 2003.
32. RSS 2.0 Specification, http://blogs.law.harvard.edu/tech/rss, 2006.
33. RSScache, http://www.rsscache.com, 2006.
34. S. Shah, S. Dharmarajan, and K. Ramamritham, "An Efficient and Resilient Approach to Filtering and Disseminating Streaming Data," Proc. Int'l Conf. Very Large Data Bases (VLDB '03), 2003.
35. L. Si and J. Callan, "Relevant Document Distribution Estimation Method for Resource Selection," Proc. Int'l Conf. Research and Development in Information Retrieval (SIGIR '03), 2003.
36. K.C. Sia and J. Cho, "Efficient Monitoring Algorithm for Fast News Alert," technical report, Univ. of California, Los Angeles, 2005, http://oak.cs.ucla.edu/~sia/pub/alert.pdf.
37. H.M. Taylor and S. Karlin, An Introduction to Stochastic Modeling, third ed. Academic Press, 1998.
38. Technorati, http://www.technorati.com, 2006.
39. C. Tryfonopoulos, S. Idreos, and M. Koubarakis, "Publish/Subscribe Functionality in IR Environments Using Structured Overlay Networks," Proc. Int'l Conf. Research and Development in Information Retrieval (SIGIR '05), 2005.
40. J.L. Wolf, M.S. Squillante, P.S. Yu, J. Sethuraman, and L. Ozsen, "Optimal Crawling Strategies for Web Search Engines," Proc. Int'l World Wide Web Conf. (WWW '02), 2002.
41. T. Yan and H. Garcia-Molina, "The SIFT Information Dissemination System," ACM Trans. Database Systems (TODS), vol. 24, no. 4, pp. 529-565, 2000.