Maintaining dynamic channel profiles on the web

Proceedings of the VLDB Endowment

Volumn 1, Issue 1, 2008, Pages 151-162

  Roitman, Haggai ^a   Carmel, David ^a   Yom Tov, Elad ^a  

^a IBM HAIFA RESEARCH LAB   (Israel)

Author keywords

Channel profiles; Web feeds; Web monitoring

Indexed keywords

BUDGET CONTROL; WEB CRAWLER;

CHANNEL PROFILE; DYNAMIC CHANNELS; DYNAMIC NATURE; NOVELTY DETECTION; WEB 2.0 APPLICATIONS; WEB FEEDS; WEB INFORMATION; WEB MONITORING;

MONITORING;

EID: 77954462339     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/1453856.1453878     Document Type: Article

References (29)

1. T. Brants and F. Chen. A system for new event detection. In SIGIR '03: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, pages 330-337, New York, NY, USA, 2003. ACM.
2. L. Brenna, A. Demers, J. Gehrke, M. Hong, J. Ossher, B. Panda, M. Riedewald, M. Thatte, and W. White. Cayuga: a high-performance event processing engine. In SIGMOD '07: Proceedings of the 2007 ACM SIGMOD international conference on Management of data, pages 1100-1102, New York, NY, USA, 2007. ACM.
3. L. Bright, A. Gal, and L. Raschid. Adaptive pull-based policies for wide area data delivery. ACM Transactions on Database Systems (TODS), 31(2):631-671, 2006.
4. D. Carmel and E. Amitay. Juru at TREC 2006: TAAT versus DAAT in the terabyte track. In Proceedings of the 15th Text REtrieval Conference (TREC2006). National Institute of Standards and Technology. NIST, 2006.
5. D. Carmel, E. Farchi, Y. Petruschka, and A. Soffer. Automatic query refinement using lexical affinities with maximal information gain. In SIGIR '02: Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, pages 283-290. ACM Press, 2002.
6. J. Cho and H. Garcia-Molina. Synchronizing a database to improve freshness. In SIGMOD '00: Proceedings of the 2000 ACM SIGMOD international conference on Management of data, pages 117-128, New York, NY, USA, 2000. ACM.
7. J. Cho and H. Garcia-Molina. Effective page refresh policies for web crawlers. ACM Transactions on Database Systems (TODS), 28(4):390-426, 2003.
8. J. Cho and H. Garcia-Molina. Estimating frequency of change. ACM Transactions on Internet Technology, 3(3):256-290, 2003.
9. J. Eckstein, A. Gal, and S. Reiner. Monitoring an information source under a politeness constraint. INFORMS Journal on Computing, 2007.
10. E. Gabrilovich, S. Dumais, and E. Horvitz. Newsjunkie: providing personalized newsfeeds via analysis of information novelty. In WWW '04: Proceedings of the 13th international conference on World Wide Web, pages 482-490, New York, NY, USA, 2004. ACM.
11. A. Gal and J. Eckstein. Managing periodically updated data in relational databases: a stochastic modeling approach. Journal of the ACM (JACM), 48(6):1141-1183, 2001.
12. S. Garg, K. Ramamritham, and S. Chakrabarti. Web-cam: monitoring the dynamic web to respond to continual queries. In SIGMOD '04: Proceedings of the 2004 ACM SIGMOD international conference on Management of data, pages 927-928, New York, NY, USA, 2004. ACM.
13. L. P. Kaelbling, M. L. Littman, and A. W. Moore. Reinforcement learning: A survey. Journal of Artificial Intelligence Research (JAIR), cs.AI/9605103, 1996.
14. R. kr. Majumdar, K. M. Moudgalya, and K. Ramamritham. Adaptive coherency maintenance techniques for time-varying data. In RTSS '03: Proceedings of the 24th IEEE International Real-Time Systems Symposium, page 98, Washington, DC, USA, 2003. IEEE Computer Society.
15. H. Liu, V. Ramasubramanian, and E. G. Sirer. Client behavior and feed characteristics of RSS, a publish-subscribe system for web micronews. In IMC'05: Proceedings of the Internet Measurement Conference 2005 on Internet Measurement Conference, pages 3-3, Berkeley, CA, USA, 2005. USENIX Association.
16. G. Luo, C. Tang, and P. S. Yu. Resource-adaptive real-time new event detection. In SIGMOD '07: Proceedings of the 2007 ACM SIGMOD international conference on Management of data, pages 497-508, New York, NY, USA, 2007. ACM.
17. A. Ntoulas, J. Cho, and C. Olston. What's new on the web?: the evolution of the web from a search engine perspective. In Proceedings of the 13th international conference on World Wide Web (WWW), pages 1-12, 2004.
18. S. Pandey, K. Dhamdhere, and C. Olston. WIC: A general-purpose algorithm for monitoring web information sources. In Proceedings of the 30th International Conference on Very Large Data Bases (VLDB), pages 360-371, 2004.
19. S. Pandey and C. Olston. User-centric web crawling. In Proceedings of the 14th international conference on World Wide Web (WWW), pages 401-411, New York, NY, USA, 2005. ACM.
20. R. K. Pon, A. F. Cardenas, D. Buttler, and T. Critchlow. Tracking multiple topics for finding interesting articles. In KDD '07: Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 560-569, New York, NY, USA, 2007. ACM.
21. D. Radev, J. Otterbacher, A. Winkel, and S. Blair-Goldensohn. Newsinessence: summarizing online news topics. Communications of the ACM, 48(10):95-98, 2005.
22. H. Roitman, A. Gal, and L. Raschid. Profile based online data delivery. In Proceedings of the VLDB '06 Phd Workshop, Seoul, Rep. of Korea, 2006.
23. H. Roitman, A. Gal, and L. Raschid. Capturing approximated data delivery tradeoffs. In ICDE'08: Proceedings of the 24th International Conference on Data Engineering, pages 1471-1473, 2008.
24. H. Roitman, A. Gal, and L. Raschid. Satisfying complex data needs using pull-based online monitoring of volatile data sources. In ICDE'08: Proceedings of the 24th International Conference on Data Engineering, pages 1465-1467, 2008.
25. G. Salton and C. Buckley. Term weighting approaches in automatic text retrieval. Information Processing and Management, 24(5):513-523, 1988.
26. K. C. Sia, J. Cho, and H.-K. Cho. Efficient monitoring algorithm for fast news alerts. IEEE Transactions on Knowledge and Data Engineering, 19(7):950-961, 2007.
27. K. C. Sia, J. Cho, K. Hino, Y. Chi, S. Zhu, and B. L. Tseng. Monitoring rss feeds based on user browsing pattern search. In Proceedings of the International Conference on Weblogs and Social Media, 2007.
28. Y.-C. Tu, S. Liu, S. Prabhakar, and B. Yao. Load shedding in stream databases: a control-based approach. In VLDB '06: Proceedings of the 32nd international conference on Very large data bases, pages 787-798. VLDB Endowment, 2006.
29. Y. Zhang, J. Callan, and T. Minka. Novelty and redundancy detection in adaptive filtering. In SIGIR '02: Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, pages 81-88, New York, NY, USA, 2002. ACM.