Efficient skyline computation on big data

IEEE Transactions on Knowledge and Data Engineering

Volumn 25, Issue 11, 2013, Pages 2521-2535

  Han, Xixian ^a   Li, Jianzhong ^a   Yang, Donghua ^a   Wang, Jinbao ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Big data; pruning; skyline; SSPL

Indexed keywords

BIG DATUM; INTERESTING POINTS; PRUNING; ROUND-ROBIN FASHIONS; SKYLINE; SKYLINE COMPUTATIONS; SSPL; SYNTHETIC AND REAL DATA;

COMPUTATIONAL METHODS; INFORMATION SYSTEMS;

ALGORITHMS;

EID: 84884749775     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2012.203     Document Type: Article

References (37)

1. I. Bartolini, P. Ciaccia, and M. Patella, "Efficient Sort-Based Skyline Evaluation," ACM Trans. Database Systems, vol. 33, no. 4, pp. 31:1-31:49, 2008.
2. I. Bartolini, Z. Zhang, and D. Papadias, "Collaborative Filtering with Personalized Skylines," IEEE Trans. Knowledge Data Eng., vol. 23, no. 2, pp. 190-203, Feb. 2011.
3. J.L. Bentley, H.T. Kung, M. Schkolnick, and C.D. Thompson, "On the Average Number of Maxima in a Set of Vectors and Applications," J. ACM, vol. 25, no. 4, pp. 536-543, 1978. (Pubitemid 9399481)
4. J.L. Bentley, K.L. Clarkson, and D.B. Levine, "Fast Linear Expected-Time Algorithms for Computing Maxima and Convex Hulls," Proc. First Ann. ACM-SIAM Symp. Discrete Algorithms (SODA '90), pp. 179-187, 1990.
5. M. Berger, Geometry I, vol. 1, Springer, 1987.
6. B.H. Bloom, "Space/Time Trade-Offs in Hash Coding with Allowable Errors," Comm. ACM, vol. 13, no. 7, pp. 422-426, 1970.
7. S. Bö rzsö nyi, D. Kossmann, and K. Stocker, "The Skyline Operator," Proc. 17th Int'l Conf. Data Eng. (ICDE '01), pp. 421-430, 2001. (Pubitemid 32457144)
8. R.E. Bryan, "Data-Intensive Supercomputing: The Case for Disc," Technical Report CMU-CS-07-128, School of Computer Science, Carnegie Mellon Univ., 2007.
9. C.-Y. Chan, H.V. Jagadish, K.-L. Tan, A.K.H. Tung, and Z. Zhang, "Finding K-Dominant Skylines in High Dimensional Space," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD '06), pp. 503-514, 2006. (Pubitemid 46946535)
10. L. Chen and X. Lian, "Efficient Processing of Metric Skyline Queries," IEEE Trans. Knowledge Data Eng., vol. 21, no. 3, pp. 351-365, Mar. 2009.
11. L. Chen, B. Cui, and H. Lu, "Constrained Skyline Query Processing against Distributed Data Sites," IEEE Trans. Knowledge Data Eng., vol. 23, no. 2, pp. 204-217, Feb. 2011.
12. J. Chomicki, P. Godfrey, J. Gryz, and D. Liang, "Skyline with Presorting," Proc. 19th Int'l Conf. Data Eng. (ICDE '03), pp. 717-719, 2003.
13. B. Cui, L. Chen, L. Xu, H. Lu, G. Song, and Q. Xu, "Efficient Skyline Computation in Structured Peer-to-Peer Systems," IEEE Trans. Knowledge Data Eng., vol. 21, no. 7, pp. 1059-1072, July 2009.
14. R. Fagin, A. Lotem, and M. Naor, "Optimal Aggregation Algorithms for Middleware," Proc. 31st ACM SIGMOD-SIGACTSIGART Symp. Principles of Database Systems (PODS '01), pp. 102-113, 2001. (Pubitemid 32865973)
15. W. Feller, An Introduction to Probability Theory and Its Applications, vol. 1, third ed. Wiley, 1968.
16. D. Freedman, R. Pisani, and R. Purves, Statistics, fourth ed. W.W. Norton & Company, 2007.
17. M. Gibas, G. Canahuate, and H. Ferhatosmanoglu, "Online Index Recommendations for High-Dimensional Databases Using Query Workloads," IEEE Trans. Knowledge and Data Eng., vol. 20, no. 2, pp. 246-260, Feb. 2008.
18. P. Godfrey, "Skyline Cardinality for Relational Processing," Foundations of Information and Knowledge Systems, vol. 2942, pp. 78-97, Springer Berlin/Heidelberg, 2004. (Pubitemid 38236602)
19. P. Godfrey, R. Shipley, and J. Gryz, "Algorithms and Analyses for Maximal Vector Computation," The VLDB J., vol. 16, no. 1, pp. 5-28, 2007. (Pubitemid 44655851)
20. J. Gray and P.J. Shenoy, "Rules of Thumb in Data Engineering," Proc. 16th Int'l Conf. Data Eng. (ICDE '00), pp. 3-12, 2000.
21. K. Hose and A. Vlachou, "A Survey of Skyline Processing in Highly Distributed Environments," The VLDB J., vol. 21, no. 3, pp. 359-384, 2012.
22. D. Kossmann, F. Ramsak, and S. Rost, "Shooting Stars in the Sky: An Online Algorithm for Skyline Queries," Proc. 28th Int'l Conf. Very Large Data Bases (VLDB '02), pp. 275-286, 2002.
23. H.T. Kung, F. Luccio, and F.P. Preparata, "On Finding the Maxima of a Set of Vectors," J. ACM, vol. 22, no. 4, pp. 469-476, 1975.
24. K.C. Lee, W.-C. Lee, B. Zheng, H. Li, and Y. Tian, "Z-Sky: An Efficient Skyline Query Processing Framework Based on ZOrder," The VLDB J., vol. 19, no. 3, pp. 333-362, 2010.
25. N. Mamoulis, M.L. Yiu, K.H. Cheng, and D.W. Cheung, "Efficient Top-K Aggregation of Ranked Inputs," ACM Trans. Database Systems, vol. 32, no. 3, p. 19, 2007.
26. D. Papadias, Y. Tao, G. Fu, and B. Seeger, "Progressive Skyline Computation in Database Systems," ACM Trans. Database Systems, vol. 30, no. 1, pp. 41-82, 2005. (Pubitemid 41201811)
27. Seagate, "Barracuda xt: No Compromise. Speed and Capacity for High-Performance Desktop Systems," http://www.seagate.com/docs/pdf/ datasheet/disc/ds-barracuda-xt.pdf, 2012.
28. C. Sheng and Y. Tao, "On Finding Skylines in External Memory," Proc. 30th ACM SIGMOD-SIGACT-SIGART Symp. Principles of Database Systems (PODS '11), pp. 107-116, 2011.
29. M. Stonebraker et al., "C-Store: A Column-Oriented DBMS," Proc. 31st Int'l Conf. Very Large Data Bases (VLDB '05), pp. 553-564, 2005. (Pubitemid 43991033)
30. K.-L. Tan, P.-K. Eng, and B.C. Ooi, "Efficient Progressive Skyline Computation," Proc. 27th Int'l Conf. Very Large Data Bases (VLDB '01), pp. 301-310, 2001.
31. Y. Tao, X. Xiao, and J. Pei, "Efficient Skyline and Top-K Retrieval in Subspaces," IEEE Trans. Knowledge Data Eng., vol. 19, no. 8, pp. 1072-1088, Aug. 2007. (Pubitemid 47000344)
32. Tom's Hardware, "Hard Drives: 40 mb to 750 gb," http://www.tomshardware.com/reviews/15-years-of-hard-drivehistory, 1368-2.html, 2006.
33. Wikipedia, "Curse of Dimensionality,"http://en.wikipedia.org/ wiki/Curse-of-dimensionality, 2012.
34. Wikipedia, "Equality of Arithmetic and Geometric Means," http://en.wikipedia.org/wiki/Inequality-of-arithmetic-and-geometric-means, 2012.
35. H.K.T. Wong, J. Li, F. Olken, D. Rotem, and L. Wong, "Bit Transposition for Very Large Scientific and Statistical Databases," Algorithmica, vol. 1, no. 3, pp. 289-309, 1986. (Pubitemid 17555822)
36. Z. Zhang, H. Lu, B.C. Ooi, and A.K. Tung, "Understanding the Meaning of a Shifted Sky: A General Framework on Extending Skyline Query," The VLDB J., vol. 19, no. 2, pp. 181-201, 2010.
37. L. Zhu, Y. Tao, and S. Zhou, "Distributed Skyline Retrieval with Low Bandwidth Consumption," IEEE Trans. Knowledge Data Eng., vol. 21, no. 3, pp. 384-400, Mar. 2009.