Bigtable: A distributed storage system for structured data

ACM Transactions on Computer Systems

Volumn 26, Issue 2, 2008, Pages

  Chang, Fay ^a   Dean, Jeffrey ^a   Ghemawat, Sanjay ^a   Hsieh, Wilson C ^a   Wallach, Deborah A ^a   Burrows, Mike ^a   Chandra, Tushar ^a   Fikes, Andrew ^a   Gruber, Robert E ^a  

^a GOOGLE INC   (United States)

Author keywords

Large scale distributed storage

Indexed keywords

COMMODITY SERVERS; DATA LAYOUTS; DATA MODELLING; DATA SIZE; DISTRIBUTED STORAGE SYSTEMS; DYNAMIC CONTROLS; GOOGLE EARTH; LARGE SIZES; PETABYTES (PB); REAL-TIME DATA; STRUCTURED DATA; WEB INDEXING; WEB PAGES;

DATA STORAGE EQUIPMENT; INTERNET; SATELLITE IMAGERY;

DATA PROCESSING;

EID: 47749140025     PISSN: 07342071     EISSN: 15577333     Source Type: Journal    
DOI: 10.1145/1365815.1365816     Document Type: Article

References (39)

1. ABADI, D. J., MADDEN, S. R., and FERREIRA, M. C. 2006. Integrating compression and execution in column-oriented database systems. Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York.
2. AILAMAKI, A., DEWITT, D. J., HILL, M. D., AND SKOUNAKIS, M. 2001. Weaving relations for cache performance. The VLDB J. 169-180.
3. BANGA, G., DRUSCHEL, P., AND MOGUL, J. C. 1999. Resource containers: A new facility for resource management in server systems. In Proceedings of the 3rd Symposium on Operating Systems Design and Implementation. 45-58.
4. BARU, C. K., FECTEAU, G., GOYAL, A., HSIAO, H., JHINGRAN, A., PADMANABHAN, S., COPELAND, G. P., AND WILSON, W. G. 1995. DB2 parallel edition. IBM Syst. J. 34, 2, 292-322.
5. BAVIER, A., BOWMAN, M., Chun, B., CULLER, D., KARLIN, S., PETERSON, L., ROSCOE, T., SPALINK, T., AND WAWRZONIAK, M. 2004. Operating system support for planetary-scale network services. In Proceedings of the 1st Symposium on Networked Systems Design and Implementation. 253-266.
6. BENTLEY, J. L. AND MCILROY, M. D. 1999. Data compression using long common strings. In Data Compression Conference. 287-295.
7. BLOOM, B. H. 1970. Space/time trade-offs in hash coding with allowable errors. Commun. ACM 13, 7, 422-426.
8. BURROWS, M. 2006. The Chubby lock service for loosely-coupled distributed systems. In Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation. 335-350.
9. CHANDRA, T., GRIESEMER, R., AND REDSTONE, J. 2007. Paxos made live - An engineering perspective. In Proceedings of PODC.
10. CHANG, F., DEAN, J., GHEMAWAT, S., HSIEH, W. C., WALLACH, D. A., BURROWS, M., CHANDRA, T., FIKES, A., AND GRUBER, R. E. 2006. Bigtable: A distributed storage system for structured data. In Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation. 205-218.
11. COMER, D. 1979. Ubiquitous B-tree. Computing Surveys 11, 2 (June), 121-137.
12. COPELAND, G. P., ALEXANDER, W., BOUGHTER, E. E., AND KELLER, T. W. 1988. Data placement in Bubba. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 99-108.
13. DEAN, J. AND GHEMAWAT, S. 2004. MapReduce: Simplified data processing on large clusters. In Proceedings of the 6th USENIX Symposium on Operating Systems Design and Implementation. 137-150.
14. DEWITT, D., KATZ, R., OLKEN, F., SHAPIRO, L., STONEBRAKER, M., AND WOOD, D. 1984. Implementation techniques for main memory database systems. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 1-8.
15. DEWITT, D. J. AND GRAY, J. 1992. Parallel database systems: The future of high performance database systems. Commun. ACM 35, 6 (June), 85-98.
16. FRENCH, C. D. 1995. One size fits all database architectures do not work for DSS. In PROCEEDINGS OF THE ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA. ACM, New York, 449-450.
17. GAWLICK, D. AND KINKADE, D. 1985. Varieties of concurrency control in IMS/VS fast path.Datab. Eng. Bull. 8, 2, 3-10.
18. GHEMAWAT, S., GOBIOFF, H., AND LEUNG, S.-T. 2003. The Google file system. In Proceedings of the 19th ACM Symposium on Operating Systems Principles. ACM, New York, 29-43.
19. GRAY, J. 1978. Notes on database operating systems. In Operating Systems - An Advanced Course. Lecture Notes in Computer Science, vol. 60. Springer-Verlag, ACM, New York.
20. GREER, R. 1999. Daytona and the fourth-generation language Cymbal. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 525-526.
21. HAGMANN, R. 1987. Reimplementing the Cedar file system using logging and group commit. In Proceedings of the 11th Symposium on Operating Systems Principles. 155-162.
22. HARTMAN, J. H. AND OUSTERHOUT, J. K. 1993. The Zebra striped network file system. In Proceedings of the 14th Symposium on Operating Systems Principles. ACM, New York, 29-43.
23. kx.com. kx.com/products/database.php. Product page.
24. LAMPORT, L. 1998. The part-time parliament. ACM Trans. Comput. Syst. 16, 2, 133-169.
25. MACCORMICK, J., MURPHY, N., NAJORK, M., THEKKATH, C. A., AND ZHOU, L. 2004. Boxwood: Abstractions as the foundation for storage infrastructure. In Proceedings of the 6th USENIX Symposium on Operating Systems Design and Implementation. 105-120.
26. MCCARTHY, J. 1960. Recursive functions of symbolic expressions and their computation by machine. Commun. ACM 3, 4 (Apr.), 184-195.
27. O'NEIL, P., CHENG, E., GAWLICK, D., AND O'NEIL,E. 1996. The log-structured merge-tree (LSM-tree). Acta Inf. 33, 4, 351-385.
28. oracle.com. www.oracle.com/technology/products/database/clustering/index. html. Product page.
29. PIKE, R., DORWARD, S., GRIESEMER, R., AND QUINLAN, S. 2005. Interpreting the data: Parallel analysis with Sawzall. Scientific Programming Journal 13, 4, 227-298.
30. RATNASAMY, S., FRANCIS, P., HANDLEY, M., KARP, R., AND SHENKER, S. 2001. A scalable content-addressable network. In Proceedings of SIGCOMM. ACM, New York, 161-172.
31. ROWSTRON, A. AND DRUSCHEL, P. 2001. Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. In Proceedings of Middleware 2001. 329-350.
32. sensage.com. sensage.com/products-sensage.htm. Product page.
33. STOICA, I., MORRIS, R., KARGER, D., KAASHOEK, M. F., AND BALAKRISHNAN, H. 2001. Chord: A scalable peer-to-peer lookup service for Internet applications. In Proceedings of SIGCOMM. ACM, New York, 149-160.
34. STONEBRAKER, M. 1986. The case for shared nothing. Datab. Eng. Bull. 9, 1 (Mar.), 4-9.
35. STONEBRAKER, M., ABADI, D. J., BATKIN, A., CHEN, X., CHERNIACK, M., FERREIRA, M., LAU, E., LIN, A., MADDEN, S., O'NEIL, E., O'NEIL, P., RASIN, A., TRAN, N., AND ZDONIK, S. 2005. C-Store: A column-oriented DBMS. In PROCEEDINGS OF THE 10TH INTERNATIONAL CONFERENCE ON VERY LARGE DATA BASES. ACM, New York, 553-564.
36. STONEBRAKER, M., AOKI, P. M., DEVINE, R., LITWIN, W., AND OLSON, M. A. 1994. Mariposa: A new architecture for distributed data. In Proceedings of the 10th International Conference on Data Engineering. IEEE Computer Society Press, Los Alamitos, CA, 54-65.
37. sybase.com. www.sybase.com/products/databaseservers/sybaseiq. Product page.
38. ZHAO, B. Y., KUBIATOWICZ, J., AND JOSEPH, A. D. 2001. Tapestry: An infrastructure for faulttolerant wide-area location and routing. Tech. Rep. UCB/CSD-01-1141, CS Division, University of California, Berkeley. Apr.
39. ZUKOWSKI, M., BONCZ, P. A., NES, N., AND HEMAN, S. 2005. MonetDB/X100 - A DBMS in the CPU cache. IEEE Data Eng. Bull. 28, 2, 17-22.