Bigtable
Fay W. Chang, Jeffrey Dean, Sanjay Ghemawat et al. · ACM Transactions on Computer Systems · 2008
Bigtable is a distributed storage system for managing structured data that is designed to scale to a very large size: petabytes of data across thousands of commodity servers. Many projects at Google store data in Bigtable, including web indexing, Google Earth, and Google Finance. These applications place very different demands on Bigtable, both in terms of data size (from URLs to web pages to satellite imagery) and latency requirements (from backend bulk processing to real-time data serving). Despite these varied demands, Bigtable has successfully provided a flexible, high-performance solution for all of these Google products. In this article, we describe the simple data model provided by Bigtable, which gives clients dynamic control over data layout and format, and we describe the design and implementation of Bigtable.
Cited by 3,460 works. doi:10.1145/1365815.1365816
Authors
- Fay W. Chang
- Sanjay Ghemawat
- Wilson C. Hsieh
- Deborah A. Wallach
- Mike Burrows
- Andrew Fikes
- Robert E. Gruber
References
- Lecture Notes in Computer Science 1205
- MapReduce
- Chord
- The Google file system
- A scalable content-addressable network
- Notes on data base operating systems
- Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems
- Space/time trade-offs in hash coding with allowable errors
- Recursive functions of symbolic expressions and their computation by machine, Part I
- Tapestry: An Infrastructure for Fault-tolerant Wide-area Location and Routing