Bigtable: a distributed storage system for structured data
Fay W. Chang, Jay B. Dean, Sanjay Ghemawat et al. · 2006
Bigtable is a distributed storage system for managing structured data that is designed to scale to a very large size: petabytes of data across thousands of commodity servers. Many projects at Google store data in Bigtable, including web indexing, Google Earth, and Google Fi-nance. These applications place very different demands on Bigtable, both in terms of data size (from URLs to web pages to satellite imagery) and latency requirements (from backend bulk processing to real-time data serving). Despite these varied demands, Bigtable has successfully provided a exible, high-performance solution for all of these Google products. In this paper we describe the sim-ple data model provided by Bigtable, which gives clients dynamic control over data layout and format, and we de-scribe the design and implementation of Bigtable. 1
Cited by 1,928 works. doi:10.5555/1298455.1298475
Authors
- Fay W. Chang
- Sanjay Ghemawat
- Wilson C. Hsieh
- Deborah A. Wallach
- Mike Burrows
- Andrew Fikes
- Robert E. Gruber
References
- Chord
- The Google file system
- A scalable content-addressable network
- Notes on data base operating systems
- Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems
- Space/time trade-offs in hash coding with allowable errors
- Recursive functions of symbolic expressions and their computation by machine, Part I
- MapReduce: Simplified Data Processing on Large Cluster
- Tapestry: An Infrastructure for Fault-tolerant Wide-area Location and Routing
- Ubiquitous B-Tree