Dynamo
Giuseppe DeCandia, Deniz Hastorun, Madan Jampani et al. · ACM SIGOPS Operating Systems Review · 2007
Reliability at massive scale is one of the biggest challenges we face at Amazon.com, one of the largest e-commerce operations in the world; even the slightest outage has significant financial consequences and impacts customer trust. The Amazon.com platform, which provides services for many web sites worldwide, is implemented on top of an infrastructure of tens of thousands of servers and network components located in many datacenters around the world. At this scale, small and large components fail continuously and the way persistent state is managed in the face of these failures drives the reliability and scalability of the software systems. This paper presents the design and implementation of Dynamo, a highly available key-value storage system that some of Amazon's core services use to provide an "always-on" experience. To achieve this level of availability, Dynamo sacrifices consistency under certain failure scenarios. It makes extensive use of object versioning and application-assisted conflict resolution in a manner that provides a novel interface for developers to use.
Cited by 1,151 works. doi:10.1145/1323293.1294281
Authors
- Giuseppe DeCandia
- Deniz Hastorun
- Madan Jampani
- Gunavardhan Kakulapati
- Avinash Lakshman
- Alex Pilchin
- Swaminathan Sivasubramanian
- Peter Vosshall
- Werner Vogels
References
- Time, clocks, and the ordering of events in a distributed system
- Chord
- The Google file system
- Consistent hashing and random trees
- Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility
- Cluster-based scalable network services
- A Majority consensus approach to concurrency control for multiple copy databases
- The dangers of replication and a solution
- Managing update conflicts in Bayou, a weakly connected replicated storage system
- SEDA