Niobe
John MacCormick, Chandramohan A. Thekkath, Marcus Jager et al. · ACM Transactions on Storage · 2008
The task of consistently and reliably replicating data is fundamental in distributed systems, and numerous existing protocols are able to achieve such replication efficiently. When called on to build a large-scale enterprise storage system with built-in replication, we were therefore surprised to discover that no existing protocols met our requirements. As a result, we designed and deployed a new replication protocol called Niobe . Niobe is in the primary-backup family of protocols, and shares many similarities with other protocols in this family. But we believe Niobe is significantly more practical for large-scale enterprise storage than previously published protocols. In particular, Niobe is simple, flexible, has rigorously proven yet simply stated consistency guarantees, and exhibits excellent performance. Niobe has been deployed as the backend for a commercial Internet service; its consistency properties have been proved formally from first principles, and further verified using the TLA + specification language. We describe the protocol itself, the system built to deploy it, and some of our experiences in doing so.
Cited by 41 works. doi:10.1145/1326542.1326543
Authors
References
- The Google file system
- The Google file system
- Web search for a planet: the google cluster architecture
- The part-time parliament
- Disconnected operation in the Coda File System
- How to Make a Multiprocessor Computer That Correctly Executes Multiprocess Programs
- Linearizability: a correctness condition for concurrent objects
- A principle for resilient sharing of distributed resources
- The serializability of concurrent database updates
- Leases: an efficient fault-tolerant mechanism for distributed file cache consistency