Network coding for large scale content distribution
Christos Gkantsidis, Pablo Rodríguez · 2005
We propose a new scheme for content distribution of large files that is based on network coding. With network coding, each node of the distribution network is able to generate and transmit encoded blocks of information. The randomization introduced by the coding process eases the scheduling of block propagation, and, thus, makes the distribution more efficient. This is particularly important in large unstructured overlay networks, where the nodes need to make block forwarding decisions based on local information only. We compare network coding to other schemes that transmit unencoded information (i.e. blocks of the original file) and, also, to schemes in which only the source is allowed to generate and transmit encoded packets. We study the performance of network coding in heterogeneous networks with dynamic node arrival and departure patterns, clustered topologies, and when incentive mechanisms to discourage free-riding are in place. We demonstrate through simulations of scenarios of practical interest that the expected file download time improves by more than 20-30% with network coding compared to coding at the server only and, by more than 2-3 times compared to sending unencoded information. Moreover, we show that network coding improves the robustness of the system and is able to smoothly handle extreme situations where the server and nodes leave the system.
Cited by 1,051 works. doi:10.1109/infcom.2005.1498511
Authors
References
- Network information flow
- Free riding on Gnutella
- A case for end system multicast
- Incentives Build Robustness in Bit-Torrent
- The benefits of coding over routing in a randomized setting
- How Practical is Network Coding?
- A digital fountain approach to reliable distribution of bulk data
- Modeling and performance analysis of BitTorrent-like peer-to-peer networks
- Multiple description coding: compression meets the network
- Distributing streaming media content using cooperative networking