A faster parallel algorithm and efficient multithreaded implementations for evaluating betweenness centrality on massive datasets
Kamesh Madduri, David Ediger, Karl Jiang et al. · 2009
We present a new lock-free parallel algorithm for computing betweenness centrality of massive complex networks that achieves better spatial locality compared with previous approaches. Betweenness centrality is a key kernel in analyzing the importance of vertices (or edges) in applications ranging from social networks, to power grids, to the influence of jazz musicians, and is also incorporated into the DARPA HPCS SSCA#2, a benchmark extensively used to evaluate the performance of emerging high-performance computing architectures for graph analytics. We design an optimized implementation of betweenness centrality for the massively multithreaded Cray XMT system with the Thread-storm processor. For a small-world network of 268 million vertices and 2.147 billion edges, the 16-processor XMT system achieves a TEPS rate (an algorithmic performance count for the number of edges traversed per second) of 160 million per second, which corresponds to more than a 2× performance improvement over the previous parallel implementation. We demonstrate the applicability of our implementation to analyze massive real-world datasets by computing approximate betweenness centrality for the large IMDb movie-actor network.
Cited by 156 works. doi:10.1109/ipdps.2009.5161100
Authors
References
- Emergence of Scaling in Random Networks
- Lethality and centrality in protein networks
- A faster algorithm for betweenness centrality*
- The web of human sexual contacts
- The worldwide air transportation network: Anomalous centrality, community structure, and cities' global roles
- R-MAT: A Recursive Model for Graph Mining
- Mapping Networks of Terrorist Cells
- S12---The HPC Challenge (HPCC) benchmark suite
- CHALLENGES IN PARALLEL GRAPH PROCESSING
- The Internet Movie Database