The LRPD test
Lawrence Rauchwerger, David Padua · Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation · 1995
Current parallelizing compilers cannot identify a significant fraction of parallelizable loops because they have complex or statically insufficiently defined access patterns. As parallelizable loops arise frequently in practice, we advocate a novel framework for their identification: speculatively execute the loop as a doall, and apply a fully parallel data dependence test to determine if it had any cross-iteration dependences; if the test fails, then the loop is re-executed serially. Since, from our experience, a significant amount of the available parallelism in Fortran programs can be exploited by loops transformed through privatization and reduction parallelization, our methods can speculatively apply these transformations and then check their validity at run-time. Another important contribution of this paper is a novel method for reduction recognition which goes beyond syntactic pattern matching; it detects at run-time if the values stored in an array participate in a reduction operation, even if they are transferred through private variables and/or are affected by statically unpredictable control flow. We present experimental results on loops from the PERFECT Benchmarks which substantiate our claim that these techniques can yield significant speedups which are often superior to those obtainable by inspector/executor methods.
Cited by 241 works. doi:10.1145/207110.207148
Authors
References
- Virtual time
- Introduction to Parallel Algorithms and Architectures: Arrays, Trees, Hypercubes
- Dependence graphs and compiler optimizations
- Optimizing supercompilers for supercomputers
- Advanced compiler optimizations for supercomputers
- Conversion of control dependence to data dependence
- The Perfect Club Benchmarks: Effective Performance Evaluation of Supercomputers
- Dependence Analysis for Supercomputing
- Supercompilers for parallel and vector computers
- Proceedings of the 2000 International Conference on Parallel Processing