Efficient compilation of fine-grained SPMD-threaded programs for multicore CPUs
John A. Stratton, Vinod Grover, Jaydeep Marathe et al. · IEEE/ACM International Symposium on Code Generation and Optimization (CGO) · 2010
In this paper we describe techniques for compiling fine-grained SPMD-threaded programs, expressed in programming models such as OpenCL or CUDA, to multicore execution platforms. Programs developed for manycore processors typically express finer thread-level parallelism than is appropriate for multicore platforms. We describe options for implementing fine-grained threading in software, and find that reasonable restrictions on the synchronization model enable significant optimizations and performance improvements over a baseline approach. We evaluate these techniques in a production-level compiler and runtime for the CUDA programming model targeting modern CPUs. Applications tested with our tool often showed performance parity with the compiled C version of the application for single-thread performance. With modest coarse-grained multithreading typical of today's CPU architectures, an average of 3.4x speedup on 4 processors was observed across the test applications.
Cited by 82 works. doi:10.1145/1772954.1772971
Authors
References
- A Bridging Model for Parallel Computation
- Scalable parallel programming with CUDA
- Scalable Parallel Programming with CUDA
- Accelerating molecular modeling applications with graphics processors
- High performance Fortran language specification
- Optimization principles and application performance evaluation of a multithreaded GPU using CUDA
- Dataflow analysis of array and scalar references
- Fast support vector machine training and classification on graphics processors
- Modeling the global Internet
- High-throughput sequence alignment using Graphics Processing Units