Program Optimization Study on a 128-Core GPU
Shane Ryoo, Christopher I. Rodrigues, Sam S. Stone et al. · 2011
Abstract — The newest generations of graphics processing unit (GPU) architecture, such as the NVIDIA GeForce 8-series, feature new interfaces that improve programmability and generality over previous GPU generations. Using NVIDIA’s Compute Unified Device Architecture (CUDA), the GPU is presented to developers as a flexible parallel architecture. This flexibility introduces the opportunity to perform a wide variety of parallelization optimizations on applications, but it can be difficult to choose and control optimizations to give reliable performance benefit. This work presents a study that examines a broad space of optimization combinations performed on several applications ported to the GeForce 8800 GTX. By doing an exhaustive search of the optimization space, we find configurations that are up to 74 % faster than those previously thought optimal. We explain the effects that optimizations can have on this architecture and how they differ from those on more traditional processors. For some optimizations, small changes in resource usage per thread can have very significant performance ramifications due to the thread assignment granularity of the platform and the lack of control over scheduling and allocation behavior of the runtime. We conclude with suggestions for better controlling resource usage and performance on this platform. I.
Cited by 37 works.
Authors
References
- The cache performance and optimizations of blocked algorithms
- Accelerator
- Optimizing Compilers for Modern Architectures: A Dependence-based Approach
- Memory---A memory model for scientific algorithms on graphics processors
- NVIDIA cuda software and gpu parallel computing architecture
- Accelerating popular tomographic reconstruction algorithms on commodity PC graphics hardware
- Data and Computation Transformations for Brook Streaming Applications on Multiprocessors
- Non-Cartesian MRI scan time reduction through sparse sampling