Improving GPU Performance Prediction with Data Transfer Modeling
Michael Boyer, Jiayuan Meng, Kalyan Kumaran · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · 2013
Accelerators such as graphics processors (GPUs) have become increasingly popular for high performance scientific computing. Often, much effort is invested in creating and optimizing GPU code without any guaranteed performance benefit. To reduce this risk, performance models can be used to project a kernel's GPU performance potential before it is ported. However, raw GPU execution time is not the only consideration. The overhead of transferring data between the CPU and the GPU is also an important factor; for some applications, this overhead may even erase the performance benefits of GPU acceleration. To address this challenge, we propose a GPU performance modeling framework that predicts both kernel execution time and data transfer time. Our extensions to an existing GPU performance model include a data usage analyzer for a sequence of GPU kernels, to determine the amount of data that needs to be transferred, and a performance model of the PCIe bus, to determine how long the data transfer will take. We have tested our framework using a set of applications running on a production machine at Argonne National Laboratory. On average, our model predicts the data transfer overhead with an error of only 8%, and the inclusion of data transfer time reduces the error in the predicted GPU speedup from 255% to 9%.
Cited by 58 works. doi:10.1109/ipdpsw.2013.236
Authors
References
- Rodinia: A benchmark suite for heterogeneous computing
- Debunking the 100X GPU vs. CPU myth
- An analytical model for a GPU architecture with memory-level and thread-level parallelism awareness
- Quantum Monte Carlo Calculations of A ≤ 6 Nuclei
- Modern potentials and the properties of condensed He4
- Accurate and efficient regression modeling for microarchitectural performance and power prediction
- An implementation of interprocedural bounded regular section analysis
- An adaptive performance modeling tool for GPU architectures
- Quantum Monte Carlo calculations of A = 9 , 10 nuclei
- 1 A Framework for Performance Modeling and Prediction