Thread fork/join techniques for multi-level parallelism exploitation in NUMA multiprocessors
Xavier Martorell, Eduard Ayguadé, Nacho Navarro et al. · International Conference on Supercomputing · 1999
This paper presents some techniques for efficient thread forking and joining in parallel execution environments, taking into consideration the physical structure of NUMA machines and the support for multi-level parallelization and processor grouping.Two work generation schemes and one join mechanism are designed, implemented, evaluated and compared with the ones used in the IFUX MP library, an efficient implementation which supports a single level of parallelism.Supporting multiple levels of parallelism is a current research goal, both in shared and distributed memory machines.Our proposals include a first work generation scheme (GWD, or global work descriptor) which supports multiple levels of parallelism, but not processor grouping.The second work generation scheme (LWD, or local work descriptor) has been designed to support multiple levels of parallelism and processor grouping.Processor grouping is needed to distribute processors among different parts of the computation and maintain the working set of each processor across different parallel constructs.The mechanisms are evaluated using synthetic benchmarks, two SPEC95fp applications and one NAS application.The performance evaluation concludes that: i) the overhead of the proposed mechanisms is similar to the overhead of the existing ones when exploiting a single level of parallelism, and ii) a remarkable improvement in performance is obtained for applications that have multiple levels of parallelism.The comparison with the traditional single-level parallelism exploitation gives an improvement in the range of 3065% for these applications.
Cited by 66 works. doi:10.1145/305138.305206 Open-access PDF
Authors
References
- The SGI Origin
- Maximizing multiprocessor performance with the SUIF compiler
- PARAFRASE-2: AN ENVIRONMENT FOR PARALLELIZING, PARTITIONING, SYNCHRONIZING, AND SCHEDULING PROGRAMS ON MULTIPROCESSORS
- Starfire: extending the SMP envelope
- Task Parallelism in a High Performance Fortran Framework
- A library implementation of the nano-threads programming model
- Parallelization of NAS benchmarks for shared memory multiprocessors
- Double standards
- Simultaneous exploitation of task and data parallelism in regular scientific applications
- Exploiting parallelism through directives on the nano-threads programming model