Traffic management
Mohammad Dashti, Alexandra Fedorova, Justin Funston et al. · ACM SIGARCH Computer Architecture News · 2013
NUMA systems are characterized by Non-Uniform Memory Access times, where accessing data in a remote node takes longer than a local access. NUMA hardware has been built since the late 80's, and the operating systems designed for it were optimized for access locality. They co-located memory pages with the threads that accessed them, so as to avoid the cost of remote accesses. Contrary to older systems, modern NUMA hardware has much smaller remote wire delays, and so remote access costs per se are not the main concern for performance, as we discovered in this work. Instead, congestion on memory controllers and interconnects , caused by memory traffic from data-intensive applications, hurts performance a lot more. Because of that, memory placement algorithms must be redesigned to target traffic congestion. This requires an arsenal of techniques that go beyond optimizing locality. In this paper we describe Carrefour , an algorithm that addresses this goal. We implemented Carrefour in Linux and obtained performance improvements of up to 3.6 relative to the default kernel, as well as significant improvements compared to NUMA-aware patchsets available for Linux. Carrefour never hurts performance by more than 4% when memory placement cannot be improved. We present the design of Carrefour , the challenges of implementing it on modern hardware, and draw insights about hardware support that would help optimize system software on future NUMA systems.
Cited by 16 works. doi:10.1145/2490301.2451157
Authors
- Mohammad Dashti
- Alexandra Fedorova
- Justin Funston
- Fabien Gaud
- Renaud Lachaize
- Baptiste Lepers
- Vivien Quéma
References
- Operating system support for improving data locality on CC-NUMA compute servers
- The multikernel
- Clearing the clouds
- Simple but effective techniques for NUMA memory management
- Thread clustering
- Addressing shared resource contention in multicore processors via scheduling
- Memory system performance in a NUMA multicore multiprocessor
- Tornado: maximizing locality and concurrency in a shared memory multiprocessor operating system
- Data-oriented transaction execution
- Using OS Observations to Improve Performance in Multicore Systems