The persistent challenge of data locality in the post-exascale era

Abstract

The era of exascale computing, exemplified by systems like Frontier, achieving exaflop-level performance marks a milestone. However, the quest for sheer compute power leads to strong imbalance in system design. Hence, scaling advancements in memory, network bandwidth, and storage are also necessary and poses challenges, with a crucial need to address data locality issues. This paper underscores the fundamental importance of data locality as a key abstraction for optimizing application performance. Despite notable software solutions, the growing complexity of parallelism and memory hierarchy demands performance portable data locality solutions across diverse computing platforms. The manuscript revisits data locality aspects, covering hardware considerations, application perspectives, software stack abstractions and tool support. It concludes with insights into data locality challenges and opportunities, emphasizing the ongoing significance of collaborative research for progress in this critical issue.