Wang, F, Zhang, W, Guo, H et al. (3 more authors) (2021) Automatic Translation of Data Parallel Programs for Heterogeneous Parallelism Through OpenMP Offloading. The Journal of Supercomputing, 77 (5). pp. 4957-4987. ISSN 0920-8542
Abstract
Heterogeneous multicores like GPGPUs are now commonplace in modern computing systems. Although heterogeneous multicores offer the potential for high performance, programmers are struggling to program such systems. This paper presents OAO, a compiler-based approach to automatically translate shared-memory OpenMP data-parallel programs to run on heterogeneous multicores through OpenMP offloading directives. Given the large user base of shared memory OpenMP programs, our approach allows programmers to continue using a single-source-based programming language that they are familiar with while benefiting from the heterogeneous performance. OAO introduces a novel runtime optimization scheme to automatically eliminate unnecessary host–device communication to minimize the communication overhead between the host and the accelerator device. We evaluate OAO by applying it to 23 benchmarks from the PolyBench and Rodinia suites on two distinct GPU platforms. Experimental results show that OAO achieves up to 32×× speedup over the original OpenMP version, and can reduce the host–device communication overhead by up to 99% over the hand-translated version.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © Springer Science+Business Media, LLC, part of Springer Nature 2020. This is an author produced version of a journal article published in The Journal of Supercomputing. Uploaded in accordance with the publisher's self-archiving policy. |
Keywords: | Heterogeneous computing; Source-to-source translation; OpenMP offloading; Compilation optimization; GPUs |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Engineering & Physical Sciences (Leeds) > School of Computing (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 26 Oct 2020 14:02 |
Last Modified: | 29 Oct 2021 00:38 |
Status: | Published |
Publisher: | Springer |
Identification Number: | 10.1007/s11227-020-03452-2 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:167161 |