Boosting CUDA applications with CPU-GPU hybrid computing

Changmin Lee; Won Woo Ro; Jean Luc Gaudiot

doi:10.1007/s10766-013-0252-y

Boosting CUDA applications with CPU-GPU hybrid computing

Changmin Lee, Won Woo Ro, Jean Luc Gaudiot

Department of Electrical and Electronic Engineering

Research output: Contribution to journal › Article › peer-review

31 Citations (Scopus)

Abstract

This paper presents a cooperative heterogeneous computing framework which enables the efficient utilization of available computing resources of host CPU cores for CUDA kernels, which are designed to run only on GPU. The proposed system exploits at runtime the coarse-grain thread-level parallelism across CPU and GPU, without any source recompilation. To this end, three features including a work distribution module, a transparent memory space, and a global scheduling queue are described in this paper. With a completely automatic runtime workload distribution, the proposed framework achieves speedups of 3.08× in the best case and 1.42× on average compared to the baseline GPU-only processing.

Original language	English
Pages (from-to)	384-404
Number of pages	21
Journal	International Journal of Parallel Programming
Volume	42
Issue number	2
DOIs	https://doi.org/10.1007/s10766-013-0252-y
Publication status	Published - 2014 Apr

Bibliographical note

Funding Information:
Acknowledgments We thank all of the anonymous reviewers for their comments. This work was supported by the Basic Science Research Program through the National Research Foundation (NRF) of Korea, which is funded by the Ministry of Education, Science and Technology [2009-0070364]. This work is also supported in part by the US National Science Foundation under Grant No. CCF-1065448. Any opinions, findings, and conclusions as well as recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.

All Science Journal Classification (ASJC) codes

Software
Theoretical Computer Science
Information Systems

Access to Document

10.1007/s10766-013-0252-y

Cite this

@article{a6d487afcdd24d45ad35afe30035cf8d,

title = "Boosting CUDA applications with CPU-GPU hybrid computing",

abstract = "This paper presents a cooperative heterogeneous computing framework which enables the efficient utilization of available computing resources of host CPU cores for CUDA kernels, which are designed to run only on GPU. The proposed system exploits at runtime the coarse-grain thread-level parallelism across CPU and GPU, without any source recompilation. To this end, three features including a work distribution module, a transparent memory space, and a global scheduling queue are described in this paper. With a completely automatic runtime workload distribution, the proposed framework achieves speedups of 3.08× in the best case and 1.42× on average compared to the baseline GPU-only processing.",

keywords = "CUDA, GPGPU, Heterogeneous computing, Parallel processing",

author = "Changmin Lee and Ro, {Won Woo} and Gaudiot, {Jean Luc}",

note = "Funding Information: Acknowledgments We thank all of the anonymous reviewers for their comments. This work was supported by the Basic Science Research Program through the National Research Foundation (NRF) of Korea, which is funded by the Ministry of Education, Science and Technology [2009-0070364]. This work is also supported in part by the US National Science Foundation under Grant No. CCF-1065448. Any opinions, findings, and conclusions as well as recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.",

year = "2014",

month = apr,

doi = "10.1007/s10766-013-0252-y",

language = "English",

volume = "42",

pages = "384--404",

journal = "International Journal of Parallel Programming",

issn = "0885-7458",

publisher = "Springer New York",

number = "2",

}

TY - JOUR

T1 - Boosting CUDA applications with CPU-GPU hybrid computing

AU - Lee, Changmin

AU - Ro, Won Woo

AU - Gaudiot, Jean Luc

N1 - Funding Information: Acknowledgments We thank all of the anonymous reviewers for their comments. This work was supported by the Basic Science Research Program through the National Research Foundation (NRF) of Korea, which is funded by the Ministry of Education, Science and Technology [2009-0070364]. This work is also supported in part by the US National Science Foundation under Grant No. CCF-1065448. Any opinions, findings, and conclusions as well as recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.

PY - 2014/4

Y1 - 2014/4

N2 - This paper presents a cooperative heterogeneous computing framework which enables the efficient utilization of available computing resources of host CPU cores for CUDA kernels, which are designed to run only on GPU. The proposed system exploits at runtime the coarse-grain thread-level parallelism across CPU and GPU, without any source recompilation. To this end, three features including a work distribution module, a transparent memory space, and a global scheduling queue are described in this paper. With a completely automatic runtime workload distribution, the proposed framework achieves speedups of 3.08× in the best case and 1.42× on average compared to the baseline GPU-only processing.

AB - This paper presents a cooperative heterogeneous computing framework which enables the efficient utilization of available computing resources of host CPU cores for CUDA kernels, which are designed to run only on GPU. The proposed system exploits at runtime the coarse-grain thread-level parallelism across CPU and GPU, without any source recompilation. To this end, three features including a work distribution module, a transparent memory space, and a global scheduling queue are described in this paper. With a completely automatic runtime workload distribution, the proposed framework achieves speedups of 3.08× in the best case and 1.42× on average compared to the baseline GPU-only processing.

KW - CUDA

KW - GPGPU

KW - Heterogeneous computing

KW - Parallel processing

UR - http://www.scopus.com/inward/record.url?scp=84899462103&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84899462103&partnerID=8YFLogxK

U2 - 10.1007/s10766-013-0252-y

DO - 10.1007/s10766-013-0252-y

M3 - Article

AN - SCOPUS:84899462103

SN - 0885-7458

VL - 42

SP - 384

EP - 404

JO - International Journal of Parallel Programming

JF - International Journal of Parallel Programming

IS - 2

ER -

Boosting CUDA applications with CPU-GPU hybrid computing

Abstract

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this