A Load-Balanced Deterministic Runtime for Pipeline Parallelism

Chen CHEN  Kai LU  Xiaoping WANG  Xu ZHOU  Zhendong WU  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E98-D   No.2   pp.433-436
Publication Date: 2015/02/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2014EDL8171
Type of Manuscript: LETTER
Category: Software System
Keyword: 
deterministic runtime,  pipeline parallelism,  round-robin scheduling,  load balance,  

Full Text: PDF(730.4KB)
>>Buy this Article

Summary: 
Most existing deterministic multithreading systems are costly on pipeline parallel programs due to load imbalance. In this letter, we propose a Load-Balanced Deterministic Runtime (LBDR) for pipeline parallelism. LBDR deterministically takes some tokens from non-synchronization-intensive threads to synchronization-intensive threads. Experimental results show that LBDR outperforms the state-of-the-art design by an average of 22.5%.