BDU IR

Minimizing Communication Overhead in Distributed Memory Automatic Parallelization

Show simple item record

dc.contributor.author Tibebu, Eneyew Shebeshe
dc.date.accessioned 2021-08-16T12:07:00Z
dc.date.available 2021-08-16T12:07:00Z
dc.date.issued 2021-01
dc.identifier.uri http://ir.bdu.edu.et/handle/123456789/12441
dc.description.abstract The importance of distributed memory auto-parallelization in utilizing high performance computers is enormous. However, past works on distributed memory auto-parallelization have excessive communication overhead problem, which degrades performance of the parallelized program. The problem with communication overhead is due to unnecessary, large volume and frequent data communications among processors. This paper presents a new communication model that addresses the problem with communication overhead. The communication model uses a combination of techniques to minimize the communication overhead. In particular, we designed a data dependency, data-flow and symbolic range based technique to precisely determine set of communication data. We implemented a prototype of the proposed communication model in a popular parallelization compiler infrastructure called Cetus. We evaluated the prototype against a state-of-the-art work using a set of PolyBenchs on a 5-node Raspberry-pi cluster. The experiments are organized into three groups that aim to evaluate communication overhead, correlation between communication overhead and problem size, and accuracy. The results show that the proposed communication model reduces communication overhead by an average of 48% when compared to the state-of-the-art approach with an accuracy of 100%. Analysis of the correlation between communication overhead and problem size indicates that the communication overhead in the proposed communication model has strong negative correlation with the problem size compared to the state-of-the-art approach. In general, from the experiment results, it can be concluded that the proposed communication model mitigates the communication overhead problem in distributed memory auto-parallelization. en_US
dc.language.iso en_US en_US
dc.subject ELECTRICAL AND COMPUTER ENGINEERING en_US
dc.title Minimizing Communication Overhead in Distributed Memory Automatic Parallelization en_US
dc.type Thesis en_US


Files in this item

This item appears in the following Collection(s)

Show simple item record