Coded Parallel Transmission for Half-Duplex Distributed Computing
Name
information-13-00342.pdf
Size
1.08 MB
Format
Adobe PDF
Checksum (MD5)
0c40b692ff8f7d802f87bec1bd99a5ce
Author(s)
Zai, Qixuan
Yuan, Kai
Wu, Youlong
Date Issued
July 15, 2022
Publisher
Multidisciplinary Digital Publishing Institute
Citation
Information 13 (7): 342 (2022)
Version
Final published version
Abstract
This work studies a general distributed coded computing system based on the MapReduce-type framework, where distributed computing nodes within a half-duplex network wish to compute multiple output functions. We first introduce a definition of communication delay to characterize the time cost during the date shuffle phase, and then propose a novel coding strategy that enables parallel transmission among the computation nodes by delicately designing the data placement, message symbols encoding, data shuffling, and decoding. Compared to the coded distributed computing (CDC) scheme proposed by Li et al., the proposed scheme significantly reduces the communication delay, in particular when the computation load is relatively smaller than the number of computing nodes K. Moreover, the communication delay of CDC is a monotonically increasing function of K, while the communication delay of our scheme decreases as K increases, indicating that the proposed scheme can make better use of the computing resources.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
Creative Commons Attribution
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.3390/info13070342
