Aarhus Universitets segl

English

Du er her: AU » Om AU » Organisation » A Multi-Threaded Approach to Encoding with Random Linear ...

Om AU

A Multi-Threaded Approach to Encoding with Random Linear Network Coding

Publikation: Bidrag til bog/antologi/rapport/proceeding › Konferencebidrag i proceedings › Forskning › peer review

Links

Cloud and distributed storage applications require processing of large fragments of data. This poses memory, delay, and processing speed challenges for systems using erasure codes to reduce the cost of storage and/or increase the reliability of the system. To address these, this paper proposes and deploys designs that exploit current multi-threading capabilities of micro- processors to accelerate the encoding and decoding process of erasure codes,focusing on the case of Random Linear Network Coding (RLNC). More specifically, we propose a strategy for parallel computation based on splitting symbols into significantly smaller fragments and reordering data to speed up computation and decreasing the potential for thread blocking. We implement the strategy in C++ and carry out benchmark experiments and compare them with the single threaded state-of-the-art block RLNC encoders. We show a reduction of processing time by a factor of three by using our strategies for files of 32 MB or more as well as reducing memory usage drastically in the system. We also show that our approach provides a better scaling than the single-threaded option, when increasing the number of fragments that a file is broken into. In other words, distributed storage systems can split files or data into a larger number of fragments without experiencing a speed penalty.
OriginalsprogEngelsk
TitelEuropean Wireless 2019 Conference, EW 2019
Antal sider7
ForlagVDE Verlag GmbH
Udgivelsesår2019
Sider25-31
ISBN (trykt)978-3-8007-4948-5
ISBN (Elektronisk)9783800749492
StatusUdgivet - 2019
BegivenhedEuropean Wireless 2019 - 25th European Wireless Conference - Aarhus, Danmark
Varighed: 2 maj 2019 → 5 maj 2019
https://www.vde-verlag.de/proceedings-en/564948016.html

Konference

KonferenceEuropean Wireless 2019 - 25th European Wireless Conference
LandDanmark
ByAarhus
Periode02/05/2019 → 05/05/2019
Internetadresse

Se relationer på Aarhus Universitet Citationsformater

Projekter

ID: 151982769