Aarhus University Seal

MinervaFS: A User-Space File System for Generalised Deduplication

Research output: Contribution to book/anthology/report/proceedingArticle in proceedingsResearchpeer-review

  • Lars Nielsen
  • ,
  • Dorian Burihabwa, University of Neuchatel, Switzerland
  • Valerio Schiavoni, University of Neuchatel, Switzerland
  • Pascal Felber, University of Neuchatel, Switzerland
  • Daniel Enrique Lucani Rötter
Deduplication exploits the presence of similar data chunks to reduce storage overhead. Generalised deduplication (GD) uses transformation functions to split data into a basis (common to millions of chunks) and a deviation with respect to the basis. Doing so, it avoids computing additional hashes, comparing or differentiating
against previously stored chunks. MINERVAFS is the first FUSE-based file system for GD. We implement and evaluate it using several real-world datasets, e.g., satellite images and virtual machine images, comparing against classical deduplication approaches (ZFS, SDFS), delta compression (xdelta) or compression (Gzip). Compared to ZFS, MINERVAFS achieves up to 63.53% (average of 27.38%) saving in storage usage and a speedup of 16% in read-heavy workloads. For VM images, MINERVAFS’s data compression is on par with Gzip, while outperforming ZFS by severalfold. In contrast to ZFS’ growing RAM costs when more data is stored, MinervaFS’ RAM usage is independent from the amount of data stored, making it well suited to handle growing storage demands.
Original languageEnglish
Title of host publicationInternational Symposium on Reliable Distributed Systems (SRDS)
Publication year2021
ISBN (Electronic)978-1-6654-3819-3
Publication statusPublished - 2021
EventInternational Symposium on Reliable Distributed Systems - Chicago, United States
Duration: 23 Sept 202123 Sept 2021
Conference number: 40


ConferenceInternational Symposium on Reliable Distributed Systems
LandUnited States

See relations at Aarhus University Citationformats


ID: 218714286