PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 29, 2024Proceedings of the ACM on Management of Data13 citations

Structural Designs Meet Optimality: Exploring Optimized LSM-tree Structures in a Colossal Configuration Space

View Full Paper
JLJunfeng LiuFWFan WangDMDingheng Mo

Key Points

  • Moose optimizes concurrent point lookup, range lookup, and update performance by decoupling level capacity and per-level run configurations.
  • Point lookup efficiency requires an enlarged final level, while correlating size ratio with runs per level enhances update throughput.
  • Implementation of the Smoose tuning framework within RocksDB outperforms existing LSM-tree structures across diverse database workloads.

Abstract

Mainstream LSM-tree-based key-value stores face challenges in optimizing performance for point lookup, range lookup, and update operations concurrently due to their constrained configurations. They typically follow fixed patterns to specify the level capacity and the number of sorted runs per-level. This confines their designs to a restricted space, limiting opportunities for broader optimizations. To address this challenge, we consider a more flexible configuration that enables independent adjustments of the number of runs per-level, size ratio, and Bloom filter settings at each LSM-tree level. By carefully analyzing the cost of each operation based on the new design space, we unveil two critical insights for optimizing the tradeoff among the three operations. Firstly, achieving efficient point lookup requires a large last level. Secondly, there is a specific correlation between the number of runs per level and size ratio that is advantageous for overall update and range lookup performance. Based on these insights, we introduce Moose, a structure delivering an impressive overall performance for point lookup, range lookup, and update concurrently. Furthermore, we also introduce a new framework, Smoose, to navigate the design space for adapting specific workloads. We implemented Moose and Smoose on top of RocksDB and experimental results demonstrate that our proposed approach outperforms state-of-the-art LSM-tree structures across diverse workloads.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Liu et al. (2024) studied this question.

synapsesocial.com/papers/68e67e05b6db6435876071f8https://doi.org/10.1145/3654978
Ask AI
Helpful
Bookmark
Share
View Full Paper