Improvement of RocksDB Performance via Large-Scale Parameter Analysis and Optimization

Huijun Jin, Won Gi Choi, Jonghwan Choi, Hanseung Sung, Sanghyun Park

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Database systems usually have many parameters that must be configured by database administrators and users. RocksDB achieves fast data writing performance using a log-structured merged tree. This database has many parameters associated with write and space amplifications. Write amplification degrades the database performance, and space amplification leads to an increased storage space owing to the storage of unwanted data. Previously, it was proven that significant performance improvements can be achieved by tuning the database parameters. However, tuning the multiple parameters of a database is a laborious task owing to the large number of potential configuration combinations. To address this problem, we selected the important parameters that affect the performance of RocksDB using random forest. We then analyzed the effects of the selected parameters on write and space amplifications using analysis of variance. We used a genetic algorithm to obtain optimized values of the major parameters. The experimental results indicate an insignificant reduction (-5.64%) in the execution time when using these optimized values; however, write amplification, space amplification, and data processing rates improved considerably by 20.65%, 54.50%, and 89.68%, respectively, as compared to the performance when using the default settings.

Original languageEnglish
Pages (from-to)374-388
Number of pages15
JournalJournal of Information Processing Systems
Volume18
Issue number3
DOIs
Publication statusPublished - 2022 Jun

Bibliographical note

Publisher Copyright:
© 2022. KIPS

All Science Journal Classification (ASJC) codes

  • Software
  • Information Systems

Fingerprint

Dive into the research topics of 'Improvement of RocksDB Performance via Large-Scale Parameter Analysis and Optimization'. Together they form a unique fingerprint.

Cite this