Facilitating database tuning with hyper-parameter optimization
Xinyi Zhang, Zhuo Chang, Yang Li et al. · Proceedings of the VLDB Endowment · 2022
Recently, using automatic configuration tuning to improve the performance of modern database management systems (DBMSs) has attracted increasing interest from the database community. This is embodied with a number of systems featuring advanced tuning capabilities being developed. However, it remains a challenge to select the best solution for database configuration tuning, considering the large body of algorithm choices. In addition, beyond the applications on database systems, we could find more potential algorithms designed for configuration tuning. To this end, this paper provides a comprehensive evaluation of configuration tuning techniques from a broader perspective, hoping to better benefit the database community. In particular, we summarize three key modules of database configuration tuning systems and conduct extensive ablation studies using various challenging cases. Our evaluation demonstrates that the hyper-parameter optimization algorithms can be borrowed to further enhance the database configuration tuning. Moreover, we identify the best algorithm choices for different modules. Beyond the comprehensive evaluations, we offer an efficient and unified database configuration tuning benchmark via surrogates that reduces the evaluation cost to a minimum, allowing for extensive runs and analysis of new techniques.
Cited by 65 works. doi:10.14778/3538598.3538604
Authors
References
- Random Forests
- Regression Shrinkage and Selection Via the Lasso
- Least angle regression
- Scikit-learn: Machine Learning in Python
- Auto-WEKA
- Applied Regression Analysis
- Taking the Human Out of the Loop: A Review of Bayesian Optimization
- Random Forest: A Classification and Regression Tool for Compound Classification and QSAR Modeling
- Explaining prediction models and individual predictions with feature contributions
- GAUSSIAN PROCESSES FOR MACHINE LEARNING