Publications

Chenghao Lyu, Qi Fan, Philippe Guyard, Yanlei Diao (2024). A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning. In PVLDB, 17(11), 2024.

PDF Cite Code Poster DOI Tech Report

Chenghao Lyu, Qi Fan, Fei Song, Arnab Sinha, Yanlei Diao, Wei Chen, Li Ma, Yihui Feng, Yaliang Li, Kai Zeng, Jingren Zhou (2022). Fine-Grained Modeling and Optimization for Intelligent Resource Management in Big Data Processing. In PVLDB, 15(11), 2022.

PDF Cite DOI Tech Report

Fei Song, Khaled Zaouk, Chenghao Lyu, Arnab Sinha, Qi Fan, Yanlei Diao, Prashant Shenoy (2021). Spark-based Cloud Data Analytics using Multi-Objective Optimization. In ICDE, 2021.

PDF Cite Code DOI Tech Report

Khaled Zaouk, Fei Song, Chenghao Lyu, Yanlei Diao (2021). Neural-based Modeling for Performance Tuning of Spark Data Analytics. arXiv, 2021.

PDF Cite

Khaled Zaouk, Fei Song, Chenghao Lyu, Arnab Sinha, Yanlei Diao, Prashant Shenoy (2019). UDAO: A Next-Generation Unified Data Analytics Optimizer. In PVLDB 12(12), 2019.

PDF Cite DOI