Few for Many: Tchebycheff Set Scalarization for Many-Objective Optimization
Xi Lin, Yilu Liu, Xiaoyuan Zhang, Fei Liu, Zhenkun Wang, Qingfu Zhang
Abstract
Multi-objective optimization can be found in many real-world applications where some conflicting objectives can not be optimized by a single solution. Existing optimization methods often focus on finding a set of Pareto solutions with different optimal trade-offs among the objectives. However, the required number of solutions to well approximate the whole Pareto optimal set could be exponentially large with respect to the number of objectives, which makes these methods unsuitable for handling many optimization objectives. In this work, instead of finding a dense set of Pareto solutions, we propose a novel Tchebycheff set scalarization method to find a few representative solutions (e.g., 5) to cover a large number of objectives (e.g., > 100) in a collaborative and complementary manner. In this way, each objective can be well addressed by at least one solution in the small solution set. In addition, we further develop a smooth Tchebycheff set scalarization approach for efficient optimization with good theoretical guarantees. Experimental studies on different problems with many optimization objectives demonstrate the effectiveness of our proposed method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- Covering Multiple Objectives with a Small Set of Solutions Using Bayesian OptimizationNatalie Maus, Kyurae Kim, Yimeng Zeng, Haydn Thomas Jones et al.NeurIPS 2025 · 1 citation
- Few-for-Many Personalized Federated LearningPing Guo, Tiantian Zhang, Xi Lin, Xiang Li et al.CVPR 2026
- PARM: Multi-Objective Test-Time Alignment via Preference-Aware Autoregressive Reward ModelBaijiong Lin, Weisen Jiang, Yuancheng Xu, Hao Chen et al.ICML 2025
- MOS-Attack: A Scalable Multi-objective Adversarial Attack FrameworkPing Guo, Cheng Gong, Xi Lin, Fei Liu et al.CVPR 2025
- Balanced Rate-Distortion Optimization in Learned Image CompressionYichi Zhang, Zhihao Duan, Yuning Huang, Fengqing ZhuCVPR 2025
Builds on27
- Gradient Surgery for Multi-Task LearningTianhe Yu, Saurabh Kumar, Abhishek Gupta, Sergey Levine et al.NeurIPS 2020 · 2,261 citations
- Conflict-Averse Gradient Descent for Multi-task learningBo Liu, Xingchao Liu, Xiaojie Jin, Peter Stone et al.NeurIPS 2021 · 686 citations
- Which Tasks Should Be Learned Together in Multi-task Learning?Trevor Standley, Amir Zamir, Dawn Chen, Leonidas J. Guibas et al.ICML 2020 · 651 citations
- Efficiently Identifying Task Groupings for Multi-Task LearningChris Fifty, Ehsan Amid, Zhe Zhao, Tianhe Yu et al.NeurIPS 2021 · 352 citations
- GCN-RL Circuit Designer: Transferable Transistor Sizing with Graph Neural Networks and Reinforcement LearningHanrui Wang, Kuan Wang, Jiacheng Yang, Linxiao Shen et al.DAC 2020 · 326 citations
Related papers
- Smooth Tchebycheff Scalarization for Multi-Objective OptimizationXi Lin, Xiaoyuan Zhang, Zhiyuan Yang, Fei Liu et al.ICML 2024 · 48 citations
- Random Hypervolume Scalarizations for Provable Multi-Objective Black Box OptimizationQiuyi (Richard) Zhang, Daniel GolovinICML 2020 · 96 citations
- Reward Dimension Reduction for Scalable Multi-Objective Reinforcement LearningGiseung Park, Youngchul SungICLR 2025
- Many-Objective Multi-Solution TransportZiyue Li, Tian Li, Virginia Smith, Jeff A. Bilmes et al.ICLR 2025
- Tchebycheff Procedure for Multi-task Text ClassificationYuren Mao, Shuang Yun, Weiwei Liu, Bo DuACL 2020 · 13 citations
