Three-way trade-off in multi-objective learning: Optimization, generalization and conflict-avoidance

L Chen, H Fernando, Y Ying… - Advances in Neural …, 2024 - proceedings.neurips.cc
Multi-objective learning (MOL) often arises in emerging machine learning problems when
multiple learning criteria or tasks need to be addressed. Recent works have developed …

Arithmetic control of llms for diverse user preferences: Directional preference alignment with multi-objective rewards

H Wang, Y Lin, W **ong, R Yang, S Diao, S Qiu… - arxiv preprint arxiv …, 2024 - arxiv.org
Fine-grained control over large language models (LLMs) remains a significant challenge,
hindering their adaptability to diverse user needs. While Reinforcement Learning from …

Pseudo Labeling Methods for Semi-Supervised Semantic Segmentation: A Review and Future Perspectives

L Ran, Y Li, G Liang, Y Zhang - IEEE Transactions on Circuits …, 2024 - ieeexplore.ieee.org
Semantic segmentation is a fundamental task in computer vision and finds extensive
applications in scene understanding, medical image analysis, and remote sensing. With the …

Direction-oriented multi-objective learning: Simple and provable stochastic algorithms

P **ao, H Ban, K Ji - Advances in Neural Information …, 2024 - proceedings.neurips.cc
Multi-objective optimization (MOO) has become an influential framework in many machine
learning problems with multiple objectives such as learning with multiple criteria and multi …

Multi-scenario and multi-task aware feature interaction for recommendation system

D Song, E Yang, G Guo, L Shen, L Jiang… - ACM Transactions on …, 2024 - dl.acm.org
Multi-scenario and multi-task recommendation can use various feedback behaviors of users
in different scenarios to learn users' preferences and then make recommendations, which …

Localize-and-stitch: Efficient model merging via sparse task arithmetic

Y He, Y Hu, Y Lin, T Zhang, H Zhao - arxiv preprint arxiv:2408.13656, 2024 - arxiv.org
Model merging offers an effective strategy to combine the strengths of multiple finetuned
models into a unified model that preserves the specialized capabilities of each. Existing …

A comprehensive survey on meta-learning: Applications, advances, and challenges

J Wang - Authorea Preprints, 2024 - techrxiv.org
Meta-learning, or" learning to learn", enables machines to acquire general priors with
minimal supervision and rapidly adapt to new tasks. Unlike traditional AI methods that …

LibMOON: A Gradient-based MultiObjective OptimizatioN Library in PyTorch

X Zhang, L Zhao, Y Yu, X Lin, Y Chen, H Zhao… - arxiv preprint arxiv …, 2024 - arxiv.org
Multiobjective optimization problems (MOPs) are prevalent in machine learning, with
applications in multi-task learning, learning under fairness or robustness constraints, etc …

Smooth Tchebycheff Scalarization for Multi-Objective Optimization

X Lin, X Zhang, Z Yang, F Liu, Z Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
Multi-objective optimization problems can be found in many real-world applications, where
the objectives often conflict each other and cannot be optimized by a single solution. In the …

Fair Resource Allocation in Multi-Task Learning

H Ban, K Ji - arxiv preprint arxiv:2402.15638, 2024 - arxiv.org
By jointly learning multiple tasks, multi-task learning (MTL) can leverage the shared
knowledge across tasks, resulting in improved data efficiency and generalization …