An overview of multi-task learning

Y Zhang, Q Yang - National Science Review, 2018 - academic.oup.com
As a promising area in machine learning, multi-task learning (MTL) aims to improve the
performance of multiple related learning tasks by leveraging useful information among them …

Deep visual tracking: Review and experimental comparison

P Li, D Wang, L Wang, H Lu - Pattern Recognition, 2018 - Elsevier
Recently, deep learning has achieved great success in visual tracking. The goal of this
paper is to review the state-of-the-art tracking methods based on deep learning. First, we …

Gradnorm: Gradient normalization for adaptive loss balancing in deep multitask networks

Z Chen, V Badrinarayanan, CY Lee… - … on machine learning, 2018 - proceedings.mlr.press
Deep multitask networks, in which one neural network produces multiple predictive outputs,
can offer better speed and performance than their single-task counterparts but are …

A survey on multi-task learning

Y Zhang, Q Yang - IEEE transactions on knowledge and data …, 2021 - ieeexplore.ieee.org
Multi-Task Learning (MTL) is a learning paradigm in machine learning and its aim is to
leverage useful information contained in multiple related tasks to help improve the …

Deep learning enabled semantic communications with speech recognition and synthesis

Z Weng, Z Qin, X Tao, C Pan, G Liu… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
In this paper, we develop a deep learning based semantic communication system for
speech transmission, named DeepSC-ST. We take the speech recognition and speech …

Dynamic task prioritization for multitask learning

M Guo, A Haque, DA Huang… - Proceedings of the …, 2018 - openaccess.thecvf.com
We propose dynamic task prioritization for multitask learning. This allows a model to
dynamically prioritize difficult tasks during training, where difficulty is inversely proportional …

Ingredient-oriented multi-degradation learning for image restoration

J Zhang, J Huang, M Yao, Z Yang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Learning to leverage the relationship among diverse image restoration tasks is quite
beneficial for unraveling the intrinsic ingredients behind the degradation. Recent years have …

Amalgamating knowledge from heterogeneous graph neural networks

Y **g, Y Yang, X Wang, M Song… - Proceedings of the …, 2021 - openaccess.thecvf.com
In this paper, we study a novel knowledge transfer task in the domain of graph neural
networks (GNNs). We strive to train a multi-talented student GNN, without accessing human …

Merlin: An open source neural network speech synthesis system

Z Wu, O Watts, S King - 9th ISCA Speech Synthesis Workshop, 2016 - research.ed.ac.uk
We introduce the Merlin speech synthesis toolkit for neural network-based speech synthesis.
The system takes linguistic features as input, and employs neural networks to predict …

A brief review on multi-task learning

KH Thung, CY Wee - Multimedia Tools and Applications, 2018 - Springer
Abstract Multi-task learning (MTL), which optimizes multiple related learning tasks at the
same time, has been widely used in various applications, including natural language …