Domain generalization: A survey

K Zhou, Z Liu, Y Qiao, T **ang… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Generalization to out-of-distribution (OOD) data is a capability natural to humans yet
challenging for machines to reproduce. This is because most learning algorithms strongly …

Volumetric emission tomography for combustion processes

SJ Grauer, K Mohri, T Yu, H Liu, W Cai - Progress in energy and …, 2023 - Elsevier
This is a comprehensive, critical, and pedagogical review of volumetric emission
tomography for combustion processes. Many flames that are of interest to scientists and …

Transformers learn shortcuts to automata

B Liu, JT Ash, S Goel, A Krishnamurthy… - arxiv preprint arxiv …, 2022 - arxiv.org
Algorithmic reasoning requires capabilities which are most naturally understood through
recurrent models of computation, like the Turing machine. However, Transformer models …

Implicit behavioral cloning

P Florence, C Lynch, A Zeng… - … on robot learning, 2022 - proceedings.mlr.press
We find that across a wide range of robot policy learning scenarios, treating supervised
policy learning with an implicit model generally performs better, on average, than commonly …

[HTML][HTML] Pre-trained models: Past, present and future

X Han, Z Zhang, N Ding, Y Gu, X Liu, Y Huo, J Qiu… - AI Open, 2021 - Elsevier
Large-scale pre-trained models (PTMs) such as BERT and GPT have recently achieved
great success and become a milestone in the field of artificial intelligence (AI). Owing to …

[PDF][PDF] Learning invariant graph representations for out-of-distribution generalization

H Li, Z Zhang, X Wang, W Zhu - Advances in Neural …, 2022 - proceedings.neurips.cc
Graph representation learning has shown effectiveness when testing and training graph
data come from the same distribution, but most existing approaches fail to generalize under …

Lift: Language-interfaced fine-tuning for non-language machine learning tasks

T Dinh, Y Zeng, R Zhang, Z Lin… - Advances in …, 2022 - proceedings.neurips.cc
Fine-tuning pretrained language models (LMs) without making any architectural changes
has become a norm for learning various language downstream tasks. However, for non …

Domain generalization with mixstyle

K Zhou, Y Yang, Y Qiao, T **ang - arxiv preprint arxiv:2104.02008, 2021 - arxiv.org
Though convolutional neural networks (CNNs) have demonstrated remarkable ability in
learning discriminative features, they often generalize poorly to unseen domains. Domain …

Self-supervised learning: Generative or contrastive

X Liu, F Zhang, Z Hou, L Mian, Z Wang… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Deep supervised learning has achieved great success in the last decade. However, its
defects of heavy dependence on manual labels and vulnerability to attacks have driven …

Combinatorial optimization and reasoning with graph neural networks

Q Cappart, D Chételat, EB Khalil, A Lodi… - Journal of Machine …, 2023 - jmlr.org
Combinatorial optimization is a well-established area in operations research and computer
science. Until recently, its methods have focused on solving problem instances in isolation …