Multimodal masked autoencoders learn transferable representations

X Geng, H Liu, L Lee, D Schuurmans, S Levine… - arxiv preprint arxiv …, 2022 - arxiv.org
Building scalable models to learn from diverse, multimodal data remains an open challenge.
For vision-language data, the dominant approaches are based on contrastive learning …

Choosing transfer languages for cross-lingual learning

YH Lin, CY Chen, J Lee, Z Li, Y Zhang, M **a… - arxiv preprint arxiv …, 2019 - arxiv.org
Cross-lingual transfer, where a high-resource transfer language is used to improve the
accuracy of a low-resource task language, is now an invaluable tool for improving …

Codon optimization with deep learning to enhance protein expression

H Fu, Y Liang, X Zhong, ZL Pan, L Huang, HL Zhang… - Scientific reports, 2020 - nature.com
Heterologous expression is the main approach for recombinant protein production ingenetic
synthesis, for which codon optimization is necessary. The existing optimization methods are …

An encoding strategy based word-character LSTM for Chinese NER

W Liu, T Xu, Q Xu, J Song, Y Zu - … of the 2019 Conference of the …, 2019 - aclanthology.org
A recently proposed lattice model has demonstrated that words in character sequence can
provide rich word boundary information for character-based Chinese NER model. In this …

Hierarchical contextualized representation for named entity recognition

Y Luo, F **ao, H Zhao - Proceedings of the AAAI conference on artificial …, 2020 - ojs.aaai.org
Named entity recognition (NER) models are typically based on the architecture of Bi-
directional LSTM (BiLSTM). The constraints of sequential nature and the modeling of single …

A neural multi-digraph model for Chinese NER with gazetteers

R Ding, P **e, X Zhang, W Lu, L Li… - Proceedings of the 57th …, 2019 - aclanthology.org
Gazetteers were shown to be useful resources for named entity recognition (NER). Many
existing approaches to incorporating gazetteers into machine learning based NER systems …

Multimodal representation with embedded visual guiding objects for named entity recognition in social media posts

Z Wu, C Zheng, Y Cai, J Chen, H Leung… - Proceedings of the 28th …, 2020 - dl.acm.org
Visual contexts often help to recognize named entities more precisely in short texts such as
tweets or snapchat. For example, one can identify" Charlie''as a name of a dog according to …

DREEAM: Guiding attention with evidence for improving document-level relation extraction

Y Ma, A Wang, N Okazaki - arxiv preprint arxiv:2302.08675, 2023 - arxiv.org
Document-level relation extraction (DocRE) is the task of identifying all relations between
each entity pair in a document. Evidence, defined as sentences containing clues for the …

UER: An open-source toolkit for pre-training models

Z Zhao, H Chen, J Zhang, X Zhao, T Liu, W Lu… - arxiv preprint arxiv …, 2019 - arxiv.org
Existing works, including ELMO and BERT, have revealed the importance of pre-training for
NLP tasks. While there does not exist a single pre-training model that works best in all …

Sentiment correlation in financial news networks and associated market movements

X Wan, J Yang, S Marinov, JP Calliess, S Zohren… - Scientific reports, 2021 - nature.com
In an increasingly connected global market, news sentiment towards one company may not
only indicate its own market performance, but can also be associated with a broader …