Multimodal masked autoencoders learn transferable representations
Building scalable models to learn from diverse, multimodal data remains an open challenge.
For vision-language data, the dominant approaches are based on contrastive learning …
For vision-language data, the dominant approaches are based on contrastive learning …
Choosing transfer languages for cross-lingual learning
Cross-lingual transfer, where a high-resource transfer language is used to improve the
accuracy of a low-resource task language, is now an invaluable tool for improving …
accuracy of a low-resource task language, is now an invaluable tool for improving …
Codon optimization with deep learning to enhance protein expression
H Fu, Y Liang, X Zhong, ZL Pan, L Huang, HL Zhang… - Scientific reports, 2020 - nature.com
Heterologous expression is the main approach for recombinant protein production ingenetic
synthesis, for which codon optimization is necessary. The existing optimization methods are …
synthesis, for which codon optimization is necessary. The existing optimization methods are …
An encoding strategy based word-character LSTM for Chinese NER
A recently proposed lattice model has demonstrated that words in character sequence can
provide rich word boundary information for character-based Chinese NER model. In this …
provide rich word boundary information for character-based Chinese NER model. In this …
Hierarchical contextualized representation for named entity recognition
Named entity recognition (NER) models are typically based on the architecture of Bi-
directional LSTM (BiLSTM). The constraints of sequential nature and the modeling of single …
directional LSTM (BiLSTM). The constraints of sequential nature and the modeling of single …
A neural multi-digraph model for Chinese NER with gazetteers
Gazetteers were shown to be useful resources for named entity recognition (NER). Many
existing approaches to incorporating gazetteers into machine learning based NER systems …
existing approaches to incorporating gazetteers into machine learning based NER systems …
Multimodal representation with embedded visual guiding objects for named entity recognition in social media posts
Visual contexts often help to recognize named entities more precisely in short texts such as
tweets or snapchat. For example, one can identify" Charlie''as a name of a dog according to …
tweets or snapchat. For example, one can identify" Charlie''as a name of a dog according to …
DREEAM: Guiding attention with evidence for improving document-level relation extraction
Document-level relation extraction (DocRE) is the task of identifying all relations between
each entity pair in a document. Evidence, defined as sentences containing clues for the …
each entity pair in a document. Evidence, defined as sentences containing clues for the …
UER: An open-source toolkit for pre-training models
Existing works, including ELMO and BERT, have revealed the importance of pre-training for
NLP tasks. While there does not exist a single pre-training model that works best in all …
NLP tasks. While there does not exist a single pre-training model that works best in all …
Sentiment correlation in financial news networks and associated market movements
In an increasingly connected global market, news sentiment towards one company may not
only indicate its own market performance, but can also be associated with a broader …
only indicate its own market performance, but can also be associated with a broader …