Enriching contextualized language model from knowledge graph for biomedical information extraction

H Fei, Y Ren, Y Zhang, D Ji, X Liang - Briefings in bioinformatics, 2021 - academic.oup.com
Biomedical information extraction (BioIE) is an important task. The aim is to analyze
biomedical texts and extract structured information such as named entities and semantic …

Entity linking meets deep learning: Techniques and solutions

W Shen, Y Li, Y Liu, J Han, J Wang… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Entity linking (EL) is the process of linking entity mentions appearing in web text with their
corresponding entities in a knowledge base. EL plays an important role in the fields of …

LUKE: Deep contextualized entity representations with entity-aware self-attention

I Yamada, A Asai, H Shindo, H Takeda… - arxiv preprint arxiv …, 2020 - arxiv.org
Entity representations are useful in natural language tasks involving entities. In this paper,
we propose new pretrained contextualized representations of words and entities based on …

KEPLER: A unified model for knowledge embedding and pre-trained language representation

X Wang, T Gao, Z Zhu, Z Zhang, Z Liu, J Li… - Transactions of the …, 2021 - direct.mit.edu
Pre-trained language representation models (PLMs) cannot well capture factual knowledge
from text. In contrast, knowledge embedding (KE) methods can effectively represent the …

ERNIE: Enhanced language representation with informative entities

Z Zhang, X Han, Z Liu, X Jiang, M Sun, Q Liu - arxiv preprint arxiv …, 2019 - arxiv.org
Neural language representation models such as BERT pre-trained on large-scale corpora
can well capture rich semantic patterns from plain text, and be fine-tuned to consistently …

Explainable reasoning over knowledge graphs for recommendation

X Wang, D Wang, C Xu, X He, Y Cao… - Proceedings of the AAAI …, 2019 - ojs.aaai.org
Incorporating knowledge graph into recommender systems has attracted increasing
attention in recent years. By exploring the interlinks within a knowledge graph, the …

Unifying knowledge graph learning and recommendation: Towards a better understanding of user preferences

Y Cao, X Wang, X He, Z Hu, TS Chua - The world wide web conference, 2019 - dl.acm.org
Incorporating knowledge graph (KG) into recommender system is promising in improving the
recommendation accuracy and explainability. However, existing methods largely assume …

BioWordVec, improving biomedical word embeddings with subword information and MeSH

Y Zhang, Q Chen, Z Yang, H Lin, Z Lu - Scientific data, 2019 - nature.com
Distributed word representations have become an essential foundation for biomedical
natural language processing (BioNLP), text mining and information retrieval. Word …

Multi-channel graph neural network for entity alignment

Y Cao, Z Liu, C Li, J Li, TS Chua - arxiv preprint arxiv:1908.09898, 2019 - arxiv.org
Entity alignment typically suffers from the issues of structural heterogeneity and limited seed
alignments. In this paper, we propose a novel Multi-channel Graph Neural Network model …

From word to sense embeddings: A survey on vector representations of meaning

J Camacho-Collados, MT Pilehvar - Journal of Artificial Intelligence …, 2018 - jair.org
Over the past years, distributed semantic representations have proved to be effective and
flexible keepers of prior knowledge to be integrated into downstream applications. This …