End-to-end transformer-based models in textual-based NLP

A Rahali, MA Akhloufi - Ai, 2023 - mdpi.com
Transformer architectures are highly expressive because they use self-attention
mechanisms to encode long-range dependencies in the input sequences. In this paper, we …

[HTML][HTML] Comparative study of multiclass text classification in research proposals using pretrained language models

E Lee, C Lee, S Ahn - Applied Sciences, 2022 - mdpi.com
Recently, transformer-based pretrained language models have demonstrated stellar
performance in natural language understanding (NLU) tasks. For example, bidirectional …

[HTML][HTML] A Hybrid Deep Learning Emotion Classification System Using Multimodal Data

DH Kim, WH Son, SS Kwak, TH Yun, JH Park, JD Lee - Sensors, 2023 - mdpi.com
This paper proposes a hybrid deep learning emotion classification system (HDECS), a
hybrid multimodal deep learning system designed for emotion classification in a specific …

K-EPIC: Entity-perceived context representation in Korean relation extraction

Y Hur, S Son, M Shim, J Lim, H Lim - Applied Sciences, 2021 - mdpi.com
Relation Extraction (RE) aims to predict the correct relation between two entities from the
given sentence. To obtain the proper relation in Relation Extraction (RE), it is significant to …

ViGLUE: a Vietnamese general language understanding benchmark and analysis of Vietnamese language models

MN Tran, PV Nguyen, L Nguyen… - Findings of the …, 2024 - aclanthology.org
As the number of language models has increased, various benchmarks have been
suggested to assess the proficiency of the models in natural language understanding …

[HTML][HTML] Experimental Study of Morphological Analyzers for Topic Categorization in News Articles

S Ahn - Applied Sciences, 2023 - mdpi.com
Natural language processing refers to the ability of computers to understand text and spoken
words similar to humans. Recently, various machine learning techniques have been used to …

[HTML][HTML] Intent classification and slot filling model for in-vehicle services in Korean

J Lim, S Son, S Lee, C Chun, S Park, Y Hur, H Lim - Applied Sciences, 2022 - mdpi.com
Since understanding a user's request has become a critical task for the artificial intelligence
speakers, capturing intents and finding correct slots along with corresponding slot value is …

Development of a Site Information Classification Model and a Similar-Site Accident Retrieval Model for Construction Using the KLUE-BERT Model

SH Shin, JH Won, HJ Jeong, MG Kang - Buildings, 2024 - mdpi.com
Before starting any construction work, providing workers with awareness about past similar
accident cases is effective in preventing mishaps. Based on construction accident reports …

Automated Think-Aloud Protocol for Identifying Students with Reading Comprehension Impairment Using Sentence Embedding

Y Yoo - Applied Sciences, 2024 - mdpi.com
The think-aloud protocol is a valuable tool for investigating readers' cognitive processes
during reading. However, its reliance on experienced human evaluators poses challenges …

Automated Assessment of Inferences Using Pre-Trained Language Models

Y Yoo - Applied Sciences, 2024 - mdpi.com
Inference plays a key role in reading comprehension. However, assessing inference in
reading is a complex process that relies on the judgment of trained experts. In this study, we …