End-to-end transformer-based models in textual-based NLP

A Rahali, MA Akhloufi - AI, 2023 - mdpi.com
Transformer architectures are highly expressive because they use self-attention
mechanisms to encode long-range dependencies in the input sequences. In this paper, we …

Deep transformer language models for Arabic text summarization: a comparison study

H Chouikhi, M Alsuhaibani - Applied Sciences, 2022 - mdpi.com
Large text documents are sometimes challenging to understand and time-consuming to
extract vital information from. These issues are addressed by automatic text summarizing …

Do you ever get off track in a conversation? the conversational system's anatomy and evaluation metrics

S Yadav, A Kaushik - Knowledge, 2022 - mdpi.com
Conversational systems are now applicable to almost every business domain. Evaluation is
an important step in the creation of dialog systems so that they may be readily tested and …

Characterisation of COVID-19-related tweets in the Croatian language: framework based on the Cro-CoV-cseBERT model

K Babić, M Petrović, S Beliga, S Martinčić-Ipšić… - Applied Sciences, 2021 - mdpi.com
This study aims to provide insights into the COVID-19-related communication on Twitter in
the Republic of Croatia. For that purpose, we developed an NL-based framework that …

Ai-generated text detector for arabic language using encoder-based transformer architecture

H Alshammari, A El-Sayed, K Elleithy - Big Data and Cognitive Computing, 2024 - mdpi.com
The effectiveness of existing AI detectors is notably hampered when processing Arabic texts.
This study introduces a novel AI text classifier designed specifically for Arabic, tackling the …

Towards transfer learning techniques—bert, distilbert, bertimbau, and distilbertimbau for automatic text classification from different languages: A case study

R Silva Barbon, AT Akabane - Sensors, 2022 - mdpi.com
The Internet of Things is a paradigm that interconnects several smart devices through the
internet to provide ubiquitous services to users. This paradigm and Web 2.0 platforms …

[HTML][HTML] From Fact Drafts to Operational Systems: Semantic Search in Legal Decisions Using Fact Drafts

GM Csányi, D Lakatos, I Üveges, A Megyeri… - Big Data and Cognitive …, 2024 - mdpi.com
This research paper presents findings from an investigation in the semantic similarity search
task within the legal domain, using a corpus of 1172 Hungarian court decisions. The study …

[HTML][HTML] Accelerating and Compressing Transformer-Based PLMs for Enhanced Comprehension of Computer Terminology

J Peng, K Zhong - Future Internet, 2024 - mdpi.com
Pretrained language models (PLMs) have significantly advanced natural language
processing (NLP), establishing the" pretraining+ fine-tuning" paradigm as a cornerstone …

[HTML][HTML] Toward Robust Arabic AI-Generated Text Detection: Tackling Diacritics Challenges

H Alshammari, K Elleithy - Information, 2024 - mdpi.com
Current AI detection systems often struggle to distinguish between Arabic human-written text
(HWT) and AI-generated text (AIGT) due to the small marks present above and below the …

[HTML][HTML] Assessing Fine-Tuned NER Models with Limited Data in French: Automating Detection of New Technologies, Technological Domains, and Startup Names in …

C MacLean, D Cavallucci - Machine Learning and Knowledge Extraction, 2024 - mdpi.com
Achieving carbon neutrality by 2050 requires unprecedented technological, economic, and
sociological changes. With time as a scarce resource, it is crucial to base decisions on …