On the opportunities and risks of foundation models

R Bommasani, DA Hudson, E Adeli, R Altman… - arxiv preprint arxiv …, 2021‏ - arxiv.org
AI is undergoing a paradigm shift with the rise of models (eg, BERT, DALL-E, GPT-3) that are
trained on broad data at scale and are adaptable to a wide range of downstream tasks. We …

Transfer learning for sentiment analysis using BERT based supervised fine-tuning

NJ Prottasha, AA Sami, M Kowsher, SA Murad… - Sensors, 2022‏ - mdpi.com
The growth of the Internet has expanded the amount of data expressed by users across
multiple platforms. The availability of these different worldviews and individuals' emotions …

A primer in BERTology: What we know about how BERT works

A Rogers, O Kovaleva, A Rumshisky - Transactions of the association …, 2021‏ - direct.mit.edu
Transformer-based models have pushed state of the art in many areas of NLP, but our
understanding of what is behind their success is still limited. This paper is the first survey of …

IndicNLPSuite: Monolingual corpora, evaluation benchmarks and pre-trained multilingual language models for Indian languages

D Kakwani, A Kunchukuttan, S Golla… - Findings of the …, 2020‏ - aclanthology.org
In this paper, we introduce NLP resources for 11 major Indian languages from two major
language families. These resources include:(a) large-scale sentence-level monolingual …

SimAlign: High quality word alignments without parallel training data using static and contextualized embeddings

MJ Sabet, P Dufter, F Yvon, H Schütze - arxiv preprint arxiv:2004.08728, 2020‏ - arxiv.org
Word alignments are useful for tasks like statistical and neural machine translation (NMT)
and cross-lingual annotation projection. Statistical word aligners perform well, as do …

Bangla-bert: transformer-based efficient model for transfer learning and language understanding

M Kowsher, AA Sami, NJ Prottasha, MS Arefin… - IEEE …, 2022‏ - ieeexplore.ieee.org
The advent of pre-trained language models has directed a new era of Natural Language
Processing (NLP), enabling us to create powerful language models. Among these models …

Reliability of electric vehicle charging infrastructure: A cross-lingual deep learning approach

Y Liu, A Francis, C Hollauer, MC Lawson… - Communications in …, 2023‏ - Elsevier
Vehicle electrification has emerged as a global strategy to address climate change and
emissions externalities from the transportation sector. Deployment of charging infrastructure …

Abusive Bangla comments detection on Facebook using transformer-based deep learning models

TT Aurpa, R Sadik, MS Ahmed - Social Network Analysis and Mining, 2022‏ - Springer
In the era of social networking platforms, user-generated content is flooding every second on
online social media platforms like Facebook. So observing and identifying many contents …

Lost in translation: large language models in non-English content analysis

G Nicholas, A Bhatia - arxiv preprint arxiv:2306.07377, 2023‏ - arxiv.org
In recent years, large language models (eg, Open AI's GPT-4, Meta's LLaMa, Google's
PaLM) have become the dominant approach for building AI systems to analyze and …

Semantic relation extraction: a review of approaches, datasets, and evaluation methods with looking at the methods and datasets in the Persian language

H Gharagozlou, J Mohammadzadeh… - ACM Transactions on …, 2023‏ - dl.acm.org
A large volume of unstructured data, especially text data, is generated and exchanged daily.
Consequently, the importance of extracting patterns and discovering knowledge from textual …