End-to-end transformer-based models in textual-based NLP

A Rahali, MA Akhloufi - AI, 2023 - mdpi.com
Transformer architectures are highly expressive because they use self-attention
mechanisms to encode long-range dependencies in the input sequences. In this paper, we …

Breaking the bank with ChatGPT: few-shot text classification for finance

L Loukas, I Stogiannidis, P Malakasiotis… - arxiv preprint arxiv …, 2023 - arxiv.org
We propose the use of conversational GPT models for easy and quick few-shot text
classification in the financial domain using the Banking77 dataset. Our approach involves in …

Measurement extraction with natural language processing: a review

J Göpfert, P Kuckertz, J Weinand… - Findings of the …, 2022 - aclanthology.org
Quantitative data is important in many domains. Information extraction methods draw
structured data from documents. However, the extraction of quantities and their contexts has …

Incorporation of company-related factual knowledge into pre-trained language models for stock-related spam tweet filtering

J Park, S Cho - Expert Systems with Applications, 2023 - Elsevier
Natural language processing for finance has gained significant attention from both
academia and the industry as the continuously increasing amount of financial texts has …

Making llms worth every penny: Resource-limited text classification in banking

L Loukas, I Stogiannidis, O Diamantopoulos… - Proceedings of the …, 2023 - dl.acm.org
Standard Full-Data classifiers in NLP demand thousands of labeled examples, which is
impractical in data-limited domains. Few-shot methods offer an alternative, utilizing …

[PDF][PDF] Overview of the NTCIR-17 FinArg-1 Task: Fine-grained argument understanding in financial analysis

CC Chen, CY Lin, CJ Chiu, HH Huang… - Proceedings of the …, 2023 - repository.nii.ac.jp
This paper provides an overview of FinArg-1 shared tasks in NTCIR-17. We propose six
subtasks with three different resources, including company manager presentations …

Bizbench: A quantitative reasoning benchmark for business and finance

R Koncel-Kedziorski, M Krumdick, V Lai… - arxiv preprint arxiv …, 2023 - arxiv.org
As large language models (LLMs) impact a growing number of complex domains, it is
becoming increasingly important to have fair, accurate, and rigorous evaluation …

E-NER--An Annotated Named Entity Recognition Corpus of Legal Text

TWT Au, IJ Cox, V Lampos - arxiv preprint arxiv:2212.09306, 2022 - arxiv.org
Identifying named entities such as a person, location or organization, in documents can
highlight key information to readers. Training Named Entity Recognition (NER) models …

A survey of large language models in finance (finllms)

J Lee, N Stevens, SC Han, M Song - arxiv preprint arxiv:2402.02315, 2024 - arxiv.org
Large Language Models (LLMs) have shown remarkable capabilities across a wide variety
of Natural Language Processing (NLP) tasks and have attracted attention from multiple …

Exploring the numerical reasoning capabilities of language models: A comprehensive analysis on tabular data

M Akhtar, A Shankarampeta, V Gupta, A Patil… - arxiv preprint arxiv …, 2023 - arxiv.org
Numbers are crucial for various real-world domains such as finance, economics, and
science. Thus, understanding and reasoning with numbers are essential skills for language …