[HTML][HTML] A survey of GPT-3 family large language models including ChatGPT and GPT-4

KS Kalyan - Natural Language Processing Journal, 2024 - Elsevier
Large language models (LLMs) are a special class of pretrained language models (PLMs)
obtained by scaling model size, pretraining corpus and computation. LLMs, because of their …

How much are llms contaminated? a comprehensive survey and the llmsanitize library

M Ravaut, B Ding, F Jiao, H Chen, X Li, R Zhao… - arxiv preprint arxiv …, 2024 - arxiv.org
With the rise of Large Language Models (LLMs) in recent years, new opportunities are
emerging, but also new challenges, and contamination is quickly becoming critical …

Financial report chunking for effective retrieval augmented generation

AJ Yepes, Y You, J Milczek, S Laverde, R Li - arxiv preprint arxiv …, 2024 - arxiv.org
Chunking information is a key step in Retrieval Augmented Generation (RAG). Current
research primarily centers on paragraph-level chunking. This approach treats all texts as …

Summary of a haystack: A challenge to long-context llms and rag systems

P Laban, AR Fabbri, C **ong, CS Wu - arxiv preprint arxiv:2407.01370, 2024 - arxiv.org
LLMs and RAG systems are now capable of handling millions of input tokens or more.
However, evaluating the output quality of such systems on long-context tasks remains …

Chain-of-knowledge: Grounding large language models via dynamic knowledge adapting over heterogeneous sources

X Li, R Zhao, YK Chia, B Ding, S Joty, S Poria… - arxiv preprint arxiv …, 2023 - arxiv.org
We present chain-of-knowledge (CoK), a novel framework that augments large language
models (LLMs) by dynamically incorporating grounding information from heterogeneous …

Open models, closed minds? on agents capabilities in mimicking human personalities through open large language models

L La Cava, A Tagarelli - arxiv preprint arxiv:2401.07115, 2024 - arxiv.org
The emergence of unveiling human-like behaviors in Large Language Models (LLMs) has
led to a closer connection between NLP and human psychology. Scholars have been …

Natural language processing in the era of large language models

A Zubiaga - Frontiers in Artificial Intelligence, 2024 - frontiersin.org
Since their inception in the 1980s, language models (LMs) have been around for more than
four decades as a means for statistically modeling the properties observed from natural …

[HTML][HTML] Large language models for intelligent transportation: A review of the state of the art and challenges

S Wandelt, C Zheng, S Wang, Y Liu, X Sun - Applied Sciences, 2024 - mdpi.com
Large Language Models (LLMs), based on their highly developed ability to comprehend and
generate human-like text, promise to revolutionize all aspects of society. These LLMs …

Bard, ChatGPT and 3DGPT: a scientometric analysis of generative AI tools and assessment of implications for mechanical engineering education

KB Mustapha, EH Yap, YA Abakr - Interactive Technology and Smart …, 2024 - emerald.com
Purpose Following the recent rise in generative artificial intelligence (GenAI) tools,
fundamental questions about their wider impacts have started to reverberate around various …

Data extraction for evidence synthesis using a large language model: A proof‐of‐concept study

G Gartlehner, L Kahwati, R Hilscher… - Research Synthesis …, 2024 - Wiley Online Library
Data extraction is a crucial, yet labor‐intensive and error‐prone part of evidence synthesis.
To date, efforts to harness machine learning for enhancing efficiency of the data extraction …