Challenges and applications of large language models

J Kaddour, J Harris, M Mozes, H Bradley… - arxiv preprint arxiv …, 2023 - arxiv.org
Large Language Models (LLMs) went from non-existent to ubiquitous in the machine
learning discourse within a few years. Due to the fast pace of the field, it is difficult to identify …

A survey on legal judgment prediction: Datasets, metrics, models and challenges

J Cui, X Shen, S Wen - IEEE Access, 2023 - ieeexplore.ieee.org
Legal judgment prediction (LJP) applies Natural Language Processing (NLP) techniques to
predict judgment results based on fact descriptions automatically. The present work …

Legalbench: A collaboratively built benchmark for measuring legal reasoning in large language models

N Guha, J Nyarko, D Ho, C Ré… - Advances in …, 2023 - proceedings.neurips.cc
The advent of large language models (LLMs) and their adoption by the legal community has
given rise to the question: what types of legal reasoning can LLMs perform? To enable …

Analyzing leakage of personally identifiable information in language models

N Lukas, A Salem, R Sim, S Tople… - … IEEE Symposium on …, 2023 - ieeexplore.ieee.org
Language Models (LMs) have been shown to leak information about training data through
sentence-level membership inference and reconstruction attacks. Understanding the risk of …

Flashattention: Fast and memory-efficient exact attention with io-awareness

T Dao, D Fu, S Ermon, A Rudra… - Advances in neural …, 2022 - proceedings.neurips.cc
Transformers are slow and memory-hungry on long sequences, since the time and memory
complexity of self-attention are quadratic in sequence length. Approximate attention …

On the opportunities and risks of foundation models

R Bommasani, DA Hudson, E Adeli, R Altman… - arxiv preprint arxiv …, 2021 - arxiv.org
AI is undergoing a paradigm shift with the rise of models (eg, BERT, DALL-E, GPT-3) that are
trained on broad data at scale and are adaptable to a wide range of downstream tasks. We …

LEGAL-BERT: The muppets straight out of law school

I Chalkidis, M Fergadiotis, P Malakasiotis… - arxiv preprint arxiv …, 2020 - arxiv.org
BERT has achieved impressive performance in several NLP tasks. However, there has been
limited investigation on its adaptation guidelines in specialised domains. Here we focus on …

Interpretable long-form legal question answering with retrieval-augmented large language models

A Louis, G van Dijck, G Spanakis - … of the AAAI Conference on Artificial …, 2024 - ojs.aaai.org
Many individuals are likely to face a legal dispute at some point in their lives, but their lack of
understanding of how to navigate these complex issues often renders them vulnerable. The …

A comparative study of automated legal text classification using random forests and deep learning

H Chen, L Wu, J Chen, W Lu, J Ding - Information Processing & …, 2022 - Elsevier
Automated legal text classification is a prominent research topic in the legal field. It lays the
foundation for building an intelligent legal system. Current literature focuses on international …

How does NLP benefit legal system: A summary of legal artificial intelligence

H Zhong, C **ao, C Tu, T Zhang, Z Liu… - arxiv preprint arxiv …, 2020 - arxiv.org
Legal Artificial Intelligence (LegalAI) focuses on applying the technology of artificial
intelligence, especially natural language processing, to benefit tasks in the legal domain. In …