Bringing order into the realm of Transformer-based language models for artificial intelligence and law

CM Greco, A Tagarelli - Artificial Intelligence and Law, 2024 - Springer
Transformer-based language models (TLMs) have widely been recognized to be a cutting-
edge technology for the successful development of deep-learning-based solutions to …

Roformer: Enhanced transformer with rotary position embedding

J Su, M Ahmed, Y Lu, S Pan, W Bo, Y Liu - Neurocomputing, 2024 - Elsevier
Position encoding has recently been shown to be effective in transformer architecture. It
enables valuable supervision for dependency modeling between elements at different …

How does NLP benefit legal system: A summary of legal artificial intelligence

H Zhong, C **ao, C Tu, T Zhang, Z Liu… - arxiv preprint arxiv …, 2020 - arxiv.org
Legal Artificial Intelligence (LegalAI) focuses on applying the technology of artificial
intelligence, especially natural language processing, to benefit tasks in the legal domain. In …

LeCaRD: a legal case retrieval dataset for Chinese law system

Y Ma, Y Shao, Y Wu, Y Liu, R Zhang… - Proceedings of the 44th …, 2021 - dl.acm.org
Legal case retrieval is of vital importance for ensuring justice in different kinds of law
systems and has recently received increasing attention in information retrieval (IR) research …

A survey on large language models for critical societal domains: Finance, healthcare, and law

ZZ Chen, J Ma, X Zhang, N Hao, A Yan… - arxiv preprint arxiv …, 2024 - arxiv.org
In the fast-evolving domain of artificial intelligence, large language models (LLMs) such as
GPT-3 and GPT-4 are revolutionizing the landscapes of finance, healthcare, and law …

LAiW: a Chinese legal large language models benchmark

Y Dai, D Feng, J Huang, H Jia, Q **e, Y Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
General and legal domain LLMs have demonstrated strong performance in various tasks of
LegalAI. However, the current evaluations of these LLMs in LegalAI are defined by the …

Legal case document similarity: You need both network and text

P Bhattacharya, K Ghosh, A Pal, S Ghosh - Information Processing & …, 2022 - Elsevier
Estimating the similarity between two legal case documents is an important and challenging
problem, having various downstream applications such as prior-case retrieval and citation …

Optimizing numerical estimation and operational efficiency in the legal domain through large language models

JH Huang, CC Yang, Y Shen, AM Pacces… - Proceedings of the 33rd …, 2024 - dl.acm.org
The legal landscape encompasses a wide array of lawsuit types, presenting lawyers with
challenges in delivering timely and accurate information to clients, particularly concerning …

ERNIE-Doc: A retrospective long-document modeling transformer

S Ding, J Shang, S Wang, Y Sun, H Tian, H Wu… - arxiv preprint arxiv …, 2020 - arxiv.org
Transformers are not suited for processing long documents, due to their quadratically
increasing memory and time consumption. Simply truncating a long document or applying …

[HTML][HTML] TaSbeeb: A judicial decision support system based on deep learning framework

HA Almuzaini, AM Azmi - Journal of King Saud University-Computer and …, 2023 - Elsevier
Since the early 1980s, the legal domain has shown a growing interest in Artificial
Intelligence approaches to tackle the increasing number of cases worldwide. TaSbeeb is a …