A comprehensive overview of large language models

H Naveed, AU Khan, S Qiu, M Saqib, S Anwar… - arxiv preprint arxiv …, 2023‏ - arxiv.org
Large Language Models (LLMs) have recently demonstrated remarkable capabilities in
natural language processing tasks and beyond. This success of LLMs has led to a large …

The emerging trends of multi-label learning

W Liu, H Wang, X Shen… - IEEE transactions on …, 2021‏ - ieeexplore.ieee.org
Exabytes of data are generated daily by humans, leading to the growing needs for new
efforts in dealing with the grand challenges for multi-label learning brought by big data. For …

Legalbench: A collaboratively built benchmark for measuring legal reasoning in large language models

N Guha, J Nyarko, D Ho, C Ré… - Advances in …, 2023‏ - proceedings.neurips.cc
The advent of large language models (LLMs) and their adoption by the legal community has
given rise to the question: what types of legal reasoning can LLMs perform? To enable …

Ernie 3.0: Large-scale knowledge enhanced pre-training for language understanding and generation

Y Sun, S Wang, S Feng, S Ding, C Pang… - arxiv preprint arxiv …, 2021‏ - arxiv.org
Pre-trained models have achieved state-of-the-art results in various Natural Language
Processing (NLP) tasks. Recent works such as T5 and GPT-3 have shown that scaling up …

[ספר][B] Pretrained transformers for text ranking: Bert and beyond

J Lin, R Nogueira, A Yates - 2022‏ - books.google.com
The goal of text ranking is to generate an ordered list of texts retrieved from a corpus in
response to a query. Although the most common formulation of text ranking is search …

Disc-lawllm: Fine-tuning large language models for intelligent legal services

S Yue, W Chen, S Wang, B Li, C Shen, S Liu… - arxiv preprint arxiv …, 2023‏ - arxiv.org
We propose DISC-LawLLM, an intelligent legal system utilizing large language models
(LLMs) to provide a wide range of legal services. We adopt legal syllogism prompting …

How does NLP benefit legal system: A summary of legal artificial intelligence

H Zhong, C **ao, C Tu, T Zhang, Z Liu… - arxiv preprint arxiv …, 2020‏ - arxiv.org
Legal Artificial Intelligence (LegalAI) focuses on applying the technology of artificial
intelligence, especially natural language processing, to benefit tasks in the legal domain. In …

[HTML][HTML] Lawformer: A pre-trained language model for chinese legal long documents

C **ao, X Hu, Z Liu, C Tu, M Sun - AI Open, 2021‏ - Elsevier
Legal artificial intelligence (LegalAI) aims to benefit legal systems with the technology of
artificial intelligence, especially natural language processing (NLP). Recently, inspired by …

Pangu-{\Sigma}: Towards trillion parameter language model with sparse heterogeneous computing

X Ren, P Zhou, X Meng, X Huang, Y Wang… - arxiv preprint arxiv …, 2023‏ - arxiv.org
The scaling of large language models has greatly improved natural language
understanding, generation, and reasoning. In this work, we develop a system that trained a …

A short survey of viewing large language models in legal aspect

Z Sun - arxiv preprint arxiv:2303.09136, 2023‏ - arxiv.org
Large language models (LLMs) have transformed many fields, including natural language
processing, computer vision, and reinforcement learning. These models have also made a …