A comprehensive overview of large language models

H Naveed, AU Khan, S Qiu, M Saqib, S Anwar… - arxiv preprint arxiv …, 2023 - arxiv.org
Large Language Models (LLMs) have recently demonstrated remarkable capabilities in
natural language processing tasks and beyond. This success of LLMs has led to a large …

The emerging trends of multi-label learning

W Liu, H Wang, X Shen… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Exabytes of data are generated daily by humans, leading to the growing needs for new
efforts in dealing with the grand challenges for multi-label learning brought by big data. For …

Ernie 3.0: Large-scale knowledge enhanced pre-training for language understanding and generation

Y Sun, S Wang, S Feng, S Ding, C Pang… - arxiv preprint arxiv …, 2021 - arxiv.org
Pre-trained models have achieved state-of-the-art results in various Natural Language
Processing (NLP) tasks. Recent works such as T5 and GPT-3 have shown that scaling up …

[BOOK][B] Pretrained transformers for text ranking: Bert and beyond

J Lin, R Nogueira, A Yates - 2022 - books.google.com
The goal of text ranking is to generate an ordered list of texts retrieved from a corpus in
response to a query. Although the most common formulation of text ranking is search …

Legalbench: A collaboratively built benchmark for measuring legal reasoning in large language models

N Guha, J Nyarko, D Ho, C Ré… - Advances in …, 2024 - proceedings.neurips.cc
The advent of large language models (LLMs) and their adoption by the legal community has
given rise to the question: what types of legal reasoning can LLMs perform? To enable …

Disc-lawllm: Fine-tuning large language models for intelligent legal services

S Yue, W Chen, S Wang, B Li, C Shen, S Liu… - arxiv preprint arxiv …, 2023 - arxiv.org
We propose DISC-LawLLM, an intelligent legal system utilizing large language models
(LLMs) to provide a wide range of legal services. We adopt legal syllogism prompting …

How does NLP benefit legal system: A summary of legal artificial intelligence

H Zhong, C **ao, C Tu, T Zhang, Z Liu… - arxiv preprint arxiv …, 2020 - arxiv.org
Legal Artificial Intelligence (LegalAI) focuses on applying the technology of artificial
intelligence, especially natural language processing, to benefit tasks in the legal domain. In …

[HTML][HTML] Lawformer: A pre-trained language model for chinese legal long documents

C **ao, X Hu, Z Liu, C Tu, M Sun - AI Open, 2021 - Elsevier
Legal artificial intelligence (LegalAI) aims to benefit legal systems with the technology of
artificial intelligence, especially natural language processing (NLP). Recently, inspired by …

Legal judgment prediction via topological learning

H Zhong, Z Guo, C Tu, C **ao, Z Liu… - Proceedings of the 2018 …, 2018 - aclanthology.org
Abstract Legal Judgment Prediction (LJP) aims to predict the judgment result based on the
facts of a case and becomes a promising application of artificial intelligence techniques in …

Pangu-{\Sigma}: Towards trillion parameter language model with sparse heterogeneous computing

X Ren, P Zhou, X Meng, X Huang, Y Wang… - arxiv preprint arxiv …, 2023 - arxiv.org
The scaling of large language models has greatly improved natural language
understanding, generation, and reasoning. In this work, we develop a system that trained a …