Large language models for generative information extraction: A survey

D Xu, W Chen, W Peng, C Zhang, T Xu, X Zhao… - Frontiers of Computer …, 2024 - Springer
Abstract Information Extraction (IE) aims to extract structural knowledge from plain natural
language texts. Recently, generative Large Language Models (LLMs) have demonstrated …

A review on large Language Models: Architectures, applications, taxonomies, open issues and challenges

MAK Raiaan, MSH Mukta, K Fatema, NM Fahad… - IEEE …, 2024 - ieeexplore.ieee.org
Large Language Models (LLMs) recently demonstrated extraordinary capability in various
natural language processing (NLP) tasks including language translation, text generation …

Self-play fine-tuning converts weak language models to strong language models

Z Chen, Y Deng, H Yuan, K Ji, Q Gu - arxiv preprint arxiv:2401.01335, 2024 - arxiv.org
Harnessing the power of human-annotated data through Supervised Fine-Tuning (SFT) is
pivotal for advancing Large Language Models (LLMs). In this paper, we delve into the …

Large language model is not a good few-shot information extractor, but a good reranker for hard samples!

Y Ma, Y Cao, YC Hong, A Sun - arxiv preprint arxiv:2303.08559, 2023 - arxiv.org
Large Language Models (LLMs) have made remarkable strides in various tasks. Whether
LLMs are competitive few-shot solvers for information extraction (IE) tasks, however, remains …

On llms-driven synthetic data generation, curation, and evaluation: A survey

L Long, R Wang, R **ao, J Zhao, X Ding… - arxiv preprint arxiv …, 2024 - arxiv.org
Within the evolving landscape of deep learning, the dilemma of data quantity and quality has
been a long-standing problem. The recent advent of Large Language Models (LLMs) offers …

Large language models and knowledge graphs: Opportunities and challenges

JZ Pan, S Razniewski, JC Kalo, S Singhania… - arxiv preprint arxiv …, 2023 - arxiv.org
Large Language Models (LLMs) have taken Knowledge Representation--and the world--by
storm. This inflection point marks a shift from explicit knowledge representation to a renewed …

Self-exploring language models: Active preference elicitation for online alignment

S Zhang, D Yu, H Sharma, H Zhong, Z Liu… - arxiv preprint arxiv …, 2024 - arxiv.org
Preference optimization, particularly through Reinforcement Learning from Human
Feedback (RLHF), has achieved significant success in aligning Large Language Models …

Generating faithful synthetic data with large language models: A case study in computational social science

V Veselovsky, MH Ribeiro, A Arora, M Josifoski… - arxiv preprint arxiv …, 2023 - arxiv.org
Large Language Models (LLMs) have democratized synthetic data generation, which in turn
has the potential to simplify and broaden a wide gamut of NLP tasks. Here, we tackle a …

Large language models for data annotation and synthesis: A survey

Z Tan, D Li, S Wang, A Beigi, B Jiang… - Proceedings of the …, 2024 - aclanthology.org
Data annotation and synthesis generally refers to the labeling or generating of raw data with
relevant information, which could be used for improving the efficacy of machine learning …

A field guide to automatic evaluation of llm-generated summaries

TA van Schaik, B Pugh - Proceedings of the 47th International ACM …, 2024 - dl.acm.org
Large Language models (LLMs) are rapidly being adopted for tasks such as text
summarization, in a wide range of industries. This has driven the need for scalable …