Kocommongen v2: A benchmark for navigating korean commonsense reasoning challenges in large language models

J Seo, J Lee, C Park, ST Hong, S Lee… - Findings of the …, 2024 - aclanthology.org
The evolution of large language models (LLMs) has culminated in a multitask model
paradigm where prompts drive the generation of user-specific outputs. However, this …

Open Korean corpora: A practical report

WI Cho, S Moon, Y Song - arxiv preprint arxiv:2012.15621, 2020 - arxiv.org
Korean is often referred to as a low-resource language in the research community. While
this claim is partially true, it is also because the availability of resources is inadequately …

CHEF in the Language Kitchen: A Generative Data Augmentation Leveraging Korean Morpheme Ingredients

J Seo, H Moon, J Lee, S Eo, C Park… - Proceedings of the 2023 …, 2023 - aclanthology.org
Korean morphological variations present unique opportunities and challenges in natural
language processing (NLP), necessitating an advanced understanding of morpheme-based …

The ASR Post-Processor Performance Challenges of BackTranScription (BTS): Data-Centric and Model-Centric Approaches

C Park, J Seo, S Lee, C Lee, H Lim - Mathematics, 2022 - mdpi.com
Training an automatic speech recognition (ASR) post-processor based on sequence-to-
sequence (S2S) requires a parallel pair (eg, speech recognition result and human post …

Korean visual abductive reasoning: AI Language Model's ability to understand plausibility.

S Han, J Won, E Kwon, S Song - Linguistic Research, 2024 - search.ebscohost.com
Visual abductive reasoning is the logical process of drawing the most plausible hypothesis
based on given observations. This ability is fundamental to artificial intelligence because it …

Focus on FoCus: Is FoCus focused on Context, Knowledge and Persona?

SY Lee, J Lee, C Park, S Eo, H Moon… - Proceedings of the …, 2022 - aclanthology.org
Rather than continuing the conversation based on personalized or implicit information, the
existing conversation system generates dialogue by focusing only on the superficial content …

[PDF][PDF] A Review of Proposals for Improvements in Evaluation of Natural Language Generation

JP Moilanen - 2023 - helda.helsinki.fi
The evaluation methodology of natural language generation (” NLG”= systems generating
text based on some kind of input) is currently in a state of a hopefully productive confusion …

[HTML][HTML] 거대 언어 모델의 한국 이해도 평가를 위한 벤치마크 연구

서민주, 정연주, 이현정, 임혜균, 장정선 - 컴퓨터교육학회 논문지, 2024 - journal.kace.re.kr
초록 본 연구는 거대 언어 모델 (Large Language Models, LLM) 의 한국 이해도를 평가하기
위해 설계된 Ko-Sovereign 벤치마크를 제안한다. Ko-Sovereign 벤치마크는 한국어 능력 …

-ATOMIC: Korean Commonsense Knowledge Graph

J Lee, J Seo, S Lee, C Park, AI Danielle… - Annual Conference on …, 2022 - koreascience.kr
일반 상식 기반의 지식 그래프는 대규모 코퍼스에 포함되어 있는 일반 상식을 그래프로
표현하여, 자연어 처리의 하위 작업들에 적용할 수 있도록 하는 구조화된 지식 표현 방법이다 …

SRLev-BIH: An Evaluation Metric for Korean Generative Commonsense Reasoning

J Seo, Y Jang, J Lee, H Moon, S Eo… - … on Human and …, 2022 - koreascience.kr
일반 상식 추론 능력은 가장 사람다운 능력 중 하나로써, 인공지능 모델이 쉽게 모사하기 어려운
영역이다. 딥러닝 기반의 언어 모델은 여전히 일반 상식에 기반한 추론을 필요로 하는 분야에서 …