Codebook llms: Adapting political science codebooks for llm use and adapting llms to follow codebooks

A Halterman, KA Keith - arxiv preprint arxiv:2407.10747, 2024 - arxiv.org
Codebooks--documents that operationalize constructs and outline annotation procedures--
are used almost universally by social scientists when coding unstructured political texts …

Calibrating llms with preference optimization on thought trees for generating rationale in science question scoring

J Li, H Xu, Z Sun, Y Zhou, D West, C Aloisi… - arxiv preprint arxiv …, 2024 - arxiv.org
Generating rationales that justify scoring decisions has been a promising way to facilitate
explainability in automated scoring systems. However, existing methods do not match the …

Mechanistic?

N Saphra, S Wiegreffe - arxiv preprint arxiv:2410.09087, 2024 - arxiv.org
The rise of the term" mechanistic interpretability" has accompanied increasing interest in
understanding neural models--particularly language models. However, this jargon has also …

Reasoning with Natural Language Explanations

M Valentino, A Freitas - arxiv preprint arxiv:2410.04148, 2024 - arxiv.org
Explanation constitutes an archetypal feature of human rationality, underpinning learning
and generalisation, and representing one of the media supporting scientific discovery and …

[PDF][PDF] Introductory Tutorial: Reasoning with Natural Language Explanations

M Valentino, A Freitas - Proceedings of the 2024 Conference on …, 2024 - aclanthology.org
Explanation constitutes an archetypal feature of human rationality, underpinning learning,
and generalisation, and representing one of the media supporting scientific discovery and …

Answer, Assemble, Ace: Understanding How LMs Answer Multiple Choice Questions

S Wiegreffe, O Tafjord, Y Belinkov, H Hajishirzi… - … Conference on Learning … - openreview.net
Multiple-choice question answering (MCQA) is a key competence of performant transformer
language models that is tested by mainstream benchmarks. However, recent evidence …

Faithful and Useful Explanations by Large Language Models

Q Lyu - 2024 - search.proquest.com
The advent of large-scale pretrained Language Models (LMs) has ushered in a new era in
Natural Language Processing (NLP). These models, trained on massive text corpora, have …

[HTML][HTML] Extended endocrine therapy in breast cancer: A basket of length-constraint feature selection metaheuristics to balance Type I against Type II errors

HP Liu, JV Zhang, D Wang, A Albrecht… - Journal of Biomedical …, 2022 - Elsevier
Extended endocrine therapy beyond 5 years is of major concern to ER+ breast cancer
survivors. However, it might be unsuitable to apply routinely used genomic tests designed …