Meaning at the Planck scale? Contextualized word embeddings for doing history, philosophy, and sociology of science

A Simons - arxiv preprint arxiv:2411.14073, 2024 - arxiv.org
This paper explores the potential of contextualized word embeddings (CWEs) as a new tool
in the history, philosophy, and sociology of science (HPSS) for studying contextual and …

Astro-HEP-BERT: A bidirectional language model for studying the meanings of concepts in astrophysics and high energy physics

A Simons - arxiv preprint arxiv:2411.14877, 2024 - arxiv.org
I present Astro-HEP-BERT, a transformer-based language model specifically designed for
generating contextualized word embeddings (CWEs) to study the meanings of concepts in …