SMATCH++: Standardized and extended evaluation of semantic graphs

J Opitz - arxiv preprint arxiv:2305.06993, 2023 - arxiv.org
The Smatch metric is a popular method for evaluating graph distances, as is necessary, for
instance, to assess the performance of semantic graph parsing systems. However, we …

Evaluate AMR graph similarity via self-supervised learning

Z Shou, F Lin - Proceedings of the 61st Annual Meeting of the …, 2023 - aclanthology.org
In work on AMR (Abstract Meaning Representation), similarity metrics are crucial as they are
used to evaluate AMR systems such as AMR parsers. Current AMR metrics are all based on …

AMR similarity metrics from principles

J Opitz, L Parcalabescu, A Frank - Transactions of the Association for …, 2020 - direct.mit.edu
Different metrics have been proposed to compare Abstract Meaning Representation (AMR)
graphs. The canonical Smatch metric (Cai and Knight,) aligns the variables of two graphs …

Accounting for language effect in the evaluation of cross-lingual AMR parsers

S Wein, N Schneider - … of the 29th International Conference on …, 2022 - aclanthology.org
Abstract Cross-lingual Abstract Meaning Representation (AMR) parsers are currently
evaluated in comparison to gold English AMRs, despite parsing a language other than …

Penman: An open-source library and tool for AMR graphs

MW Goodman - Proceedings of the 58th Annual Meeting of the …, 2020 - aclanthology.org
Abstract Meaning Representation (AMR)(Banarescu et al., 2013) is a framework for
semantic dependencies that encodes its rooted and directed acyclic graphs in a format …

Framing analysis of health-related narratives: Conspiracy versus mainstream media

M Reiter-Haas, B Klösch, M Hadler, E Lex - arxiv preprint arxiv …, 2024 - arxiv.org
Understanding how online media frame issues is crucial due to their impact on public
opinion. Research on framing using natural language processing techniques mainly focuses …

Evaluation of a semantic search approach based on amr for information retrieval in image exploitation

A Müller, A Kuwertz - 2022 Sensor Data Fusion: Trends …, 2022 - ieeexplore.ieee.org
As part of the unprecedented wealth of data available nowadays, semi-formal reports in the
domain of remote sensing can convey information important for decision making in …

Inspecting Soundness of AMR Similarity Metrics in terms of Equivalence and Inequivalence

KS Ki, B Kim, G Gweon - Proceedings of the 13th Joint Conference …, 2024 - aclanthology.org
In this study, we investigate soundness of current Abstract Meaning Representation (AMR)
similarity metrics in terms of equivalence and inequivalence. Specifically, AMR guidelines …

Development and Evaluation of Cross-lingual Abstract Meaning Representation

SB Wein - 2024 - search.proquest.com
Semantic representations, which reflect the meaning of a text, are an important tool for
downstream natural language processing tasks which rely on meaning inference. One type …

[BUCH][B] Linguistic Interpretability and Composition of Abstract Meaning Representations

A Blodgett - 2021 - search.proquest.com
Abstract Many Natural Language Processing (NLP) and Natural Language Understanding
(NLU) tasks require some implicit representation of meaning. Abstract Meaning …