Prompt as triggers for backdoor attack: Examining the vulnerability in language models

S Zhao, J Wen, LA Tuan, J Zhao, J Fu - arxiv preprint arxiv:2305.01219, 2023 - arxiv.org
The prompt-based learning paradigm, which bridges the gap between pre-training and fine-
tuning, achieves state-of-the-art performance on several NLP tasks, particularly in few-shot …

State-of-the-art generalisation research in NLP: a taxonomy and review

D Hupkes, M Giulianelli, V Dankers, M Artetxe… - arxiv preprint arxiv …, 2022 - arxiv.org
The ability to generalise well is one of the primary desiderata of natural language
processing (NLP). Yet, what'good generalisation'entails and how it should be evaluated is …

Towards making the most of llm for translation quality estimation

H Huang, S Wu, X Liang, B Wang, Y Shi, P Wu… - … Conference on Natural …, 2023 - Springer
Abstract Machine Translation Quality Estimation (QE) aims to evaluate the quality of
machine translation without relying on references. Recently, Large-scale Language Model …

Take care of your prompt bias! investigating and mitigating prompt bias in factual knowledge extraction

Z Xu, K Peng, L Ding, D Tao, X Lu - arxiv preprint arxiv:2403.09963, 2024 - arxiv.org
Recent research shows that pre-trained language models (PLMs) suffer from" prompt bias"
in factual knowledge extraction, ie, prompts tend to introduce biases toward specific labels …

Clean-label backdoor attack and defense: An examination of language model vulnerability

S Zhao, X Xu, L **ao, J Wen, LA Tuan - Expert Systems with Applications, 2025 - Elsevier
Prompt-based learning, a paradigm that creates a bridge between pre-training and fine-
tuning stages, has proven to be highly effective concerning various NLP tasks, particularly in …

Whose wife is it anyway? assessing bias against same-gender relationships in machine translation

I Stewart, R Mihalcea - arxiv preprint arxiv:2401.04972, 2024 - arxiv.org
Machine translation often suffers from biased data and algorithms that can lead to
unacceptable errors in system output. While bias in gender norms has been investigated …

Poor Man's Quality Estimation: Predicting Reference-Based MT Metrics Without the Reference

V Zouhar, S Dhuliawala, W Zhou, N Daheim… - arxiv preprint arxiv …, 2023 - arxiv.org
Machine translation quality estimation (QE) predicts human judgements of a translation
hypothesis without seeing the reference. State-of-the-art QE systems based on pretrained …

Improving translation quality estimation with bias mitigation

H Huang, S Wu, K Chen, H Di, M Yang… - Proceedings of the 61st …, 2023 - aclanthology.org
State-of-the-art translation Quality Estimation (QE) models are proven to be biased. More
specifically, they over-rely on monolingual features while ignoring the bilingual semantic …

Multi-view fusion for universal translation quality estimation

H Huang, S Wu, K Chen, X Liang, H Di, M Yang… - Information …, 2024 - Elsevier
Abstract Machine translation quality estimation (QE) aims to evaluate the result of translation
without reference. Despite the progress it has made, state-of-the-art QE models are proven …

Towards fine-grained information: Identifying the type and location of translation errors

K Bao, Y Wan, D Liu, B Yang, W Lei, X He… - arxiv preprint arxiv …, 2023 - arxiv.org
Fine-grained information on translation errors is helpful for the translation evaluation
community. Existing approaches can not synchronously consider error position and type …