| Findings of the 2017 conference on machine translation (wmt17) O Bojar, R Chatterjee, C Federmann, Y Graham, B Haddow, S Huang, ... Association for Computational Linguistics, 2017 | 1490 | 2017 |
| Findings of the 2019 conference on machine translation (WMT19) L Barrault, O Bojar, MR Costa-Jussa, C Federmann, M Fishel, Y Graham, ... ACL, 2019 | 776 | 2019 |
| Results of the WMT17 Metrics Shared Task O Bojar, Y Graham, A Kamran Proceedings of the Second Conference on Machine Translation, Volume 2 …, 2017 | 320* | 2017 |
| Results of the wmt16 metrics shared task O Bojar, Y Graham, A Kamran, M Stanojević Proceedings of the First Conference on Machine Translation: Volume 2, Shared …, 2016 | 258 | 2016 |
| Continuous measurement scales in human evaluation of machine translation Y Graham, T Baldwin, A Moffat, J Zobel Proceedings of the 7th Linguistic Annotation Workshop and Interoperability …, 2013 | 240 | 2013 |
| Results of the WMT19 metrics shared task: Segment-level and strong MT systems pose big challenges Q Ma, JTZ Wei, O Bojar, Y Graham Association for Computational Linguistics 2, 62-90, 2019 | 212 | 2019 |
| Findings of the 2021 conference on machine translation (WMT21) F Akhbardeh, A Arkhangorodsky, M Biesialska, O Bojar, R Chatterjee, ... Proceedings of the sixth conference on machine translation, 1-88, 2021 | 196 | 2021 |
| Can machine translation systems be evaluated by the crowd alone Y Graham, T Baldwin, A Moffat, J Zobel Natural Language Engineering 23 (1), 3-30, 2017 | 195 | 2017 |
| Findings of the 2022 conference on machine translation (WMT22) T Kocmi, R Bawden, O Bojar, A Dvorkovich, C Federmann, M Fishel, ... Proceedings of the Seventh Conference on Machine Translation (WMT), 1-45, 2022 | 178 | 2022 |
| Re-evaluating automatic summarization with BLEU and 192 shades of ROUGE Y Graham Proceedings of the 2015 conference on empirical methods in natural language …, 2015 | 173 | 2015 |
| Trecvid 2018: Benchmarking video activity detection, video captioning and matching, video storytelling linking and video search G Awad, AA Butt, K Curtis, Y Lee, J Fiscus, A Godil, D Joy, A Delgado, ... Proceedings of TRECVID 2018, 2018 | 132 | 2018 |
| Accurate evaluation of segment-level machine translation metrics Y Graham, T Baldwin, N Mathur Proceedings of the 2015 Conference of the North American Chapter of the …, 2015 | 122 | 2015 |
| Results of the WMT18 metrics shared task: Both characters and embeddings achieve good performance Q Ma, O Bojar, Y Graham Proceedings of the third conference on machine translation: shared task …, 2018 | 119 | 2018 |
| Trecvid 2017: evaluating ad-hoc and instance video search, events detection, video captioning, and hyperlinking G Awad, AA Butt, J Fiscus, D Joy, A Delgado, W Mcclinton, M Michel, ... TREC video retrieval evaluation (TRECVID), 2017 | 118 | 2017 |
| Statistical power and translationese in machine translation evaluation Y Graham, B Haddow, P Koehn Proceedings of the 2020 Conference on Empirical Methods in Natural Language …, 2020 | 91 | 2020 |
| Testing for Significance of Increased Correlation with Human Judgment Y Graham, T Baldwin Conference on Empirical Methods in Natural Language Processing, 172-180, 2014 | 86 | 2014 |
| Trecvid 2019: An evaluation campaign to benchmark video activity detection, video captioning and matching, and video search & retrieval G Awad, AA Butt, K Curtis, Y Lee, J Fiscus, A Godil, A Delgado, J Zhang, ... arXiv preprint arXiv:2009.09984, 2020 | 83 | 2020 |
| TRECVID 2020: A comprehensive campaign for evaluating video retrieval tasks across multiple application domains G Awad, AA Butt, K Curtis, J Fiscus, A Godil, Y Lee, A Delgado, J Zhang, ... arXiv preprint arXiv:2104.13473, 2021 | 78 | 2021 |
| Blend: a novel combined MT metric based on direct assessment—CASICT-DCU submission to WMT17 metrics task Q Ma, Y Graham, S Wang, Q Liu Proceedings of the second conference on machine translation, 598-603, 2017 | 71 | 2017 |
| Is machine translation getting better over time? Y Graham, T Baldwin, A Moffat, J Zobel Proceedings of the 14th Conference of the European Chapter of the …, 2014 | 69 | 2014 |
Ondřej BojarCharles University, Faculty of Mathematics and Physics, Institute of Formal and Applied LinguisticsAdresse e-mail validée de ufal.mff.cuni.cz