[PDF][PDF] Focused evaluation for image description with binary forced-choice tasks

M Hodosh, J Hockenmaier - Proceedings of the 5th Workshop on …, 2016 - aclanthology.org
Current evaluation metrics for image description may be too coarse. We therefore propose a
series of binary forced-choice tasks that each focus on a different aspect of the captions. We …