Large Language Models for Machine Translation Quality Annotation: Humans and Models Are Both Challenged

Large Language Models (LLMs) are considered to be a more efficient and cost-effective alternative to human judgment for Machine Translation (MT) evaluation.