Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Findings of the Fifth Shared Task on Multilingual Coreference Resolution: Expanding Datasets for Long-Range Entities

About

This paper describes the fifth edition of the Shared Task on Multilingual Coreference Resolution, held in conjunction with the CODI-CRAC 2026 workshop. Building on previous iterations, the task required participants to develop systems capable of mention identification and identity-based coreference clustering. The 2026 edition specifically emphasizes long-range entities, defined as coreferential chains spanning significant distances, across many words and sentences. The task expanded its linguistic scope by incorporating five new datasets and two additional languages. These additions leverage version 1.4 of CorefUD, a harmonized multilingual collection comprising 27 datasets in 19 languages. In total, ten systems participated, including four LLM-based approaches (three fine-tuned models and one few-shot approach). While traditional systems still maintained their lead, LLMs demonstrated significant potential, suggesting they may soon challenge established approaches in future editions.

Michal Nov\'ak, Miloslav Konop\'ik, Anna Nedoluzhko, Martin Popel, Ond\v{r}ej Pra\v{z}\'ak, Jakub Sido, Milan Straka, Zden\v{e}k \v{Z}abokrtsk\'y, Daniel Zeman• 2026

Related benchmarks

TaskDatasetResultRank
Coreference ResolutionCRAC mini Shared Task 2026 (test)
Head-match74.32
12
Showing 1 of 1 rows

Other info

Follow for update