A Multilingual Dataset and Empirical Validation for the Mutual Reinforcement Effect in Information Extraction
About
The Mutual Reinforcement Effect (MRE) describes a phenomenon in information extraction where word-level and sentence-level tasks can mutually improve each other when jointly modeled. While prior work has reported MRE in Japanese, its generality across languages and task settings has not been empirically validated, largely due to the lack of multilingual MRE datasets. To address this limitation, we introduce the Multilingual MRE Mix dataset (MMM), which consists of 21 sub-datasets covering English, Japanese, and Chinese. We propose an LLM-assisted dataset translation and alignment framework that significantly reduces manual annotation effort while preserving the structural requirements of MRE tasks. Building on MMM, we adopt a unified input-output framework to train an open-domain information extraction model and conduct extensive empirical studies, including full fine-tuning ablations and the construction of knowledgeable verbalizers based on MRE-mix data. Experimental results show that 76 percent of the MMM sub-datasets consistently exhibit the Mutual Reinforcement Effect across languages. These findings provide systematic empirical validation of MRE in multilingual settings and demonstrate its practical value for information extraction.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Information Extraction | MMM Japanese SCPOS: RW | TL F10.946 | 8 | |
| Information Extraction | MMM Japanese SCPOS: Adj & N | TL F195.2 | 8 | |
| Information Extraction | MMM Japanese SCPOS Adj | TL F1 Score94 | 8 | |
| Information Extraction | MMM Japanese SCPOS N | TL F194.7 | 8 | |
| Information Extraction | MMM Japanese SCNM | TL F189 | 7 | |
| Information Extraction | MMM Japanese TCREE | TL F197.08 | 7 | |
| Information Extraction | MMM English SCNM | TL F185.43 | 6 | |
| Information Extraction | MMM English SCPOS: RW | TL F195.07 | 6 | |
| Information Extraction | MMM English SCPOS: Adj & N | TL F194.3 | 6 | |
| Information Extraction | MMM English SCPOS: Adj | TL F194.4 | 6 |