Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Definition generation for lexical semantic change detection

About

We use contextualized word definitions generated by large language models as semantic representations in the task of diachronic lexical semantic change detection (LSCD). In short, generated definitions are used as `senses', and the change score of a target word is retrieved by comparing their distributions in two time periods under comparison. On the material of five datasets and three languages, we show that generated definitions are indeed specific and general enough to convey a signal sufficient to rank sets of words by the degree of their semantic change over time. Our approach is on par with or outperforms prior non-supervised sense-based LSCD methods. At the same time, it preserves interpretability and allows to inspect the reasons behind a specific shift in terms of discrete definitions-as-senses. This is another step in the direction of explainable semantic change modeling.

Mariia Fedorova, Andrey Kutuzov, Yves Scherrer• 2024

Related benchmarks

TaskDatasetResultRank
Lexical Semantic Change DetectionSemEval Task 1 Subtask 2 English 2020
Spearman Correlation0.637
54
Lexical Semantic Change DetectionNorwegian-1
Spearman's Rho0.496
5
Lexical Semantic Change DetectionNorwegian-2
Spearman's Rho0.565
5
Lexical Semantic Change DetectionRussian 1
Spearman's rho0.488
5
Lexical Semantic Change DetectionRussian 3
Spearman's rho0.504
5
Lexical Semantic Change DetectionRussian-2
Spearman Rho0.462
5
Showing 6 of 6 rows

Other info

Code

Follow for update