Open-source Frame Semantic Parsing
About
While the state-of-the-art for frame semantic parsing has progressed dramatically in recent years, it is still difficult for end-users to apply state-of-the-art models in practice. To address this, we present Frame Semantic Transformer, an open-source Python library which achieves near state-of-the-art performance on FrameNet 1.7, while focusing on ease-of-use. We use a T5 model fine-tuned on Propbank and FrameNet exemplars as a base, and improve performance by using FrameNet lexical units to provide hints to T5 at inference time. We enhance robustness to real-world data by using textual data augmentations during training.
David Chanin• 2023
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Semantic Representation Evaluation | UpWork Narrative Situations Crime & Justice (test) | Preference Rate30 | 6 | |
| Semantic Representation Evaluation | UpWork Narrative Situations Economy (test) | Preference Rate14 | 6 | |
| Semantic Representation Evaluation | UpWork Narrative Situations Firefighting (test) | Preference Rate21 | 6 | |
| Semantic Representation Evaluation | UpWork Narrative Situations Healthcare (test) | Preference Rate6 | 6 | |
| Semantic Representation Evaluation | UpWork Narrative Situations Tech. Development (test) | Preference Rate14 | 6 |
Showing 5 of 5 rows