Irony Detection, Reasoning and Understanding in Zero-shot Learning
About
The generalisation of irony detection faces significant challenges, leading to substantial performance deviations when detection models are applied to diverse real-world scenarios. In this study, we find that irony-focused prompts, as generated from our IDADP framework for LLMs, can not only overcome dataset-specific limitations but also generate coherent, human-readable reasoning, transforming ironic text into its intended meaning. Based on our findings and in-depth analysis, we identify several promising directions for future research aimed at enhancing LLMs' zero-shot capabilities in irony detection, reasoning, and comprehension. These include advancing contextual awareness in irony detection, exploring hybrid symbolic-neural methods, and integrating multimodal data, among others.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Sarcasm Detection | IAC V1 | Accuracy65.84 | 24 | |
| Sarcasm Detection | IAC V2 | Accuracy70.32 | 24 | |
| Sarcasm Detection | SemEval 2018 | Accuracy0.6531 | 24 |