Towards Robust Argumentative Essay Understanding via TIDE: An Interactive Framework with Trial and Debate
About
Argumentative essays serve as a vital medium for assessing critical thinking and reasoning skills, yet there is limited works on accurately understanding and evaluating such texts via prompt. In this work, we propose TIDE, a novel framework designed to improve criteria-based prompt optimization for argument-related tasks by integrating TrIal and DEbate mechanism. Our method addresses key limitations of criteria-based prompt optimizing by mitigating the influence of noisy training data and enhancing optimization stability. We evaluate TIDE on three core tasks: Automated Essay Scoring, Argument Component Detection, and Argument Relation Identification. Results demonstrate that our framework improves performance across tasks. These findings underscore the potential of combining prompt-based methods for advanced argument understanding.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Automated essay scoring | CEAMC | QWK45.64 | 7 | |
| Automated essay scoring | ArGPT | QWK53.59 | 7 | |
| Automated essay scoring | ASAP 2.0 | QWK49.51 | 7 | |
| Argument Component Detection | CEAMC | Micro F169.57 | 5 | |
| Argument Component Detection | AEE | Micro F185.35 | 5 | |
| Argument Relation Identification | CEAMC | Micro F116.05 | 5 | |
| Argument Relation Identification | AEE | Micro F162.83 | 5 |