Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Fine-grained Verification via Diagnostic Reasoning Supervision for Aspect Sentiment Triplet Extraction

About

Aspect Sentiment Triplet Extraction (ASTE) aims to identify aspect terms, opinion terms, and sentiment polarities as structured triplets, providing essential inputs for downstream information system applications such as opinion mining, explainable recommendations, and review summarization. Prior work mainly focuses on end-to-end extraction, while post hoc verification of extracted triplets remains comparatively underexplored. This gap limits the reliability of ASTE systems, since predicted triplets may be locally plausible while being globally invalid. Moreover, candidate invalidity is multi-faceted and candidate usability is inherently graded, motivating a fine-grained verification mechanism that can filter or re-rank outputs from diverse extractors. In this paper, we propose FiVeD, a framework for Fine-grained Verification with Diagnostic reasoning supervision. Specifically, the verifier is trained with multiple complementary objectives, including validity classification and quality score estimation as primary tasks, with error type classification and rationale generation as auxiliary tasks. We define hierarchical error categories and construct plausible incorrect triplets under semantic and syntactic constraints, and leverage an off-the-shelf LLM with task-specific rubrics to produce quality scores and diagnostic rationales. During inference, the resulting quality scores are used to filter candidate outputs, supporting adjustable precision-recall tradeoffs. Experiments across multiple ASTE baselines demonstrate that FiVeD consistently improves extraction performance by up to 3.53 F1 points as a plug-and-play verification module.

Wenna Lai, Haoran Xie, Guandong Xu, Qing Li, S. Joe Qin• 2026

Related benchmarks

TaskDatasetResultRank
aspect sentiment triplet extractionRest SemEval 2015 (test)
F1 Score68.03
69
aspect sentiment triplet extractionLap SemEval 2014 (test)
F1 Score64.38
69
aspect sentiment triplet extractionREST 2014 (test)
F1 Score74.94
35
aspect sentiment triplet extractionRest 2016 (test)
F1 Score74.7
35
Showing 4 of 4 rows

Other info

Follow for update