Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LLM-as-an-Annotator: Training Lightweight Models with LLM-Annotated Examples for Aspect Sentiment Tuple Prediction

About

Training models for Aspect-Based Sentiment Analysis (ABSA) tasks requires manually annotated data, which is expensive and time-consuming to obtain. This paper introduces LA-ABSA, a novel approach that leverages Large Language Model (LLM)-generated annotations to fine-tune lightweight models for complex ABSA tasks. We evaluate our approach on five datasets for Target Aspect Sentiment Detection (TASD) and Aspect Sentiment Quad Prediction (ASQP). Our approach outperformed previously reported augmentation strategies and achieved competitive performance with LLM-prompting in low-resource scenarios, while providing substantial energy efficiency benefits. For example, using 50 annotated examples for in-context learning (ICL) to guide the annotation of unlabeled data, LA-ABSA achieved an F1 score of 49.85 for ASQP on the SemEval Rest16 dataset, closely matching the performance of ICL prompting with Gemma-3-27B (51.10), while requiring significantly lower computational resources.

Nils Constantin Hellwig, Jakob Fehle, Udo Kruschwitz, Christian Wolff• 2026

Related benchmarks

TaskDatasetResultRank
Target Aspect Sentiment DetectionRest 2016
F1 Score62.74
31
Aspect-Sentiment-Query-Pair ExtractionRest15
F1 Score40.38
21
Aspect-Sentiment-Query-Pair ExtractionRest 16
F1 Score49.85
21
Target Aspect Sentiment DetectionRest15
F1 Score58.4
21
Aspect-Sentiment-Query-Pair ExtractionFlightABSA
F1 Score48.98
9
Target Aspect Sentiment DetectionFlightABSA
F1 Score62.57
9
Target Aspect Sentiment DetectionCoursera
F1 Score39.22
6
Target Aspect Sentiment DetectionHotels
F1 Score55.69
6
Showing 8 of 8 rows

Other info

Follow for update