AI-PAVE-Br: Leveraging Large Language Models for Enhanced Product Attribute Value Extraction through a Golden Set Approach
About
The explosive growth and complexity of product data within the dynamic Brazilian e-commerce landscape demand robust and specialized methods for structured information extraction. Traditional approaches to Product Attribute Value Extraction (PAVE) often struggle with the linguistic nuances and sheer diversity of product descriptions in Portuguese. To address this critical gap, this paper introduces two major contributions. First, we present AI-PAVEBr, a specialized system engineered with Large Language Models (LLMs) to perform high-accuracy PAVE specifically for Brazilian e-commerce catalogs. Second, to facilitate reproducible research and provide a definitive benchmark, we introduce and share the Golden Set, a new, meticulously curated, and manually annotated dataset for PAVE in Portuguese. We detail the creation process and structure (Entity, Category, Subcategories) of this high-quality reference set. Our experiments conclusively show that AI-PAVE-Br, leveraging targeted prompt engineering, dramatically outperforms conventional Named Entity Recognition (NER) baselines. This work not only delivers a superior, scalable solution for a major non-English market but also enriches the NLP community with a valuable, publicly available resource for future PAVE research.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Entity Prediction | Golden Set Air Conditioner | Coverage72 | 3 | |
| Entity Prediction | Golden Set TV | Coverage71 | 3 | |
| Entity Prediction | Golden Set Cell Phone | Coverage73 | 3 | |
| Entity Prediction | Golden Set Refrigerator | Coverage70 | 3 | |
| Entity Prediction | Golden Set Notebook | Coverage72 | 3 | |
| Entity Prediction | Golden Set Tire | Coverage71 | 3 | |
| Entity Prediction | Golden Set Wardrobe | Coverage70 | 3 | |
| Entity Prediction | Golden Set Bed | Coverage69 | 3 | |
| Entity Prediction | Golden Set Sneaker | Coverage74 | 3 | |
| Entity Prediction | Golden Set Stove | Coverage68 | 3 |