AWED-FiNER: Agents, Web applications, and Expert Detectors for Fine-grained Named Entity Recognition across 36 Languages for 6.6 Billion Speakers
About
Named Entity Recognition (NER) is a foundational task in Natural Language Processing (NLP) and Information Retrieval (IR), which facilitates semantic search and structured data extraction. We introduce \textbf{AWED-FiNER}, an open-source collection of agentic tool, web application, and 53 state-of-the-art expert models that provide Fine-grained Named Entity Recognition (FgNER) solutions across 36 languages spoken by more than 6.6 billion people. The agentic tool enables routing multilingual text to specialized expert models to fetch FgNER annotations within seconds. The web-based platform provides a ready-to-use FgNER annotation service for non-technical users. Moreover, the collection of language-specific extremely small open-source state-of-the-art expert models facilitates offline deployment in resource-constrained scenarios, including edge devices. AWED-FiNER covers languages spoken by over 6.6 billion people, ranging from global languages like English, Chinese, Spanish, and Hindi, to low-resource languages like Assamese, Santali, and Odia, along with a specific focus on extremely low-resource vulnerable languages such as Bodo, Manipuri, Bishnupriya, and Mizo. The resources can be accessed here: Agentic Tool (https://github.com/PrachuryyaKaushik/AWED-FiNER), Web Application (https://hf.co/spaces/prachuryyaIITG/AWED-FiNER), and 53 Expert Detector Models (https://hf.co/collections/prachuryyaIITG/awed-finer).
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Fine-grained Named Entity Recognition | SampurNER | Precision67.18 | 22 | |
| Fine-grained Named Entity Recognition | MultiCoNER2 2023 (test) | Precision85.67 | 12 | |
| Fine-grained Named Entity Recognition | CLASSER 2025 (test) | Precision79.24 | 6 | |
| Fine-grained Named Entity Recognition | FiNE-MiBBiC | Precision (%)66.12 | 4 | |
| Fine-grained Named Entity Recognition | FiNERVINER | Precision80.33 | 2 | |
| Fine-grained Named Entity Recognition | APTFiNER | Precision75.72 | 2 | |
| Fine-grained Named Entity Recognition | FewNERD | Precision (%)66.21 | 1 |