Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

An Entity Linking Agent for Question Answering

About

Some Question Answering (QA) systems rely on knowledge bases (KBs) to provide accurate answers. Entity Linking (EL) plays a critical role in linking natural language mentions to KB entries. However, most existing EL methods are designed for long contexts and do not perform well on short, ambiguous user questions in QA tasks. We propose an entity linking agent for QA, based on a Large Language Model that simulates human cognitive workflows. The agent actively identifies entity mentions, retrieves candidate entities, and makes decision. To verify the effectiveness of our agent, we conduct two experiments: tool-based entity linking and QA task evaluation. The results confirm the robustness and effectiveness of our agent.

Yajie Luo, Yihong Wu, Muzhi Li, Jia Ao Sun, Xinyu Wang, Liheng Ma, Yingxue Zhang, Jian-Yun Nie• 2025

Related benchmarks

TaskDatasetResultRank
Question AnsweringPopQA (test)
Accuracy76.5
111
Entity LinkingWEBQSP (test)
Precision91.18
13
Entity Linking2Wiki (test)
Precision97.06
13
Entity LinkingCWQ (test)
Precision82.43
13
Question AnsweringTriviaQA (test)
Exact Match (EM)79.9
6
Showing 5 of 5 rows

Other info

Follow for update