Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

AutoKG: Efficient Automated Knowledge Graph Generation for Language Models

About

Traditional methods of linking large language models (LLMs) to knowledge bases via the semantic similarity search often fall short of capturing complex relational dynamics. To address these limitations, we introduce AutoKG, a lightweight and efficient approach for automated knowledge graph (KG) construction. For a given knowledge base consisting of text blocks, AutoKG first extracts keywords using a LLM and then evaluates the relationship weight between each pair of keywords using graph Laplace learning. We employ a hybrid search scheme combining vector similarity and graph-based associations to enrich LLM responses. Preliminary experiments demonstrate that AutoKG offers a more comprehensive and interconnected knowledge retrieval mechanism compared to the semantic similarity search, thereby enhancing the capabilities of LLMs in generating more insightful and relevant outputs.

Bohan Chen, Andrea L. Bertozzi• 2023

Related benchmarks

TaskDatasetResultRank
Relation ExtractionWiki-NRE
Precision79.2
19
Knowledge Graph ExtractionWebNLG
Precision78.1
4
Knowledge Graph ExtractionSoftRel-Δ
Precision89.4
4
Decision Graph ExtractionProstate Guideline Chunk 1
Nodes Precision50
3
Decision Graph ExtractionProstate Guideline Chunk 2
Nodes Precision41.7
3
Decision Graph ExtractionProstate Guideline Chunk 3
Nodes Precision45.5
3
Decision Graph ExtractionProstate Guideline Chunk 4
Nodes Precision36.8
3
Decision Graph ExtractionProstate Guideline Chunk 5
Nodes Precision47.6
3
Decision Graph ExtractionProstate Guideline Complete Graph
Nodes Precision56.8
3
Showing 9 of 9 rows

Other info

Follow for update