Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

OneKE: A Dockerized Schema-Guided LLM Agent-based Knowledge Extraction System

About

We introduce OneKE, a dockerized schema-guided knowledge extraction system, which can extract knowledge from the Web and raw PDF Books, and support various domains (science, news, etc.). Specifically, we design OneKE with multiple agents and a configure knowledge base. Different agents perform their respective roles, enabling support for various extraction scenarios. The configure knowledge base facilitates schema configuration, error case debugging and correction, further improving the performance. Empirical evaluations on benchmark datasets demonstrate OneKE's efficacy, while case studies further elucidate its adaptability to diverse tasks across multiple domains, highlighting its potential for broad applications. We have open-sourced the Code at https://github.com/zjunlp/OneKE and released a Video at http://oneke.openkg.cn/demo.mp4.

Yujie Luo, Xiangyuan Ru, Kangwei Liu, Lin Yuan, Mengshu Sun, Ningyu Zhang, Lei Liang, Zhiqiang Zhang, Jun Zhou, Lanning Wei, Da Zheng, Haofen Wang, Huajun Chen• 2024

Related benchmarks

TaskDatasetResultRank
Relation ExtractionWiki-ZSL (test)
Micro-F142.18
16
Relation ExtractionFewRel (test)
Micro-F139.19
16
Event extractionRAMS (test)
Micro-F122.58
13
Named Entity RecognitionCrossNER (test)
Micro-F160.91
13
Event extractionWikiEvents (test)
Micro-F112.43
13
Event extractionCCF Law and FewFC (test)
CCF Law Score62.19
11
Relation ExtractionCOAE2016 and SKE2020 (test)
COAE2016 Performance49.83
11
Named Entity RecognitionWeibo and Boson (test)
Weibo NER Score35.06
11
Cyber Threat Intelligence Named Entity RecognitionDNRTI (test)
Macro F121.57
5
Cyber Threat Intelligence Named Entity RecognitionLADDER
Macro F144.16
5
Showing 10 of 13 rows

Other info

Follow for update