Agents-K1: Towards Agent-native Knowledge Orchestration
About
Current LLM-based research agents have advanced through agent orchestration, yet largely overlook scientific knowledge orchestration. Existing works often reduce papers to abstracts, surface mentions, and flat \texttt{cites} edges, omitting key entities, claims, evidence, mechanisms, and method lineages essential for scientific reasoning. To this end, we introduce \textbf{Agents-K1}, an end-to-end knowledge orchestration pipeline that converts raw documents into agent-native scientific knowledge graphs. Agents-K1 integrates three components under a unifying theoretical foundation: a multimodal parser whose five-module schema captures entities, multimodal evidence, citations, and typed inter-entity relations across the full paper rather than abstracts alone; a 4B information-extraction backbone trained with GRPO under a rule-based reward; and a graphanything CLI, a tri-source agent interface that unifies web search, multimodal graph retrieval, and cross-document traversal. On top of this, we process 2.46 million scientific papers across six subjects to produce \textbf{Scholar-KG}, of which we release a one-million-paper subset, and the full Scholar-KG is accessible via the SCP link below. The same pipeline can be extended to general-domain corpora and to schema-conformant data synthesis. Extensive experiments demonstrate that Agents-K1 achieves superior performance in scientific information extraction, knowledge graph construction, and multi-hop scientific reasoning.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Relation Extraction | SciERC | Relation Strict F112.7 | 99 | |
| Relation Extraction | CoNLL 04 | F131.81 | 85 | |
| Multi-hop Question Answering | HotpotQA | LLM Accuracy67.8 | 25 | |
| Multi-hop Question Answering | 2WikiMultihopQA | Containment Accuracy67.1 | 16 | |
| Multi-hop Question Answering | MuSiQue | Contain-Acc.31.1 | 16 | |
| Named Entity Recognition | CrossNER AI | F1 Score54 | 16 | |
| Named Entity Recognition | CrossNER Held out AI Literature Music Politics Science | Average F160.35 | 4 | |
| Named Entity Recognition | In Distribution CoNLL2003 NCBI BC5CDR | Average F172.8 | 4 | |
| Named Entity Recognition | CrossNER Literature (held-out) | F1 Score57.36 | 4 | |
| Named Entity Recognition | CoNLL2003 in-distribution | F1 Score70.07 | 4 |