Sakana Fugu Technical Report
About
The capabilities of frontier Large Language Models (LLMs) continue to advance, with different providers increasingly specializing in distinct domains. This raises a natural next objective: how to combine the individual specializations of various LLMs into a collectively intelligent system. To this end, we report the development of Sakana Fugu, a family of orchestrator models that harness and amplify the capabilities of an LLM agent team. Fugu models are themselves language models trained to understand user queries and dynamically devise agentic scaffolds to solve them. Through these adaptive scaffolds, Fugu accesses performance beyond any individual LLM agent, achieving state-of-the-art results compared to other publicly accessible models across a range of challenging tasks, including SWE-Bench Pro, Terminal Bench, LiveCodeBench, GPQA-Diamond, Humanity's Last Exam, and CharXiv Reasoning. We release two models: Fugu, which balances performance with latency for everyday use, and Fugu-Ultra, which prioritizes answer quality on the hardest problems. We describe our training paradigm, which encompasses large-scale fine-tuning, evolutionary algorithms, and reinforcement learning approaches, along with the infrastructure and core design principles that turn these methods into a production system. We hope this report encourages further research into multi-agent systems and dynamic, query-adaptive agentic scaffolds as a path toward the next frontier of AI capabilities, accessed through collective intelligence.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Scientific Reasoning | GPQA Diamond | -- | 94 | |
| Coding | LiveCodeBench v6 | Score (%)92 | 51 | |
| Scientific Coding | SciCode | -- | 18 | |
| General Knowledge Reasoning | Humanity's Last Exam | Score50 | 17 | |
| Scientific Chart Interpretation | CharXiv Reasoning | Overall Score86.6 | 17 | |
| Hyperparameter Optimization | autoresearch (val) | Best Validation bpb0.9774 | 13 | |
| Coding | LiveCodeBench Pro | Score90.8 | 5 | |
| Domain-specific agentic reasoning | BANKING | Score21.7 | 5 | |
| Long-context Reasoning | Long Context Reasoning | Score74.7 | 5 | |
| Rubik's cube solver synthesis | 300 scrambles (held-out) | Solve Rate1 | 5 |