Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Inducing Reasoning Primitives from Agent Traces

About

ReAct-style LLM agents often rediscover the same reasoning routines across problems, yet leave those routines trapped in transient scratchpads. We introduce Reasoning Primitive Induction, a single-pass method that mines successful ReAct traces, clusters recurrent reasoning moves, and converts the most frequent moves into a compact library of typed pseudo-tools. Each pseudo-tool is specified by a natural-language docstring interpreted by an LLM at invocation time, and a standard ReAct loop composes these primitives at test time. The central result is that induced libraries outperform the very agent that generated their traces: by +44pp on RuleArena NBA (30 -> 74), +30pp on MuSR team allocation (38 -> 68), and +22pp on NatPlan meeting planning (7 -> 29). Across five comparable subtasks spanning narrative deduction, rule application, and constraint-satisfaction planning, a single fixed configuration improves over zero-shot Chain-of-Thought on every subtask, matches or surpasses expert-authored decompositions, and outperforms AWM at lower average inference cost.

Zhihan Lei, Jiarui Yan, Joshua Momo, William W. Cohen• 2026

Related benchmarks

TaskDatasetResultRank
Rule-governed ReasoningRuleArena NBA--
14
Meeting PlanningNatPlan meeting (test)
Accuracy29
12
Murder Mystery ReasoningMUSR murder (test)
Accuracy75
12
Trip PlanningNatural-plan Trip Planning (test)
EM Accuracy5.2
11
Multistep ReasoningMUSR object (test)
Accuracy68.9
6
Object Placement ReasoningMUSR object (test)
Accuracy68.9
6
Rule-following ReasoningRuleArena NBA (test)
Accuracy74.2
6
Multistep ReasoningMUSR team (test)
Accuracy68
6
Natural Language PlanningNatPlan trip (test)
Accuracy5.2
6
Team Allocation ReasoningMUSR team (test)
Accuracy68
6
Showing 10 of 10 rows

Other info

Follow for update