AURA: Intent-Directed Probing for Implicit-Need Surfacing in Situated LLM Agents
About
A situated query like "where is Lin Wei?" often encodes more than its literal content: the user may also want to know whether Lin Wei is free, in a good mood, or worth interrupting now. Standard tool-use agents answer the literal question and stop. AURA inserts an inference step between scene perception and tool use that produces an IntentFrame: a structured estimate of the implicit need with a scalar gap score that controls per-query probe budget and tool selection. On a 100-query four-scene implicit-intent benchmark, AURA improves implicit-need coverage over ReAct-style probing (Delta = +0.07, p < 10^-6); three of four scenes are individually significant, the gain reproduces on a second backbone, and a prompt ablation attributes the lift to gap calibration rather than answer memorisation. On factual lookup the controller trades raw accuracy for 82% fewer probes and zero forbidden-tool violations on a privacy-sensitive slice; scope conditions are detailed in Limitations. Code, simulator, and benchmark are released at https://github.com/innovation64/AURA.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Factual Question Answering | AURATown environment-grounded queries N=50, 3 seeds 1.0 | Factual Accuracy69.6 | 9 | |
| Implicit-intent surfacing | AURATown Scene A v2 (pilot) | Literal Score95.7 | 6 | |
| Implicit-need coverage | 100-query four-scene benchmark v2 (full) | Overall Coverage80.4 | 3 | |
| Implicit-need coverage evaluation | implicit-intent Overall v2 | Implicit-Need Coverage80.4 | 3 | |
| Implicit-need coverage evaluation | implicit-intent Scene A: cafe v2 | Implicit-Need Coverage80 | 3 | |
| Implicit-need coverage evaluation | implicit-intent Scene B library v2 | Implicit-Need Coverage77.9 | 3 | |
| Implicit-need coverage evaluation | implicit-intent Scene C: garden v2 | Implicit Need Coverage81.1 | 3 | |
| Implicit-need coverage evaluation | implicit-intent v2 (Scene D: night) | Implicit-Need Coverage82.7 | 3 | |
| Question Answering | LoCoMo 200-question | F119.2 | 3 | |
| Theory of Mind reasoning | FANToM (400-question stratified split) | BeliefQA Accuracy66.2 | 3 |