Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

AURA: Intent-Directed Probing for Implicit-Need Surfacing in Situated LLM Agents

About

A situated query like "where is Lin Wei?" often encodes more than its literal content: the user may also want to know whether Lin Wei is free, in a good mood, or worth interrupting now. Standard tool-use agents answer the literal question and stop. AURA inserts an inference step between scene perception and tool use that produces an IntentFrame: a structured estimate of the implicit need with a scalar gap score that controls per-query probe budget and tool selection. On a 100-query four-scene implicit-intent benchmark, AURA improves implicit-need coverage over ReAct-style probing (Delta = +0.07, p < 10^-6); three of four scenes are individually significant, the gain reproduces on a second backbone, and a prompt ablation attributes the lift to gap calibration rather than answer memorisation. On factual lookup the controller trades raw accuracy for 82% fewer probes and zero forbidden-tool violations on a privacy-sensitive slice; scope conditions are detailed in Limitations. Code, simulator, and benchmark are released at https://github.com/innovation64/AURA.

Yang Li, Jiaxiang Liu, Jiang Cai, Mingkun Xu• 2026

Related benchmarks

TaskDatasetResultRank
Factual Question AnsweringAURATown environment-grounded queries N=50, 3 seeds 1.0
Factual Accuracy69.6
9
Implicit-intent surfacingAURATown Scene A v2 (pilot)
Literal Score95.7
6
Implicit-need coverage100-query four-scene benchmark v2 (full)
Overall Coverage80.4
3
Implicit-need coverage evaluationimplicit-intent Overall v2
Implicit-Need Coverage80.4
3
Implicit-need coverage evaluationimplicit-intent Scene A: cafe v2
Implicit-Need Coverage80
3
Implicit-need coverage evaluationimplicit-intent Scene B library v2
Implicit-Need Coverage77.9
3
Implicit-need coverage evaluationimplicit-intent Scene C: garden v2
Implicit Need Coverage81.1
3
Implicit-need coverage evaluationimplicit-intent v2 (Scene D: night)
Implicit-Need Coverage82.7
3
Question AnsweringLoCoMo 200-question
F119.2
3
Theory of Mind reasoningFANToM (400-question stratified split)
BeliefQA Accuracy66.2
3
Showing 10 of 16 rows

Other info

GitHub

Follow for update