Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Whose Is This?: Context-Aware Object Ownership Inference with Uncertainty-Guided Questioning

About

Service robots must infer object ownership to correctly interpret instructions such as "bring me my cup." However, ownership is a latent attribute that cannot be directly observed, and existing methods often rely on limited cues such as recent usage, making them unreliable in scenarios such as temporary sharing. We propose a framework for context-aware ownership inference with uncertainty-guided interaction (COIN). The method integrates user background information and object usage history using a large language model (LLM) to estimate ownership scores. To handle uncertainty, we apply conformal prediction to construct a set of plausible owners and selectively generate user queries when the prediction is uncertain. Experiments in a simulated home environment show that the proposed method consistently outperforms baseline approaches, achieving a Subset Accuracy of 0.988 and a Mean Jaccard index of 0.991. The method also maintains high performance in scenarios involving temporary use and shared ownership. The results demonstrate that combining contextual reasoning with uncertainty-aware interaction improves both estimation accuracy and robustness. The project page is available at https://emergentsystemlabstudent.github.io/COIN/.

Saki Hashimoto, Akira Taniguchi, Shoichi Hasegawa, Yoshinobu Hagiwara, Tadahiro Taniguchi• 2026

Related benchmarks

TaskDatasetResultRank
Object IdentificationHOMER (Multi-user sharing)
Subset Accuracy100
5
Object Ownership IdentificationHomer (test)
Subset Accuracy98.7
5
Ownership inferenceHOMER
Subset Accuracy98.8
5
Contextual Ownership InferenceHOMER Single_user
Subset Accuracy98
5
Active Question GenerationActive Question Generation Evaluation Set
Number of Questions28.4
2
Showing 5 of 5 rows

Other info

Follow for update