Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ConTraIRL: Factorized Contrastive Abstractions for Transferable IRL

About

Reward transfer in Inverse Reinforcement Learning (IRL) is unreliable when policies must generalize to unseen combinations of environment dynamics and task goals. We propose Factorized Contrastive Abstractions for Transferable IRL (ConTraIRL), a framework that enables compositional reward transfer by learning decoupled latent representations of these two factors. ConTraIRL uses a dual-encoder architecture that maps observations into separate dynamics and goal latent spaces, trained with a dual contrastive objective. Temporal alignment encourages the dynamics encoder to learn goal-invariant structure, while the goal encoder captures dynamics-invariant features. This factorization supports reward inference under recombined dynamics-goal settings. Experiments on continuous control benchmarks demonstrate effective few-shot transfer to unseen dynamics-goal pairings, improving sample efficiency and reward recovery over transfer IRL baselines.

Yikang Gui, Bikramjit Banerjee, Prashant Doshi• 2026

Related benchmarks

TaskDatasetResultRank
Inverse Reinforcement LearningMuJoCo Ant
Normalized Return0.93
7
Inverse Reinforcement LearningMuJoCo Half-Cheetah
Normalized Return0.95
7
Inverse Reinforcement LearningMuJoCo Walker
Normalized Return0.96
7
Inverse Reinforcement LearningMuJoCo Swimmer target contexts
Normalized Return97
4
Showing 4 of 4 rows

Other info

Follow for update