Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MAGIK: Mapping to Analogous Goals via Imagination-enabled Knowledge Transfer

About

Humans excel at analogical reasoning - applying knowledge from one task to a related one with minimal relearning. In contrast, reinforcement learning (RL) agents typically require extensive retraining even when new tasks share structural similarities with previously learned ones. In this work, we propose MAGIK, a novel framework that enables RL agents to transfer knowledge to analogous tasks without interacting with the target environment. Our approach leverages an imagination mechanism to map entities in the target task to their analogues in the source domain, allowing the agent to reuse its original policy. Experiments on custom MiniGrid and MuJoCo tasks show that MAGIK achieves effective zero-shot transfer using only a small number of human-labelled examples. We compare our approach to related baselines and highlight how it offers a novel and effective mechanism for knowledge transfer via imagination-based analogy mapping.

Ajsal Shereef Palattuparambil, Thommen George Karimpanal, Santu Rana• 2025

Related benchmarks

TaskDatasetResultRank
Ball PickingMiniGrid Target 1 v1 (test)
Red Ball Picked Score8.2
8
Ball PickingMiniGrid Target 2 v1 (test)
Green Ball Pick Success9.2
7
Ball PickingMiniGrid Target 3 v1 (test)
Green Ball Picked Rate0.00e+0
7
Target ReachingReacher Red target task
Target Reach Count19.2
5
Target ReachingReacher Green (target task)
Target Reached Count19.2
5
Target ReachingReacher Yellow (target task)
Success Count19.6
5
Target ReachingReacher Blue (source task)
Target Reaches Count20
4
Showing 7 of 7 rows

Other info

Follow for update